Apr 09 12:37:49 devstack cinder-volume[72910]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 09 12:37:49 devstack cinder-volume[72910]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 09 12:37:49 devstack cinder-volume[72910]: we strongly recommend against using it for new projects.
Apr 09 12:37:49 devstack cinder-volume[72910]: If you are already using Eventlet, we recommend migrating to a different
Apr 09 12:37:49 devstack cinder-volume[72910]: framework.  For more detail see
Apr 09 12:37:49 devstack cinder-volume[72910]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 09 12:37:49 devstack cinder-volume[72910]:   import eventlet  # noqa
Apr 09 12:37:51 devstack cinder-volume[72910]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72910) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 09 12:37:51 devstack cinder-volume[72910]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72910) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 09 12:37:51 devstack cinder-volume[72910]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72910) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 09 12:37:51 devstack cinder-volume[72910]: INFO dbcounter [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] Registered counter for database cinder
Apr 09 12:37:51 devstack cinder-volume[72910]: DEBUG oslo_db.sqlalchemy.engines [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72910) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 09 12:37:51 devstack cinder-volume[72910]: DEBUG dbcounter [-] [72910] Writer thread running {{(pid=72910) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 09 12:37:51 devstack cinder-volume[72910]: INFO cinder.rpc [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 09 12:37:51 devstack cinder-volume[72910]: INFO cinder.rpc [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 09 12:37:51 devstack cinder-volume[72910]: DEBUG oslo_db.sqlalchemy.engines [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72910) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 09 12:37:51 devstack cinder-volume[72910]: INFO cinder.volume.manager [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] Determined volume DB was empty at startup.
Apr 09 12:37:51 devstack cinder-volume[72910]: DEBUG cinder.volume.manager [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72910) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 09 12:37:51 devstack cinder-volume[72910]: INFO cinder.volume.manager [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 09 12:37:51 devstack cinder-volume[72910]: WARNING stevedore.named [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 09 12:37:51 devstack cinder-volume[72910]: WARNING castellan.key_manager [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 09 12:37:51 devstack cinder-volume[72910]: WARNING cinder.keymgr.conf_key_mgr [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 09 12:37:51 devstack cinder-volume[72910]: DEBUG cinder.volume.drivers.lvm [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72910) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Apr 09 12:37:51 devstack cinder-volume[72910]: DEBUG oslo_concurrency.processutils [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_concurrency.processutils [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] CMD "cinder-rtstool verify" returned: 0 in 0.232s {{(pid=72910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_db.sqlalchemy.engines [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72910) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 09 12:37:52 devstack cinder-volume[72910]: INFO cinder.rpc [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Apr 09 12:37:52 devstack cinder-volume[72910]: INFO cinder.rpc [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Apr 09 12:37:52 devstack cinder-volume[72910]: WARNING stevedore.named [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 09 12:37:52 devstack cinder-volume[72910]: WARNING castellan.key_manager [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 09 12:37:52 devstack cinder-volume[72910]: INFO cinder.volume.manager [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_db.sqlalchemy.engines [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72910) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 09 12:37:52 devstack cinder-volume[72910]: INFO oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] Starting 1 workers
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] Started child 73013 {{(pid=72910) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] Full set of CONF: {{(pid=72910) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] ******************************************************************************** {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] Configuration options gathered from: {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] ================================================================================ {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] allow_availability_zone_fallback = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[73013]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] allow_compression_on_image_upload = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] allowed_direct_url_schemes     = [] {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] api_rate_limit                 = True {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] auth_strategy                  = keystone {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] az_cache_duration              = 3600 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_availability_zone      = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_host                   = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_name                   = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_stats_polling_interval = 60 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backup_api_class               = cinder.backup.api.API {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backup_name_template           = backup-%s {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backup_use_same_host           = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backup_use_temp_snapshot       = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] chap_password                  = **** {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] chap_username                  =  {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] cinder_internal_tenant_project_id = b3c6bd62af0945c28f5ce26cb83bb6b6 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] cinder_internal_tenant_user_id = b0f7dc36f9014681b367363a66a9f288 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] cloned_volume_same_az          = True {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] cluster                        = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] compression_format             = gzip {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] compute_api_class              = cinder.compute.nova.API {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] config_dir                     = [] {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] config_source                  = [] {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] control_exchange               = openstack {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] debug                          = True {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] default_availability_zone      = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] default_group_type             = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] default_volume_type            = lvmdriver-1 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] disk_geometry                  = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] driver_client_cert             = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] driver_client_cert_key         = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] driver_data_namespace          = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] driver_ssl_cert_path           = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] driver_ssl_cert_verify         = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] driver_use_ssl                 = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] enable_force_upload            = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] enable_new_services            = True {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] enable_unsupported_driver      = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] enforce_multipath_for_image_xfer = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] filter_function                = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] glance_api_insecure            = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] glance_api_servers             = ['http://192.168.122.250/image'] {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] glance_api_ssl_compression     = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] glance_ca_certificates_file    = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] glance_catalog_info            = image:glance:publicURL {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] glance_certfile                = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] glance_keyfile                 = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] glance_num_retries             = 3 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] glance_request_timeout         = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] goodness_function              = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] graceful_shutdown_timeout      = 5 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] group_api_class                = cinder.group.api.API {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] host                           = devstack {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] image_compress_on_upload       = True {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] image_conversion_address_space_limit = 1 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] image_conversion_cpu_limit     = 60 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] image_conversion_disable       = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] image_upload_use_cinder_backend = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] image_upload_use_internal_tenant = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] image_volume_cache_enabled     = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] image_volume_cache_max_count   = 0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] image_volume_cache_max_size_gb = 0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] init_host_max_objects_retrieval = 0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] instance_format                = [instance: %(uuid)s]  {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] iscsi_target_flags             =  {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] iscsi_write_cache              = on {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] iser_helper                    = tgtadm {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] iser_ip_address                = 192.168.122.250 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] iser_port                      = 3260 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] log_color                      = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] log_config_append              = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] log_dir                        = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] log_file                       = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] log_options                    = True {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] log_rotate_interval            = 1 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] log_rotate_interval_type       = days {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] log_rotation_type              = none {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] max_age                        = 0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] max_logfile_count              = 30 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] max_logfile_size_mb            = 200 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] max_over_subscription_ratio    = 20.0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] message_reap_interval          = 86400 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] message_ttl                    = 2592000 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] migration_create_volume_timeout_secs = 300 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] monkey_patch                   = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] monkey_patch_modules           = [] {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] my_ip                          = 192.168.122.250 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] no_snapshot_gb_quota           = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] num_iser_scan_tries            = 3 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] num_shell_tries                = 3 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] num_volume_device_scan_tries   = 3 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] nvmeof_conn_info_version       = 1 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] nvmet_ns_id                    = 10 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] nvmet_port_id                  = 1 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] osapi_max_limit                = 1000 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] osapi_volume_ext_list          = [] {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] osapi_volume_listen_port       = 8776 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] osapi_volume_use_ssl           = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] osapi_volume_workers           = 2 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] per_volume_size_limit          = -1 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] periodic_fuzzy_delay           = 60 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] periodic_interval              = 60 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] public_endpoint                = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] publish_errors                 = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] quota_backup_gigabytes         = 1000 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] quota_backups                  = 10 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] quota_gigabytes                = 1000 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] quota_groups                   = 10 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] quota_snapshots                = 10 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] quota_volumes                  = 10 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] rate_limit_burst               = 0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] rate_limit_except_level        = CRITICAL {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] rate_limit_interval            = 0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] reinit_driver_count            = 3 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] replication_device             = **** {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] report_discard_supported       = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] report_interval                = 120 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] reservation_clean_interval     = 86400 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] reservation_expire             = 86400 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] reserved_image_namespaces      = [] {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] reserved_percentage            = 0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[73013]: INFO cinder.volume.manager [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] rpc_response_timeout           = 120 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] run_external_periodic_tasks    = True {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] scst_target_driver             = iscsi {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] scst_target_iqn_name           = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] service_down_time              = 720 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] shell_completion               = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] snapshot_name_template         = snapshot-%s {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] snapshot_same_host             = True {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] split_loggers                  = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] state_path                     = /opt/stack/data/cinder {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] storage_availability_zone      = nova {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] storage_protocol               = iSCSI {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] syslog_log_facility            = LOG_USER {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] target_helper                  = lioadm {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] target_ip_address              = 192.168.122.250 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] target_port                    = 3260 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] target_protocol                = iscsi {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] target_secondary_ip_addresses  = [] {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] trace_flags                    = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] transport_url                  = **** {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] until_refresh                  = 0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] use_chap_auth                  = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] use_default_quota_class        = True {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] use_journal                    = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] use_json                       = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] use_multipath_for_image_xfer   = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] use_stderr                     = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] use_syslog                     = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] verify_glance_signatures       = enabled {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] volume_api_class               = cinder.volume.api.API {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] volume_backend_name            = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] volume_clear                   = zero {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] volume_clear_ionice            = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] volume_clear_size              = 0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] volume_copy_bps_limit          = 0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] volume_dd_blocksize            = 1M {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] volume_name_template           = volume-%s {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] volume_service_inithost_offload = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] volume_usage_audit_period      = month {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] zoning_mode                    = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_concurrency.disable_process_locking = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] keystone_authtoken.admin_password = **** {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] keystone_authtoken.admin_token = **** {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] keystone_authtoken.admin_user  = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] keystone_authtoken.auth_port   = 35357 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] keystone_authtoken.auth_protocol = https {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] keystone_authtoken.auth_section = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] keystone_authtoken.auth_type   = password {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] keystone_authtoken.auth_uri    = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] keystone_authtoken.auth_version = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] keystone_authtoken.cache       = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] keystone_authtoken.certfile    = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] keystone_authtoken.delay_auth_decision = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] keystone_authtoken.http_connect_timeout = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] keystone_authtoken.identity_uri = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] keystone_authtoken.include_service_catalog = True {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] keystone_authtoken.insecure    = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] keystone_authtoken.interface   = public {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] keystone_authtoken.keyfile     = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] keystone_authtoken.memcache_password =  {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.045s {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] keystone_authtoken.memcache_username =  {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] keystone_authtoken.region_name = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] keystone_authtoken.service_token_roles_required = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] keystone_authtoken.service_type = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] keystone_authtoken.token_cache_time = 300 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.250/identity {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] cache.backend                  = dogpile.cache.null {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] cache.backend_argument         = **** {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] cache.backend_expiration_time  = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] cache.config_prefix            = cache.oslo {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] cache.debug_cache_backend      = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] cache.enable_retry_client      = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] cache.enable_socket_keepalive  = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] cache.enabled                  = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] cache.enforce_fips_mode        = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] cache.expiration_time          = 600 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] cache.hashclient_retry_attempts = 2 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] cache.memcache_dead_retry      = 300 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] cache.memcache_pool_maxsize    = 10 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] cache.memcache_sasl_enabled    = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] cache.password                 = **** {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] cache.proxies                  = [] {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] cache.redis_db                 = 0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] cache.redis_sentinel_service_name = mymaster {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] cache.redis_server             = localhost:6379 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] cache.retry_attempts           = 2 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] cache.retry_delay              = 0.0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] cache.socket_keepalive_count   = 1 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] cache.socket_keepalive_idle    = 1 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] cache.socket_keepalive_interval = 1 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] cache.socket_timeout           = 1.0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] cache.tls_allowed_ciphers      = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] cache.tls_cafile               = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] cache.tls_certfile             = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] cache.tls_enabled              = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] cache.tls_keyfile              = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] cache.username                 = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] coordination.backend_url       = **** {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] database.asyncio_connection    = **** {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] database.asyncio_slave_connection = **** {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] database.backend               = sqlalchemy {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] database.connection            = **** {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] database.connection_debug      = 0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] database.connection_parameters =  {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] database.connection_recycle_time = 3600 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] database.connection_trace      = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] database.db_inc_retry_interval = True {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] database.db_max_retries        = 20 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] database.db_max_retry_interval = 10 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] database.db_retry_interval     = 1 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] database.max_overflow          = 50 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] database.max_pool_size         = 5 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] database.max_retries           = 10 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] database.mysql_wsrep_sync_wait = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] database.pool_timeout          = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] database.retry_interval        = 10 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] database.slave_connection      = **** {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] database.sqlite_synchronous    = True {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] database.synchronous_reader    = True {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] database.use_db_reconnect      = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] profiler.connection_string     = messaging:// {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] profiler.enabled               = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] profiler.es_doc_type           = notification {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] profiler.es_scroll_size        = 10000 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] profiler.es_scroll_time        = 2m {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] profiler.filter_error_trace    = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] profiler.hmac_keys             = **** {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] profiler.sentinel_service_name = mymaster {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] profiler.socket_timeout        = 0.1 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] profiler.trace_requests        = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] profiler.trace_sqlalchemy      = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] profiler_jaeger.process_tags   = {} {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] profiler_jaeger.service_name_prefix = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] profiler_otlp.service_name_prefix = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_policy.enforce_new_defaults = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: WARNING oslo_config.cfg [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_policy.enforce_scope      = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_policy.policy_default_rule = default {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_policy.policy_file        = policy.yaml {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] privsep_osbrick.group          = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] privsep_osbrick.helper_command = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] privsep_osbrick.user           = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] cinder_sys_admin.group         = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] cinder_sys_admin.helper_command = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.042s {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] cinder_sys_admin.user          = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] service_user.auth_section      = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] service_user.auth_type         = password {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] service_user.cafile            = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] service_user.certfile          = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] service_user.collect_timing    = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] service_user.insecure          = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] service_user.keyfile           = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] service_user.send_service_user_token = True {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] service_user.split_loggers     = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] service_user.timeout           = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] glance.auth_section            = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] glance.auth_type               = password {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] glance.certfile                = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] glance.collect_timing          = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] glance.insecure                = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] glance.keyfile                 = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] glance.region_name             = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] glance.split_loggers           = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] glance.timeout                 = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.backend_availability_zone = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.chap_password = **** {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.chap_username =  {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.disk_geometry = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.driver_client_cert = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.driver_client_cert_key = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.driver_data_namespace = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.driver_use_ssl = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.enable_unsupported_driver = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.extra_capabilities = {} {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.filter_function = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.goodness_function = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.iscsi_target_flags =  {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.iscsi_write_cache = on {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.iser_helper   = tgtadm {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.iser_ip_address = 192.168.122.250 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.iser_port     = 3260 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.lvm_share_target = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.lvm_type      = auto {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.num_shell_tries = 3 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.nvmet_port_id = 1 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.replication_device = **** {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.report_discard_supported = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.reserved_percentage = 0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.scst_target_driver = iscsi {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.scst_target_iqn_name = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.storage_protocol = iSCSI {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.target_helper = tgtadm {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.target_ip_address = 192.168.122.250 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.target_port   = 3260 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.target_protocol = iscsi {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.trace_flags   = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.unique_fqdn_network = True {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.use_chap_auth = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.volume_backend_name = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.volume_clear  = zero {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.volume_clear_ionice = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.volume_clear_size = 0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_reports.file_event_handler = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_reports.log_dir           = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.backend_availability_zone = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.backend_host       = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.chap_password      = **** {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.chap_username      = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.disk_geometry      = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.driver_client_cert = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.driver_data_namespace = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.extra_capabilities = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.filter_function    = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.goodness_function  = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.iser_helper        = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.iser_ip_address    = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.iser_port          = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.iser_target_prefix = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.lvm_share_target   = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.lvm_type           = auto {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.num_shell_tries    = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.replication_device = **** {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.report_discard_supported = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.reserved_percentage = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.scst_target_driver = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.storage_protocol   = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.target_helper      = lioadm {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.target_ip_address  = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.target_port        = 3260 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.trace_flags        = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.use_chap_auth      = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.volume_clear       = zero {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.volume_clear_size  = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] lvmdriver-1.volumes_dir        = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack sudo[73018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Apr 09 12:37:52 devstack sudo[73018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_messaging_rabbit.ssl      = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_messaging_notifications.driver = [] {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_messaging_notifications.retry = -1 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] key_manager.fixed_key          = **** {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] barbican.barbican_api_version  = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] barbican.barbican_endpoint     = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] barbican.barbican_endpoint_type = public {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] barbican.barbican_region_name  = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] barbican.cafile                = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] barbican.certfile              = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] barbican.collect_timing        = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] barbican.insecure              = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] barbican.keyfile               = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] barbican.number_of_retries     = 60 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] barbican.retry_delay           = 1 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] barbican.send_service_user_token = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] barbican.split_loggers         = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] barbican.timeout               = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] barbican.verify_ssl            = True {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] barbican.verify_ssl_path       = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] barbican_service_user.auth_section = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] barbican_service_user.auth_type = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] barbican_service_user.cafile   = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] barbican_service_user.certfile = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] barbican_service_user.collect_timing = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] barbican_service_user.insecure = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] barbican_service_user.keyfile  = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] barbican_service_user.split_loggers = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] barbican_service_user.timeout  = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] vault.approle_role_id          = **** {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] vault.approle_secret_id        = **** {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] vault.kv_mountpoint            = secret {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] vault.kv_path                  = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] vault.kv_version               = 2 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] vault.namespace                = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] vault.root_token_id            = **** {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] vault.ssl_ca_crt_file          = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] vault.timeout                  = 60.0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] vault.use_ssl                  = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:37:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] ******************************************************************************** {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 09 12:37:53 devstack sudo[73018]: pam_unix(sudo:session): session closed for user root
Apr 09 12:37:53 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.579s {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:37:53 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:37:53 devstack sudo[73023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 09 12:37:53 devstack sudo[73023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:37:53 devstack sudo[73023]: pam_unix(sudo:session): session closed for user root
Apr 09 12:37:53 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.545s {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:37:53 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 09 12:37:53 devstack cinder-volume[73013]: INFO cinder.brick.local_dev.lvm [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Apr 09 12:37:53 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:37:53 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:37:53 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:37:53 devstack sudo[73222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 09 12:37:53 devstack sudo[73222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:37:54 devstack sudo[73222]: pam_unix(sudo:session): session closed for user root
Apr 09 12:37:54 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.527s {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:37:54 devstack cinder-volume[73013]: DEBUG cinder.brick.local_dev.lvm [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=73013) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Apr 09 12:37:54 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:37:54 devstack sudo[73499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 09 12:37:54 devstack sudo[73499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:37:55 devstack sudo[73499]: pam_unix(sudo:session): session closed for user root
Apr 09 12:37:55 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.129s {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:37:55 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:37:55 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:37:55 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:37:55 devstack sudo[73677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 09 12:37:55 devstack sudo[73677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:37:55 devstack sudo[73677]: pam_unix(sudo:session): session closed for user root
Apr 09 12:37:55 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.482s {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:37:55 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:37:55 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:37:55 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:37:55 devstack sudo[73712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Apr 09 12:37:55 devstack sudo[73712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:37:56 devstack sudo[73712]: pam_unix(sudo:session): session closed for user root
Apr 09 12:37:56 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.479s {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:37:56 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:37:56 devstack sudo[73715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 09 12:37:56 devstack sudo[73715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:37:56 devstack sudo[73715]: pam_unix(sudo:session): session closed for user root
Apr 09 12:37:56 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.469s {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:37:56 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:37:56 devstack sudo[73720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 09 12:37:56 devstack sudo[73720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:37:57 devstack sudo[73720]: pam_unix(sudo:session): session closed for user root
Apr 09 12:37:57 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.567s {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:37:57 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:37:57 devstack sudo[73724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 09 12:37:57 devstack sudo[73724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:37:57 devstack sudo[73724]: pam_unix(sudo:session): session closed for user root
Apr 09 12:37:57 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.478s {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:37:57 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:37:57 devstack sudo[73732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 09 12:37:57 devstack sudo[73732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:37:58 devstack sudo[73732]: pam_unix(sudo:session): session closed for user root
Apr 09 12:37:58 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.484s {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:37:58 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:37:58 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:37:58 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:37:58 devstack sudo[73736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 09 12:37:58 devstack sudo[73736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:37:58 devstack sudo[73736]: pam_unix(sudo:session): session closed for user root
Apr 09 12:37:58 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.501s {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:37:58 devstack cinder-volume[73013]: INFO cinder.volume.drivers.lvm [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Apr 09 12:37:58 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:37:58 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:37:58 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:37:58 devstack sudo[73813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 09 12:37:58 devstack sudo[73813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:37:59 devstack sudo[73813]: pam_unix(sudo:session): session closed for user root
Apr 09 12:37:59 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.483s {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:37:59 devstack cinder-volume[73013]: DEBUG cinder.volume.drivers.lvm [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] Updating volume stats {{(pid=73013) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 09 12:37:59 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:37:59 devstack sudo[73863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 09 12:37:59 devstack sudo[73863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:37:59 devstack sudo[73863]: pam_unix(sudo:session): session closed for user root
Apr 09 12:37:59 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.450s {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:37:59 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:37:59 devstack sudo[74001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 09 12:37:59 devstack sudo[74001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:38:00 devstack sudo[74001]: pam_unix(sudo:session): session closed for user root
Apr 09 12:38:00 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.451s {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:38:00 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:38:00 devstack sudo[74005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 09 12:38:00 devstack sudo[74005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:38:00 devstack sudo[74005]: pam_unix(sudo:session): session closed for user root
Apr 09 12:38:00 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.447s {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:38:00 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:38:00 devstack sudo[74009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 09 12:38:00 devstack sudo[74009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:38:01 devstack sudo[74009]: pam_unix(sudo:session): session closed for user root
Apr 09 12:38:01 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.469s {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:38:01 devstack cinder-volume[73013]: INFO cinder.volume.driver [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] Driver hasn't implemented _init_vendor_properties()
Apr 09 12:38:01 devstack cinder-volume[73013]: DEBUG cinder.volume.driver [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=73013) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 09 12:38:01 devstack cinder-volume[73013]: DEBUG oslo_db.sqlalchemy.engines [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73013) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 09 12:38:01 devstack cinder-volume[73013]: DEBUG dbcounter [-] [73013] Writer thread running {{(pid=73013) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 09 12:38:01 devstack cinder-volume[73013]: DEBUG cinder.db.sqlalchemy.api [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] Building query based on filter {{(pid=73013) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 09 12:38:01 devstack cinder-volume[73013]: DEBUG cinder.image.image_utils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=73013) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 09 12:38:01 devstack cinder-volume[73013]: INFO cinder.keymgr.migration [None req-6534d7ca-d129-405d-b479-de29b6a90097 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 09 12:38:01 devstack cinder-volume[73013]: DEBUG cinder.volume.drivers.lvm [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] Updating volume stats {{(pid=73013) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 09 12:38:01 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:38:01 devstack sudo[74013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 09 12:38:01 devstack sudo[74013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:38:01 devstack sudo[74013]: pam_unix(sudo:session): session closed for user root
Apr 09 12:38:01 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.438s {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:38:01 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:38:01 devstack sudo[74020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 09 12:38:01 devstack sudo[74020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:38:02 devstack sudo[74020]: pam_unix(sudo:session): session closed for user root
Apr 09 12:38:02 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.457s {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:38:02 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:38:02 devstack sudo[74024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 09 12:38:02 devstack sudo[74024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:38:02 devstack cinder-volume[72910]: DEBUG dbcounter [-] [72910] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72910) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 12:38:02 devstack sudo[74024]: pam_unix(sudo:session): session closed for user root
Apr 09 12:38:02 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.480s {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:38:02 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:38:02 devstack sudo[74030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 09 12:38:02 devstack sudo[74030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:38:03 devstack sudo[74030]: pam_unix(sudo:session): session closed for user root
Apr 09 12:38:03 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.555s {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:38:03 devstack cinder-volume[73013]: DEBUG cinder.manager [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] Notifying Schedulers of capabilities ... {{(pid=73013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:38:03 devstack cinder-volume[73013]: INFO cinder.volume.manager [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] Driver initialization completed successfully.
Apr 09 12:38:03 devstack cinder-volume[73013]: INFO cinder.manager [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] Initiating service 2 cleanup
Apr 09 12:38:03 devstack cinder-volume[73013]: INFO cinder.manager [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] Service 2 cleanup completed.
Apr 09 12:38:03 devstack cinder-volume[73013]: DEBUG cinder.service [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] Creating RPC server for service cinder-volume {{(pid=73013) start /opt/stack/cinder/cinder/service.py:231}}
Apr 09 12:38:03 devstack cinder-volume[73013]: DEBUG cinder.service [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=73013) start /opt/stack/cinder/cinder/service.py:237}}
Apr 09 12:38:03 devstack cinder-volume[73013]: INFO cinder.volume.manager [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Apr 09 12:38:03 devstack cinder-volume[73013]: DEBUG cinder.volume.drivers.lvm [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] Updating volume stats {{(pid=73013) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 09 12:38:03 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:38:03 devstack sudo[74035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 09 12:38:03 devstack sudo[74035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:38:03 devstack sudo[74035]: pam_unix(sudo:session): session closed for user root
Apr 09 12:38:03 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.499s {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:38:03 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:38:03 devstack sudo[74041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 09 12:38:03 devstack sudo[74041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:38:04 devstack sudo[74041]: pam_unix(sudo:session): session closed for user root
Apr 09 12:38:04 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.464s {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:38:04 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:38:04 devstack sudo[74098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 09 12:38:04 devstack sudo[74098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:38:04 devstack sudo[74098]: pam_unix(sudo:session): session closed for user root
Apr 09 12:38:04 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.461s {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:38:04 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:38:04 devstack sudo[74101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 09 12:38:04 devstack sudo[74101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:38:05 devstack sudo[74101]: pam_unix(sudo:session): session closed for user root
Apr 09 12:38:05 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.460s {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:38:05 devstack cinder-volume[73013]: INFO cinder.volume.manager [None req-eb838301-1653-4682-a59b-89458bdfcdd6 None None] Driver post RPC initialization completed successfully.
Apr 09 12:38:13 devstack cinder-volume[73013]: DEBUG dbcounter [-] [73013] Writing DB stats cinder:SELECT=2 {{(pid=73013) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 12:38:15 devstack cinder-volume[73013]: DEBUG dbcounter [-] [73013] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=73013) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 12:39:03 devstack cinder-volume[73013]: DEBUG oslo_service.periodic_task [None req-4f298278-69c7-4127-b874-d71811cf15f6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73013) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 09 12:39:03 devstack cinder-volume[73013]: DEBUG cinder.volume.drivers.lvm [None req-4f298278-69c7-4127-b874-d71811cf15f6 None None] Updating volume stats {{(pid=73013) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 09 12:39:03 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-4f298278-69c7-4127-b874-d71811cf15f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:39:03 devstack sudo[78831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 09 12:39:03 devstack sudo[78831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:39:03 devstack sudo[78831]: pam_unix(sudo:session): session closed for user root
Apr 09 12:39:03 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-4f298278-69c7-4127-b874-d71811cf15f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.432s {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:39:03 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-4f298278-69c7-4127-b874-d71811cf15f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:39:03 devstack sudo[78834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 09 12:39:03 devstack sudo[78834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:39:04 devstack sudo[78834]: pam_unix(sudo:session): session closed for user root
Apr 09 12:39:04 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-4f298278-69c7-4127-b874-d71811cf15f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.429s {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:39:04 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-4f298278-69c7-4127-b874-d71811cf15f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:39:04 devstack sudo[78837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 09 12:39:04 devstack sudo[78837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:39:04 devstack sudo[78837]: pam_unix(sudo:session): session closed for user root
Apr 09 12:39:04 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-4f298278-69c7-4127-b874-d71811cf15f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.479s {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:39:04 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-4f298278-69c7-4127-b874-d71811cf15f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:39:04 devstack sudo[78841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 09 12:39:04 devstack sudo[78841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:39:04 devstack sudo[78841]: pam_unix(sudo:session): session closed for user root
Apr 09 12:39:04 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-4f298278-69c7-4127-b874-d71811cf15f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.436s {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:39:04 devstack cinder-volume[73013]: DEBUG cinder.manager [None req-4f298278-69c7-4127-b874-d71811cf15f6 None None] Notifying Schedulers of capabilities ... {{(pid=73013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:40:03 devstack cinder-volume[73013]: DEBUG oslo_service.periodic_task [None req-4f298278-69c7-4127-b874-d71811cf15f6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73013) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 09 12:40:03 devstack cinder-volume[73013]: DEBUG cinder.volume.drivers.lvm [None req-4f298278-69c7-4127-b874-d71811cf15f6 None None] Updating volume stats {{(pid=73013) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 09 12:40:03 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-4f298278-69c7-4127-b874-d71811cf15f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:40:03 devstack sudo[79798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 09 12:40:03 devstack sudo[79798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:40:03 devstack sudo[79798]: pam_unix(sudo:session): session closed for user root
Apr 09 12:40:03 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-4f298278-69c7-4127-b874-d71811cf15f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.482s {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:40:03 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-4f298278-69c7-4127-b874-d71811cf15f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:40:03 devstack sudo[79854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 09 12:40:03 devstack sudo[79854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:40:04 devstack sudo[79854]: pam_unix(sudo:session): session closed for user root
Apr 09 12:40:04 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-4f298278-69c7-4127-b874-d71811cf15f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.508s {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:40:04 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-4f298278-69c7-4127-b874-d71811cf15f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:40:04 devstack sudo[79874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 09 12:40:04 devstack sudo[79874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:40:04 devstack sudo[79874]: pam_unix(sudo:session): session closed for user root
Apr 09 12:40:04 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-4f298278-69c7-4127-b874-d71811cf15f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.451s {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:40:04 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-4f298278-69c7-4127-b874-d71811cf15f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:40:04 devstack sudo[79883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 09 12:40:04 devstack sudo[79883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:40:05 devstack sudo[79883]: pam_unix(sudo:session): session closed for user root
Apr 09 12:40:05 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-4f298278-69c7-4127-b874-d71811cf15f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.460s {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:40:05 devstack cinder-volume[73013]: DEBUG cinder.manager [None req-4f298278-69c7-4127-b874-d71811cf15f6 None None] Notifying Schedulers of capabilities ... {{(pid=73013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:40:15 devstack cinder-volume[73013]: DEBUG dbcounter [-] [73013] Writing DB stats cinder:SELECT=1 {{(pid=73013) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 12:40:15 devstack cinder-volume[73013]: DEBUG dbcounter [-] [73013] Writing DB stats cinder:UPDATE=1 {{(pid=73013) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 12:41:03 devstack cinder-volume[73013]: DEBUG oslo_service.periodic_task [None req-4f298278-69c7-4127-b874-d71811cf15f6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73013) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 09 12:41:03 devstack cinder-volume[73013]: DEBUG cinder.volume.drivers.lvm [None req-4f298278-69c7-4127-b874-d71811cf15f6 None None] Updating volume stats {{(pid=73013) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 09 12:41:03 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-4f298278-69c7-4127-b874-d71811cf15f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:41:03 devstack sudo[81553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 09 12:41:03 devstack sudo[81553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:41:03 devstack sudo[81553]: pam_unix(sudo:session): session closed for user root
Apr 09 12:41:03 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-4f298278-69c7-4127-b874-d71811cf15f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.481s {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:41:03 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-4f298278-69c7-4127-b874-d71811cf15f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:41:03 devstack sudo[81557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 09 12:41:03 devstack sudo[81557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:41:04 devstack sudo[81557]: pam_unix(sudo:session): session closed for user root
Apr 09 12:41:04 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-4f298278-69c7-4127-b874-d71811cf15f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.497s {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:41:04 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-4f298278-69c7-4127-b874-d71811cf15f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:41:04 devstack sudo[81571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 09 12:41:04 devstack sudo[81571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:41:04 devstack sudo[81571]: pam_unix(sudo:session): session closed for user root
Apr 09 12:41:04 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-4f298278-69c7-4127-b874-d71811cf15f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.489s {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:41:04 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-4f298278-69c7-4127-b874-d71811cf15f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:41:04 devstack sudo[81574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 09 12:41:04 devstack sudo[81574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:41:05 devstack sudo[81574]: pam_unix(sudo:session): session closed for user root
Apr 09 12:41:05 devstack cinder-volume[73013]: DEBUG oslo_concurrency.processutils [None req-4f298278-69c7-4127-b874-d71811cf15f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.468s {{(pid=73013) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:41:05 devstack cinder-volume[73013]: DEBUG cinder.manager [None req-4f298278-69c7-4127-b874-d71811cf15f6 None None] Notifying Schedulers of capabilities ... {{(pid=73013) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:41:30 devstack cinder-volume[72910]: INFO oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] Caught SIGTERM, stopping children
Apr 09 12:41:30 devstack cinder-volume[72910]: DEBUG oslo_concurrency.lockutils [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] Acquiring lock "singleton_lock" {{(pid=72910) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 09 12:41:30 devstack cinder-volume[72910]: DEBUG oslo_concurrency.lockutils [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] Acquired lock "singleton_lock" {{(pid=72910) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 09 12:41:30 devstack cinder-volume[72910]: DEBUG oslo_concurrency.lockutils [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] Releasing lock "singleton_lock" {{(pid=72910) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 09 12:41:30 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] Stop services. {{(pid=72910) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 09 12:41:30 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] Killing children. {{(pid=72910) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 09 12:41:30 devstack cinder-volume[72910]: INFO oslo_service.backend._eventlet.service [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] Waiting on 1 children to exit
Apr 09 12:41:35 devstack cinder-volume[73013]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting
Apr 09 12:41:35 devstack cinder-volume[82232]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 09 12:41:35 devstack cinder-volume[82232]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 09 12:41:35 devstack cinder-volume[82232]: we strongly recommend against using it for new projects.
Apr 09 12:41:35 devstack cinder-volume[82232]: If you are already using Eventlet, we recommend migrating to a different
Apr 09 12:41:35 devstack cinder-volume[82232]: framework.  For more detail see
Apr 09 12:41:35 devstack cinder-volume[82232]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 09 12:41:35 devstack cinder-volume[82232]:   import eventlet  # noqa
Apr 09 12:41:37 devstack cinder-volume[82232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 09 12:41:37 devstack cinder-volume[82232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 09 12:41:37 devstack cinder-volume[82232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 09 12:41:38 devstack cinder-volume[73013]: DEBUG oslo_concurrency.lockutils [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] Acquiring lock "singleton_lock" {{(pid=73013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 09 12:41:38 devstack cinder-volume[73013]: DEBUG oslo_concurrency.lockutils [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] Acquired lock "singleton_lock" {{(pid=73013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 09 12:41:38 devstack cinder-volume[73013]: DEBUG oslo_concurrency.lockutils [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] Releasing lock "singleton_lock" {{(pid=73013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 09 12:41:38 devstack cinder-volume[73013]: WARNING amqp [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 09 12:41:38 devstack cinder-volume[73013]: WARNING amqp [None req-9ef8a6c6-69f1-4ee1-97c9-fc0df59e91d7 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 09 12:41:38 devstack cinder-volume[82232]: INFO dbcounter [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] Registered counter for database cinder
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_db.sqlalchemy.engines [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82232) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG dbcounter [-] [82232] Writer thread running {{(pid=82232) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 09 12:41:38 devstack cinder-volume[82232]: INFO cinder.rpc [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 09 12:41:38 devstack cinder-volume[82232]: INFO cinder.rpc [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_db.sqlalchemy.engines [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82232) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 09 12:41:38 devstack cinder-volume[82232]: INFO cinder.volume.manager [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] Determined volume DB was empty at startup.
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG cinder.volume.manager [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82232) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 09 12:41:38 devstack cinder-volume[82232]: INFO cinder.volume.manager [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 09 12:41:38 devstack cinder-volume[82232]: WARNING stevedore.named [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 09 12:41:38 devstack cinder-volume[82232]: WARNING castellan.key_manager [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 09 12:41:38 devstack cinder-volume[82232]: WARNING cinder.keymgr.conf_key_mgr [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 09 12:41:38 devstack cinder-volume[82232]: INFO cinder.volume.manager [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_db.sqlalchemy.engines [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82232) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 09 12:41:38 devstack cinder-volume[82232]: INFO oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] Starting 1 workers
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] Started child 82383 {{(pid=82232) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] Full set of CONF: {{(pid=82232) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] ******************************************************************************** {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] Configuration options gathered from: {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] ================================================================================ {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] allow_availability_zone_fallback = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] allow_compression_on_image_upload = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82383]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] allowed_direct_url_schemes     = [] {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] api_rate_limit                 = True {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] auth_strategy                  = keystone {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_availability_zone      = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_host                   = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_name                   = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_stats_polling_interval = 60 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backup_api_class               = cinder.backup.api.API {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backup_name_template           = backup-%s {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backup_use_same_host           = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backup_use_temp_snapshot       = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] chap_password                  = **** {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] chap_username                  =  {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] cinder_internal_tenant_project_id = b3c6bd62af0945c28f5ce26cb83bb6b6 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] cinder_internal_tenant_user_id = b0f7dc36f9014681b367363a66a9f288 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] cluster                        = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] compression_format             = gzip {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] compute_api_class              = cinder.compute.nova.API {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] config_dir                     = [] {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] config_source                  = [] {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] control_exchange               = openstack {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] debug                          = True {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] default_availability_zone      = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] default_group_type             = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] default_volume_type            = QuobyteHD {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] disk_geometry                  = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] driver_client_cert             = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] driver_client_cert_key         = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] driver_data_namespace          = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] driver_ssl_cert_path           = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] driver_ssl_cert_verify         = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] driver_use_ssl                 = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] enable_new_services            = True {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] enable_unsupported_driver      = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] enabled_backends               = ['QuobyteHD'] {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] enforce_multipath_for_image_xfer = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] filter_function                = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] glance_api_insecure            = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] glance_api_servers             = ['http://192.168.122.250/image'] {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] glance_api_ssl_compression     = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] glance_ca_certificates_file    = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] glance_catalog_info            = image:glance:publicURL {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] glance_certfile                = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] glance_keyfile                 = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] glance_num_retries             = 3 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] glance_request_timeout         = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] goodness_function              = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] graceful_shutdown_timeout      = 5 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] group_api_class                = cinder.group.api.API {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] host                           = devstack {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] image_compress_on_upload       = True {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] image_conversion_address_space_limit = 1 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] image_conversion_cpu_limit     = 60 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] image_conversion_disable       = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] image_upload_use_cinder_backend = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] image_upload_use_internal_tenant = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] image_volume_cache_enabled     = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] image_volume_cache_max_count   = 0 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] image_volume_cache_max_size_gb = 0 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] init_host_max_objects_retrieval = 0 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] instance_format                = [instance: %(uuid)s]  {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] iscsi_target_flags             =  {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] iscsi_write_cache              = on {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] iser_helper                    = tgtadm {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] iser_ip_address                = 192.168.122.250 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] iser_port                      = 3260 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] log_color                      = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] log_config_append              = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] log_dir                        = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] log_file                       = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] log_options                    = True {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] log_rotate_interval            = 1 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] log_rotate_interval_type       = days {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] log_rotation_type              = none {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] max_age                        = 0 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] max_logfile_count              = 30 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] max_logfile_size_mb            = 200 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] max_over_subscription_ratio    = 20.0 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] message_reap_interval          = 86400 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] message_ttl                    = 2592000 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] migration_create_volume_timeout_secs = 300 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] monkey_patch                   = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] monkey_patch_modules           = [] {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] my_ip                          = 192.168.122.250 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] no_snapshot_gb_quota           = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] num_iser_scan_tries            = 3 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] num_shell_tries                = 3 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] num_volume_device_scan_tries   = 3 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] nvmeof_conn_info_version       = 1 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] nvmet_ns_id                    = 10 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] nvmet_port_id                  = 1 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] osapi_max_limit                = 1000 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] osapi_volume_ext_list          = [] {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82383]: INFO cinder.volume.manager [None req-e1df4d0d-d489-48b7-b52b-ee5a9cefcf2f None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] osapi_volume_listen_port       = 8776 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] osapi_volume_use_ssl           = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] osapi_volume_workers           = 2 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82383]: DEBUG cinder.volume.drivers.remotefs [None req-e1df4d0d-d489-48b7-b52b-ee5a9cefcf2f None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82383) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] per_volume_size_limit          = -1 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] periodic_fuzzy_delay           = 60 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] periodic_interval              = 60 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] public_endpoint                = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] publish_errors                 = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] quota_backup_gigabytes         = 1000 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] quota_backups                  = 10 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] quota_gigabytes                = 1000 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] quota_groups                   = 10 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] quota_snapshots                = 10 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] quota_volumes                  = 10 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] rate_limit_burst               = 0 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] rate_limit_except_level        = CRITICAL {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] rate_limit_interval            = 0 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] reinit_driver_count            = 3 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] replication_device             = **** {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] report_discard_supported       = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] report_interval                = 120 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] reservation_clean_interval     = 86400 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] reservation_expire             = 86400 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] reserved_image_namespaces      = [] {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] reserved_percentage            = 0 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] rpc_response_timeout           = 120 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] run_external_periodic_tasks    = True {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] scst_target_driver             = iscsi {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] scst_target_iqn_name           = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] service_down_time              = 720 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] shell_completion               = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] snapshot_name_template         = snapshot-%s {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] split_loggers                  = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] state_path                     = /opt/stack/data/cinder {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] storage_availability_zone      = nova {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] storage_protocol               = iSCSI {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] syslog_log_facility            = LOG_USER {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] target_helper                  = lioadm {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] target_ip_address              = 192.168.122.250 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] target_port                    = 3260 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] target_protocol                = iscsi {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] target_secondary_ip_addresses  = [] {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] trace_flags                    = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] transport_url                  = **** {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] until_refresh                  = 0 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] use_chap_auth                  = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] use_default_quota_class        = True {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] use_journal                    = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] use_json                       = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] use_multipath_for_image_xfer   = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] use_stderr                     = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] use_syslog                     = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] verify_glance_signatures       = enabled {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] volume_api_class               = cinder.volume.api.API {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] volume_backend_name            = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] volume_clear                   = zero {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] volume_clear_ionice            = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] volume_clear_size              = 0 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] volume_copy_bps_limit          = 0 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] volume_dd_blocksize            = 1M {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] volume_name_template           = volume-%s {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] volume_service_inithost_offload = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] volume_usage_audit_period      = month {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] zoning_mode                    = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_concurrency.disable_process_locking = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] keystone_authtoken.admin_password = **** {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] keystone_authtoken.admin_token = **** {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] keystone_authtoken.admin_user  = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] keystone_authtoken.auth_port   = 35357 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] keystone_authtoken.auth_protocol = https {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] keystone_authtoken.auth_section = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] keystone_authtoken.auth_type   = password {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] keystone_authtoken.auth_uri    = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] keystone_authtoken.auth_version = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] keystone_authtoken.cache       = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] keystone_authtoken.certfile    = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] keystone_authtoken.identity_uri = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] keystone_authtoken.include_service_catalog = True {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] keystone_authtoken.insecure    = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] keystone_authtoken.interface   = public {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] keystone_authtoken.keyfile     = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] keystone_authtoken.memcache_password =  {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] keystone_authtoken.memcache_username =  {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] keystone_authtoken.region_name = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] keystone_authtoken.service_type = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.250/identity {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] cache.backend                  = dogpile.cache.null {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] cache.backend_argument         = **** {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] cache.backend_expiration_time  = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] cache.config_prefix            = cache.oslo {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] cache.debug_cache_backend      = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] cache.enable_retry_client      = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] cache.enable_socket_keepalive  = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] cache.enabled                  = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] cache.enforce_fips_mode        = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] cache.expiration_time          = 600 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] cache.hashclient_retry_attempts = 2 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] cache.memcache_dead_retry      = 300 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] cache.memcache_pool_maxsize    = 10 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] cache.memcache_sasl_enabled    = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] cache.password                 = **** {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] cache.proxies                  = [] {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] cache.redis_db                 = 0 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] cache.redis_server             = localhost:6379 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] cache.retry_attempts           = 2 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] cache.retry_delay              = 0.0 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] cache.socket_keepalive_count   = 1 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] cache.socket_keepalive_idle    = 1 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] cache.socket_keepalive_interval = 1 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] cache.socket_timeout           = 1.0 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] cache.tls_allowed_ciphers      = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] cache.tls_cafile               = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] cache.tls_certfile             = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] cache.tls_enabled              = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] cache.tls_keyfile              = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] cache.username                 = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] coordination.backend_url       = **** {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] database.asyncio_connection    = **** {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] database.asyncio_slave_connection = **** {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] database.backend               = sqlalchemy {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] database.connection            = **** {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] database.connection_debug      = 0 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] database.connection_parameters =  {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82383]: DEBUG cinder.volume.drivers.quobyte [None req-e1df4d0d-d489-48b7-b52b-ee5a9cefcf2f None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82383) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] database.connection_recycle_time = 3600 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] database.connection_trace      = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] database.db_inc_retry_interval = True {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] database.db_max_retries        = 20 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82383]: WARNING cinder.volume.drivers.quobyte [None req-e1df4d0d-d489-48b7-b52b-ee5a9cefcf2f None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] database.db_max_retry_interval = 10 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82383]: WARNING cinder.volume.drivers.quobyte [None req-e1df4d0d-d489-48b7-b52b-ee5a9cefcf2f None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] database.db_retry_interval     = 1 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] database.max_overflow          = 50 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] database.max_pool_size         = 5 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] database.max_retries           = 10 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82383]: DEBUG oslo_concurrency.processutils [None req-e1df4d0d-d489-48b7-b52b-ee5a9cefcf2f None None] Running cmd (subprocess): mount.quobyte {{(pid=82383) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] database.mysql_wsrep_sync_wait = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] database.pool_timeout          = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] database.retry_interval        = 10 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] database.slave_connection      = **** {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] database.sqlite_synchronous    = True {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] database.synchronous_reader    = True {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] database.use_db_reconnect      = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] profiler.connection_string     = messaging:// {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] profiler.enabled               = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] profiler.es_doc_type           = notification {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] profiler.es_scroll_size        = 10000 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] profiler.es_scroll_time        = 2m {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] profiler.filter_error_trace    = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] profiler.hmac_keys             = **** {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] profiler.sentinel_service_name = mymaster {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] profiler.socket_timeout        = 0.1 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] profiler.trace_requests        = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] profiler.trace_sqlalchemy      = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] profiler_jaeger.process_tags   = {} {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] profiler_jaeger.service_name_prefix = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] profiler_otlp.service_name_prefix = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_policy.enforce_new_defaults = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: WARNING oslo_config.cfg [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_policy.enforce_scope      = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_policy.policy_default_rule = default {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_policy.policy_file        = policy.yaml {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] privsep_osbrick.group          = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] privsep_osbrick.helper_command = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] privsep_osbrick.user           = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] cinder_sys_admin.group         = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] cinder_sys_admin.helper_command = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] cinder_sys_admin.user          = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] service_user.auth_section      = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] service_user.auth_type         = password {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] service_user.cafile            = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] service_user.certfile          = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] service_user.collect_timing    = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] service_user.insecure          = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] service_user.keyfile           = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] service_user.send_service_user_token = True {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] service_user.split_loggers     = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] service_user.timeout           = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] glance.auth_section            = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] glance.auth_type               = password {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] glance.certfile                = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] glance.collect_timing          = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] glance.insecure                = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] glance.keyfile                 = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] glance.region_name             = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] glance.split_loggers           = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] glance.timeout                 = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.backend_availability_zone = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.chap_password = **** {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.chap_username =  {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.disk_geometry = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.driver_client_cert = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.driver_client_cert_key = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.driver_data_namespace = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.driver_use_ssl = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.extra_capabilities = {} {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.filter_function = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.goodness_function = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.iscsi_target_flags =  {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.iscsi_write_cache = on {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.iser_helper   = tgtadm {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.iser_ip_address = 192.168.122.250 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.iser_port     = 3260 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.nas_host      =  {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.nas_login     = admin {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.nas_mount_options = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.nas_password  = **** {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.nas_private_key =  {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.nas_share_path =  {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.num_shell_tries = 3 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.quobyte_volume_url = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.replication_device = **** {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.report_discard_supported = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.reserved_percentage = 0 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.target_helper = tgtadm {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.target_ip_address = 192.168.122.250 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.target_port   = 3260 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.target_protocol = iscsi {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.trace_flags   = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.unique_fqdn_network = True {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.use_chap_auth = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.volume_backend_name = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.volume_clear  = zero {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.volume_clear_ionice = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.volume_clear_size = 0 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_reports.file_event_handler = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_reports.log_dir           = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.backend_availability_zone = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.backend_host         = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.chap_password        = **** {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.chap_username        = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.chiscsi_conf         = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.disk_geometry        = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.driver_client_cert   = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.driver_data_namespace = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.driver_use_ssl       = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.extra_capabilities   = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.filter_function      = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.goodness_function    = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.iser_helper          = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.iser_ip_address      = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.iser_port            = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.iser_target_prefix   = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.nas_host             = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.nas_login            = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.nas_mount_options    = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.nas_password         = **** {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.nas_private_key      = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.nas_share_path       = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.nas_ssh_port         = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.num_shell_tries      = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.nvmet_port_id        = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.replication_device   = **** {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.report_discard_supported = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.reserved_percentage  = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.scst_target_driver   = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.storage_protocol     = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.target_helper        = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.target_ip_address    = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.target_port          = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.target_prefix        = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.target_protocol      = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.trace_flags          = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.use_chap_auth        = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.volume_clear         = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.volume_clear_size    = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] QuobyteHD.volumes_dir          = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_messaging_rabbit.ssl      = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack quobyte-client[82384]: Reading configuration file: /etc/quobyte/client.cfg
Apr 09 12:41:38 devstack quobyte-client[82384]: Invalid parameters found, error: missing mount point.
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack quobyte-client[82384]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack quobyte-client[82384]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_messaging_notifications.driver = [] {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_messaging_notifications.retry = -1 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] key_manager.fixed_key          = **** {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] barbican.barbican_api_version  = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] barbican.barbican_endpoint     = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] barbican.barbican_endpoint_type = public {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] barbican.barbican_region_name  = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] barbican.cafile                = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] barbican.certfile              = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] barbican.collect_timing        = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] barbican.insecure              = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] barbican.keyfile               = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] barbican.number_of_retries     = 60 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] barbican.retry_delay           = 1 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] barbican.send_service_user_token = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] barbican.split_loggers         = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] barbican.timeout               = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] barbican.verify_ssl            = True {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] barbican.verify_ssl_path       = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] barbican_service_user.auth_section = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] barbican_service_user.auth_type = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] barbican_service_user.cafile   = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] barbican_service_user.certfile = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] barbican_service_user.collect_timing = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] barbican_service_user.insecure = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] barbican_service_user.keyfile  = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] barbican_service_user.split_loggers = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] barbican_service_user.timeout  = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] vault.approle_role_id          = **** {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] vault.approle_secret_id        = **** {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] vault.kv_mountpoint            = secret {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] vault.kv_path                  = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] vault.kv_version               = 2 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] vault.namespace                = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] vault.root_token_id            = **** {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] vault.ssl_ca_crt_file          = None {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] vault.timeout                  = 60.0 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] vault.use_ssl                  = False {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:38 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] ******************************************************************************** {{(pid=82232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 09 12:41:38 devstack cinder-volume[82383]: DEBUG oslo_concurrency.processutils [None req-e1df4d0d-d489-48b7-b52b-ee5a9cefcf2f None None] CMD "mount.quobyte" returned: 1 in 0.086s {{(pid=82383) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:41:38 devstack cinder-volume[82383]: DEBUG oslo_concurrency.lockutils [None req-e1df4d0d-d489-48b7-b52b-ee5a9cefcf2f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82383) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:41:38 devstack cinder-volume[82383]: DEBUG oslo_concurrency.lockutils [None req-e1df4d0d-d489-48b7-b52b-ee5a9cefcf2f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82383) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:41:38 devstack cinder-volume[82383]: DEBUG cinder.volume.drivers.quobyte [None req-e1df4d0d-d489-48b7-b52b-ee5a9cefcf2f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82383) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:41:38 devstack cinder-volume[82383]: INFO cinder.volume.drivers.quobyte [None req-e1df4d0d-d489-48b7-b52b-ee5a9cefcf2f None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 ...
Apr 09 12:41:38 devstack cinder-volume[82383]: DEBUG oslo_concurrency.processutils [None req-e1df4d0d-d489-48b7-b52b-ee5a9cefcf2f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b -c /etc/quobyte/client-cinder.cfg {{(pid=82383) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:41:38 devstack sudo[82385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b -c /etc/quobyte/client-cinder.cfg
Apr 09 12:41:38 devstack sudo[82385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:41:39 devstack sudo[82385]: pam_unix(sudo:session): session closed for user root
Apr 09 12:41:39 devstack cinder-volume[82383]: DEBUG oslo_concurrency.processutils [None req-e1df4d0d-d489-48b7-b52b-ee5a9cefcf2f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.542s {{(pid=82383) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:41:39 devstack cinder-volume[82383]: INFO cinder.volume.drivers.quobyte [None req-e1df4d0d-d489-48b7-b52b-ee5a9cefcf2f None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 succeeded
Apr 09 12:41:39 devstack cinder-volume[82383]: DEBUG cinder.volume.drivers.quobyte [None req-e1df4d0d-d489-48b7-b52b-ee5a9cefcf2f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82383) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:41:39 devstack cinder-volume[82383]: DEBUG oslo_concurrency.lockutils [None req-e1df4d0d-d489-48b7-b52b-ee5a9cefcf2f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.568s {{(pid=82383) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:41:39 devstack cinder-volume[82383]: DEBUG oslo_concurrency.processutils [None req-e1df4d0d-d489-48b7-b52b-ee5a9cefcf2f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82383) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:41:39 devstack sudo[82454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:41:39 devstack sudo[82454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:41:39 devstack sudo[82454]: pam_unix(sudo:session): session closed for user root
Apr 09 12:41:39 devstack cinder-volume[82383]: DEBUG oslo_concurrency.processutils [None req-e1df4d0d-d489-48b7-b52b-ee5a9cefcf2f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.407s {{(pid=82383) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:41:39 devstack cinder-volume[82383]: INFO cinder.volume.driver [None req-e1df4d0d-d489-48b7-b52b-ee5a9cefcf2f None None] Driver hasn't implemented _init_vendor_properties()
Apr 09 12:41:39 devstack cinder-volume[82383]: DEBUG cinder.volume.driver [None req-e1df4d0d-d489-48b7-b52b-ee5a9cefcf2f None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579765319824, 'free_capacity_gb': 1775.7579765319824, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82383) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 09 12:41:39 devstack cinder-volume[82383]: DEBUG oslo_db.sqlalchemy.engines [None req-e1df4d0d-d489-48b7-b52b-ee5a9cefcf2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82383) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 09 12:41:39 devstack cinder-volume[82383]: DEBUG dbcounter [-] [82383] Writer thread running {{(pid=82383) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 09 12:41:39 devstack cinder-volume[82383]: DEBUG cinder.db.sqlalchemy.api [None req-e1df4d0d-d489-48b7-b52b-ee5a9cefcf2f None None] Building query based on filter {{(pid=82383) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 09 12:41:39 devstack cinder-volume[82383]: DEBUG cinder.image.image_utils [None req-e1df4d0d-d489-48b7-b52b-ee5a9cefcf2f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82383) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 09 12:41:39 devstack cinder-volume[82383]: INFO cinder.keymgr.migration [None req-c2ab4af7-c2fd-4a6f-b558-319e9e190491 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 09 12:41:39 devstack cinder-volume[82383]: DEBUG oslo_concurrency.lockutils [None req-e1df4d0d-d489-48b7-b52b-ee5a9cefcf2f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82383) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:41:39 devstack cinder-volume[82383]: DEBUG oslo_concurrency.lockutils [None req-e1df4d0d-d489-48b7-b52b-ee5a9cefcf2f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82383) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:41:39 devstack cinder-volume[82383]: DEBUG cinder.volume.drivers.quobyte [None req-e1df4d0d-d489-48b7-b52b-ee5a9cefcf2f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82383) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:41:39 devstack cinder-volume[82383]: DEBUG cinder.volume.drivers.quobyte [None req-e1df4d0d-d489-48b7-b52b-ee5a9cefcf2f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82383) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:41:39 devstack cinder-volume[82383]: DEBUG oslo_concurrency.lockutils [None req-e1df4d0d-d489-48b7-b52b-ee5a9cefcf2f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82383) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:41:39 devstack cinder-volume[82383]: DEBUG oslo_concurrency.processutils [None req-e1df4d0d-d489-48b7-b52b-ee5a9cefcf2f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82383) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:41:40 devstack sudo[82457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:41:40 devstack sudo[82457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:41:40 devstack sudo[82457]: pam_unix(sudo:session): session closed for user root
Apr 09 12:41:40 devstack cinder-volume[82383]: DEBUG oslo_concurrency.processutils [None req-e1df4d0d-d489-48b7-b52b-ee5a9cefcf2f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.411s {{(pid=82383) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:41:40 devstack cinder-volume[82383]: DEBUG cinder.manager [None req-e1df4d0d-d489-48b7-b52b-ee5a9cefcf2f None None] Notifying Schedulers of capabilities ... {{(pid=82383) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:41:40 devstack cinder-volume[82383]: INFO cinder.volume.manager [None req-e1df4d0d-d489-48b7-b52b-ee5a9cefcf2f None None] Driver initialization completed successfully.
Apr 09 12:41:40 devstack cinder-volume[82383]: INFO cinder.manager [None req-e1df4d0d-d489-48b7-b52b-ee5a9cefcf2f None None] Initiating service 3 cleanup
Apr 09 12:41:40 devstack cinder-volume[82383]: INFO cinder.manager [None req-e1df4d0d-d489-48b7-b52b-ee5a9cefcf2f None None] Service 3 cleanup completed.
Apr 09 12:41:40 devstack cinder-volume[82383]: DEBUG cinder.service [None req-e1df4d0d-d489-48b7-b52b-ee5a9cefcf2f None None] Creating RPC server for service cinder-volume {{(pid=82383) start /opt/stack/cinder/cinder/service.py:231}}
Apr 09 12:41:40 devstack cinder-volume[82383]: DEBUG cinder.service [None req-e1df4d0d-d489-48b7-b52b-ee5a9cefcf2f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82383) start /opt/stack/cinder/cinder/service.py:237}}
Apr 09 12:41:40 devstack cinder-volume[82383]: INFO cinder.volume.manager [None req-e1df4d0d-d489-48b7-b52b-ee5a9cefcf2f None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 09 12:41:40 devstack cinder-volume[82383]: DEBUG oslo_concurrency.lockutils [None req-e1df4d0d-d489-48b7-b52b-ee5a9cefcf2f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82383) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:41:40 devstack cinder-volume[82383]: DEBUG oslo_concurrency.lockutils [None req-e1df4d0d-d489-48b7-b52b-ee5a9cefcf2f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82383) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:41:40 devstack cinder-volume[82383]: DEBUG cinder.volume.drivers.quobyte [None req-e1df4d0d-d489-48b7-b52b-ee5a9cefcf2f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82383) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:41:40 devstack cinder-volume[82383]: DEBUG cinder.volume.drivers.quobyte [None req-e1df4d0d-d489-48b7-b52b-ee5a9cefcf2f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82383) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:41:40 devstack cinder-volume[82383]: DEBUG oslo_concurrency.lockutils [None req-e1df4d0d-d489-48b7-b52b-ee5a9cefcf2f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82383) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:41:40 devstack cinder-volume[82383]: DEBUG oslo_concurrency.processutils [None req-e1df4d0d-d489-48b7-b52b-ee5a9cefcf2f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82383) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:41:40 devstack sudo[82462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:41:40 devstack sudo[82462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:41:40 devstack sudo[82462]: pam_unix(sudo:session): session closed for user root
Apr 09 12:41:40 devstack cinder-volume[82383]: DEBUG oslo_concurrency.processutils [None req-e1df4d0d-d489-48b7-b52b-ee5a9cefcf2f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.439s {{(pid=82383) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:41:40 devstack cinder-volume[82383]: INFO cinder.volume.manager [None req-e1df4d0d-d489-48b7-b52b-ee5a9cefcf2f None None] Driver post RPC initialization completed successfully.
Apr 09 12:41:43 devstack cinder-volume[82383]: DEBUG oslo_concurrency.lockutils [None req-650865a3-fdfb-4778-b58e-c1727e1c0c66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82383) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:41:43 devstack cinder-volume[82383]: DEBUG oslo_concurrency.lockutils [None req-650865a3-fdfb-4778-b58e-c1727e1c0c66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82383) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:41:43 devstack cinder-volume[82383]: DEBUG cinder.volume.drivers.quobyte [None req-650865a3-fdfb-4778-b58e-c1727e1c0c66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82383) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:41:43 devstack cinder-volume[82383]: DEBUG cinder.volume.drivers.quobyte [None req-650865a3-fdfb-4778-b58e-c1727e1c0c66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82383) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:41:43 devstack cinder-volume[82383]: DEBUG oslo_concurrency.lockutils [None req-650865a3-fdfb-4778-b58e-c1727e1c0c66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82383) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:41:43 devstack cinder-volume[82383]: DEBUG oslo_concurrency.processutils [None req-650865a3-fdfb-4778-b58e-c1727e1c0c66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82383) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:41:43 devstack sudo[82535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:41:43 devstack sudo[82535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:41:44 devstack sudo[82535]: pam_unix(sudo:session): session closed for user root
Apr 09 12:41:44 devstack cinder-volume[82383]: DEBUG oslo_concurrency.processutils [None req-650865a3-fdfb-4778-b58e-c1727e1c0c66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.444s {{(pid=82383) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:41:44 devstack cinder-volume[82383]: DEBUG cinder.manager [None req-650865a3-fdfb-4778-b58e-c1727e1c0c66 None None] Notifying Schedulers of capabilities ... {{(pid=82383) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:41:45 devstack cinder-volume[82232]: INFO oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] Caught SIGTERM, stopping children
Apr 09 12:41:45 devstack cinder-volume[82232]: DEBUG oslo_concurrency.lockutils [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] Acquiring lock "singleton_lock" {{(pid=82232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 09 12:41:45 devstack cinder-volume[82232]: DEBUG oslo_concurrency.lockutils [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] Acquired lock "singleton_lock" {{(pid=82232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 09 12:41:45 devstack cinder-volume[82232]: DEBUG oslo_concurrency.lockutils [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] Releasing lock "singleton_lock" {{(pid=82232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 09 12:41:45 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] Stop services. {{(pid=82232) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 09 12:41:45 devstack cinder-volume[82232]: DEBUG oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] Killing children. {{(pid=82232) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 09 12:41:45 devstack cinder-volume[82232]: INFO oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] Waiting on 1 children to exit
Apr 09 12:41:48 devstack cinder-volume[82383]: DEBUG oslo_concurrency.lockutils [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] Acquiring lock "singleton_lock" {{(pid=82383) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 09 12:41:48 devstack cinder-volume[82383]: DEBUG oslo_concurrency.lockutils [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] Acquired lock "singleton_lock" {{(pid=82383) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 09 12:41:48 devstack cinder-volume[82383]: DEBUG oslo_concurrency.lockutils [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] Releasing lock "singleton_lock" {{(pid=82383) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 09 12:41:48 devstack cinder-volume[82383]: WARNING amqp [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 09 12:41:48 devstack cinder-volume[82383]: WARNING amqp [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 09 12:41:48 devstack cinder-volume[82232]: INFO oslo_service.backend._eventlet.service [None req-2ae7c8bd-ab27-4d15-ba2e-4c3fbdb94739 None None] Child 82383 exited with status 0
Apr 09 12:41:49 devstack cinder-volume[82625]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 09 12:41:49 devstack cinder-volume[82625]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 09 12:41:49 devstack cinder-volume[82625]: we strongly recommend against using it for new projects.
Apr 09 12:41:49 devstack cinder-volume[82625]: If you are already using Eventlet, we recommend migrating to a different
Apr 09 12:41:49 devstack cinder-volume[82625]: framework.  For more detail see
Apr 09 12:41:49 devstack cinder-volume[82625]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 09 12:41:49 devstack cinder-volume[82625]:   import eventlet  # noqa
Apr 09 12:41:50 devstack cinder-volume[82625]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82625) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 09 12:41:50 devstack cinder-volume[82625]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82625) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 09 12:41:50 devstack cinder-volume[82625]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82625) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 09 12:41:51 devstack cinder-volume[82625]: INFO dbcounter [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] Registered counter for database cinder
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_db.sqlalchemy.engines [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82625) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG dbcounter [-] [82625] Writer thread running {{(pid=82625) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 09 12:41:51 devstack cinder-volume[82625]: INFO cinder.rpc [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 09 12:41:51 devstack cinder-volume[82625]: INFO cinder.rpc [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_db.sqlalchemy.engines [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82625) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 09 12:41:51 devstack cinder-volume[82625]: INFO cinder.volume.manager [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] Determined volume DB was empty at startup.
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG cinder.volume.manager [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82625) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 09 12:41:51 devstack cinder-volume[82625]: WARNING stevedore.named [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 09 12:41:51 devstack cinder-volume[82625]: WARNING castellan.key_manager [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 09 12:41:51 devstack cinder-volume[82625]: WARNING cinder.keymgr.conf_key_mgr [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 09 12:41:51 devstack cinder-volume[82625]: INFO cinder.volume.manager [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_db.sqlalchemy.engines [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82625) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 09 12:41:51 devstack cinder-volume[82625]: INFO oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] Starting 1 workers
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] Started child 82760 {{(pid=82625) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] Full set of CONF: {{(pid=82625) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] ******************************************************************************** {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] Configuration options gathered from: {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] ================================================================================ {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] allow_availability_zone_fallback = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] allow_compression_on_image_upload = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] allowed_direct_url_schemes     = [] {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] api_rate_limit                 = True {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] auth_strategy                  = keystone {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_availability_zone      = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_host                   = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_name                   = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_stats_polling_interval = 60 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backup_api_class               = cinder.backup.api.API {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backup_name_template           = backup-%s {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backup_use_same_host           = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backup_use_temp_snapshot       = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] chap_password                  = **** {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] chap_username                  =  {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82760]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] cinder_internal_tenant_project_id = b3c6bd62af0945c28f5ce26cb83bb6b6 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] cinder_internal_tenant_user_id = b0f7dc36f9014681b367363a66a9f288 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] cluster                        = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] compression_format             = gzip {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] compute_api_class              = cinder.compute.nova.API {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] config_dir                     = [] {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] config_source                  = [] {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] control_exchange               = openstack {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] debug                          = True {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] default_availability_zone      = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] default_group_type             = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] default_volume_type            = QuobyteHD {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] disk_geometry                  = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] driver_client_cert             = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] driver_client_cert_key         = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] driver_data_namespace          = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] driver_ssl_cert_path           = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] driver_ssl_cert_verify         = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] driver_use_ssl                 = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] enable_new_services            = True {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] enable_unsupported_driver      = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] enabled_backends               = ['QuobyteHD'] {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] enforce_multipath_for_image_xfer = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] filter_function                = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] glance_api_insecure            = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] glance_api_servers             = ['http://192.168.122.250/image'] {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] glance_api_ssl_compression     = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] glance_ca_certificates_file    = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] glance_catalog_info            = image:glance:publicURL {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] glance_certfile                = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] glance_keyfile                 = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] glance_num_retries             = 3 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] glance_request_timeout         = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] goodness_function              = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] graceful_shutdown_timeout      = 5 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] group_api_class                = cinder.group.api.API {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] host                           = devstack {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] image_compress_on_upload       = True {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] image_conversion_address_space_limit = 1 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] image_conversion_cpu_limit     = 60 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] image_conversion_disable       = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] image_upload_use_cinder_backend = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] image_upload_use_internal_tenant = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] image_volume_cache_enabled     = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] image_volume_cache_max_count   = 0 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] image_volume_cache_max_size_gb = 0 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] init_host_max_objects_retrieval = 0 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] instance_format                = [instance: %(uuid)s]  {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] iscsi_target_flags             =  {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] iscsi_write_cache              = on {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] iser_helper                    = tgtadm {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] iser_ip_address                = 192.168.122.250 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] iser_port                      = 3260 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] log_color                      = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] log_config_append              = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] log_dir                        = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] log_file                       = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] log_options                    = True {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] log_rotate_interval            = 1 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] log_rotate_interval_type       = days {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] log_rotation_type              = none {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] max_age                        = 0 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] max_logfile_count              = 30 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] max_logfile_size_mb            = 200 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] max_over_subscription_ratio    = 20.0 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] message_reap_interval          = 86400 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] message_ttl                    = 2592000 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] migration_create_volume_timeout_secs = 300 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] monkey_patch                   = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] monkey_patch_modules           = [] {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] my_ip                          = 192.168.122.250 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] no_snapshot_gb_quota           = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] num_iser_scan_tries            = 3 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] num_shell_tries                = 3 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] num_volume_device_scan_tries   = 3 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] nvmeof_conn_info_version       = 1 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] nvmet_ns_id                    = 10 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] nvmet_port_id                  = 1 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] osapi_max_limit                = 1000 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] osapi_volume_ext_list          = [] {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] osapi_volume_listen            = 0.0.0.0 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] osapi_volume_listen_port       = 8776 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] osapi_volume_use_ssl           = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] osapi_volume_workers           = 2 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] per_volume_size_limit          = -1 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] periodic_fuzzy_delay           = 60 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] periodic_interval              = 60 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] project_id_regex               = [0-9a-f\-]+ {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] public_endpoint                = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] publish_errors                 = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] quota_backup_gigabytes         = 1000 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] quota_backups                  = 10 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] quota_gigabytes                = 1000 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] quota_groups                   = 10 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] quota_snapshots                = 10 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] quota_volumes                  = 10 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] rate_limit_burst               = 0 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] rate_limit_except_level        = CRITICAL {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] rate_limit_interval            = 0 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] reinit_driver_count            = 3 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] replication_device             = **** {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] report_discard_supported       = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] report_interval                = 120 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] reservation_clean_interval     = 86400 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] reservation_expire             = 86400 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] reserved_image_namespaces      = [] {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] reserved_percentage            = 0 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] rpc_response_timeout           = 120 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] run_external_periodic_tasks    = True {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] scst_target_driver             = iscsi {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] scst_target_iqn_name           = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] service_down_time              = 720 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] shell_completion               = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] snapshot_name_template         = snapshot-%s {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] split_loggers                  = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] state_path                     = /opt/stack/data/cinder {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] storage_availability_zone      = nova {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] storage_protocol               = iSCSI {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] syslog_log_facility            = LOG_USER {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] target_helper                  = lioadm {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] target_ip_address              = 192.168.122.250 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] target_port                    = 3260 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] target_protocol                = iscsi {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] target_secondary_ip_addresses  = [] {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] trace_flags                    = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] transfer_api_class             = cinder.transfer.api.API {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] transport_url                  = **** {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] until_refresh                  = 0 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] use_chap_auth                  = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] use_default_quota_class        = True {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] use_journal                    = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] use_json                       = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] use_multipath_for_image_xfer   = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] use_stderr                     = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] use_syslog                     = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] verify_glance_signatures       = enabled {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] volume_api_class               = cinder.volume.api.API {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] volume_backend_name            = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] volume_clear                   = zero {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] volume_clear_ionice            = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] volume_clear_size              = 0 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] volume_copy_bps_limit          = 0 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] volume_dd_blocksize            = 1M {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] volume_name_template           = volume-%s {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] volume_service_inithost_offload = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] volume_usage_audit_period      = month {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] zoning_mode                    = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_concurrency.disable_process_locking = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] keystone_authtoken.admin_password = **** {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] keystone_authtoken.admin_token = **** {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] keystone_authtoken.admin_user  = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] keystone_authtoken.auth_admin_prefix =  {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] keystone_authtoken.auth_port   = 35357 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] keystone_authtoken.auth_protocol = https {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] keystone_authtoken.auth_section = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] keystone_authtoken.auth_type   = password {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] keystone_authtoken.auth_uri    = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] keystone_authtoken.auth_version = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] keystone_authtoken.cache       = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] keystone_authtoken.certfile    = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] keystone_authtoken.delay_auth_decision = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] keystone_authtoken.http_connect_timeout = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] keystone_authtoken.identity_uri = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] keystone_authtoken.include_service_catalog = True {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] keystone_authtoken.insecure    = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] keystone_authtoken.interface   = public {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] keystone_authtoken.keyfile     = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] keystone_authtoken.memcache_password =  {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] keystone_authtoken.memcache_username =  {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] keystone_authtoken.region_name = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] keystone_authtoken.service_token_roles_required = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] keystone_authtoken.service_type = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] keystone_authtoken.token_cache_time = 300 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.250/identity {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] cache.backend                  = dogpile.cache.null {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] cache.backend_argument         = **** {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] cache.backend_expiration_time  = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] cache.config_prefix            = cache.oslo {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] cache.debug_cache_backend      = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] cache.enable_retry_client      = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] cache.enable_socket_keepalive  = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] cache.enabled                  = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] cache.enforce_fips_mode        = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] cache.expiration_time          = 600 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] cache.hashclient_retry_attempts = 2 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] cache.memcache_dead_retry      = 300 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] cache.memcache_pool_maxsize    = 10 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] cache.memcache_sasl_enabled    = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] cache.password                 = **** {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] cache.proxies                  = [] {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] cache.redis_db                 = 0 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] cache.redis_sentinel_service_name = mymaster {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] cache.redis_server             = localhost:6379 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] cache.retry_attempts           = 2 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] cache.retry_delay              = 0.0 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-fb970afa-c128-4f0b-91c9-76cac0ae696a None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] cache.socket_keepalive_count   = 1 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] cache.socket_keepalive_idle    = 1 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] cache.socket_keepalive_interval = 1 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] cache.socket_timeout           = 1.0 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] cache.tls_allowed_ciphers      = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] cache.tls_cafile               = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] cache.tls_certfile             = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] cache.tls_enabled              = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] cache.tls_keyfile              = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] cache.username                 = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] coordination.backend_url       = **** {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] database.asyncio_connection    = **** {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] database.asyncio_slave_connection = **** {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] database.backend               = sqlalchemy {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] database.connection            = **** {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] database.connection_debug      = 0 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] database.connection_parameters =  {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] database.connection_recycle_time = 3600 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] database.connection_trace      = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] database.db_inc_retry_interval = True {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] database.db_max_retries        = 20 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] database.db_max_retry_interval = 10 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] database.db_retry_interval     = 1 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] database.max_overflow          = 50 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] database.max_pool_size         = 5 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] database.max_retries           = 10 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] database.mysql_wsrep_sync_wait = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] database.pool_timeout          = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] database.retry_interval        = 10 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] database.slave_connection      = **** {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] database.sqlite_synchronous    = True {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] database.synchronous_reader    = True {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] database.use_db_reconnect      = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] profiler.connection_string     = messaging:// {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] profiler.enabled               = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] profiler.es_doc_type           = notification {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] profiler.es_scroll_size        = 10000 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-fb970afa-c128-4f0b-91c9-76cac0ae696a None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82760) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] profiler.es_scroll_time        = 2m {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] profiler.filter_error_trace    = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] profiler.hmac_keys             = **** {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] profiler.sentinel_service_name = mymaster {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] profiler.socket_timeout        = 0.1 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] profiler.trace_requests        = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] profiler.trace_sqlalchemy      = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] profiler_jaeger.process_tags   = {} {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] profiler_jaeger.service_name_prefix = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] profiler_otlp.service_name_prefix = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_policy.enforce_new_defaults = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: WARNING oslo_config.cfg [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_policy.enforce_scope      = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_policy.policy_default_rule = default {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_policy.policy_file        = policy.yaml {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_policy.remote_timeout     = 60.0 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] privsep_osbrick.group          = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] privsep_osbrick.helper_command = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] privsep_osbrick.user           = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] cinder_sys_admin.group         = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] cinder_sys_admin.helper_command = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] cinder_sys_admin.user          = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] service_user.auth_section      = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] service_user.auth_type         = password {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] service_user.cafile            = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] service_user.certfile          = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] service_user.collect_timing    = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] service_user.insecure          = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] service_user.keyfile           = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] service_user.send_service_user_token = True {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] service_user.split_loggers     = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] service_user.timeout           = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] glance.auth_section            = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] glance.auth_type               = password {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] glance.certfile                = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] glance.collect_timing          = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] glance.insecure                = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] glance.keyfile                 = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] glance.region_name             = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] glance.split_loggers           = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] glance.timeout                 = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.backend_availability_zone = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.chap_password = **** {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.chap_username =  {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.disk_geometry = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.driver_client_cert = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.driver_client_cert_key = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.driver_data_namespace = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.driver_use_ssl = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.enable_unsupported_driver = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.extra_capabilities = {} {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.filter_function = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.goodness_function = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.iscsi_target_flags =  {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.iscsi_write_cache = on {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.iser_helper   = tgtadm {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.iser_ip_address = 192.168.122.250 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.iser_port     = 3260 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.nas_host      =  {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.nas_login     = admin {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.nas_mount_options = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.nas_password  = **** {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.nas_private_key =  {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.nas_share_path =  {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.nas_ssh_port  = 22 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.num_shell_tries = 3 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.nvmet_port_id = 1 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.quobyte_client_cfg = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.quobyte_volume_url = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.replication_device = **** {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.report_discard_supported = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.reserved_percentage = 0 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.scst_target_driver = iscsi {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.scst_target_iqn_name = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.storage_protocol = iSCSI {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.target_helper = tgtadm {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.target_ip_address = 192.168.122.250 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.target_port   = 3260 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.target_protocol = iscsi {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.trace_flags   = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.unique_fqdn_network = True {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.use_chap_auth = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.volume_backend_name = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.volume_clear  = zero {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.volume_clear_ionice = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.volume_clear_size = 0 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_reports.file_event_handler = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_reports.log_dir           = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.backend_availability_zone = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.backend_host         = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.chap_password        = **** {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.chap_username        = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.chiscsi_conf         = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.disk_geometry        = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.driver_client_cert   = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.driver_client_cert_key = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.driver_data_namespace = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.driver_use_ssl       = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.extra_capabilities   = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.filter_function      = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.goodness_function    = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.iscsi_target_flags   = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.iscsi_write_cache    = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.iser_helper          = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.iser_ip_address      = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.iser_port            = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.iser_target_prefix   = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.nas_host             = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.nas_login            = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.nas_mount_options    = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.nas_password         = **** {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.nas_private_key      = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.nas_share_path       = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.nas_ssh_port         = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.num_shell_tries      = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.nvmet_ns_id          = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.nvmet_port_id        = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.replication_device   = **** {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.report_discard_supported = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.reserved_percentage  = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.scst_target_driver   = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.storage_protocol     = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.target_helper        = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.target_ip_address    = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.target_port          = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.target_prefix        = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.target_protocol      = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.trace_flags          = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.unique_fqdn_network  = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.use_chap_auth        = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.volume_clear         = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.volume_clear_ionice  = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.volume_clear_size    = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] QuobyteHD.volumes_dir          = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_messaging_rabbit.ssl      = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_messaging_notifications.driver = [] {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_messaging_notifications.retry = -1 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] oslo_messaging_notifications.transport_url = **** {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] key_manager.fixed_key          = **** {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] barbican.barbican_api_version  = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] barbican.barbican_endpoint     = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] barbican.barbican_endpoint_type = public {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] barbican.barbican_region_name  = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] barbican.cafile                = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] barbican.certfile              = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] barbican.collect_timing        = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] barbican.insecure              = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] barbican.keyfile               = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] barbican.number_of_retries     = 60 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] barbican.retry_delay           = 1 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] barbican.send_service_user_token = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] barbican.split_loggers         = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] barbican.timeout               = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] barbican.verify_ssl            = True {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] barbican.verify_ssl_path       = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] barbican_service_user.auth_section = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] barbican_service_user.auth_type = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] barbican_service_user.cafile   = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] barbican_service_user.certfile = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] barbican_service_user.collect_timing = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] barbican_service_user.insecure = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] barbican_service_user.keyfile  = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] barbican_service_user.split_loggers = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] barbican_service_user.timeout  = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] vault.approle_role_id          = **** {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] vault.approle_secret_id        = **** {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] vault.kv_mountpoint            = secret {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] vault.kv_path                  = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] vault.kv_version               = 2 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] vault.namespace                = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] vault.root_token_id            = **** {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] vault.ssl_ca_crt_file          = None {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] vault.timeout                  = 60.0 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] vault.use_ssl                  = False {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 09 12:41:51 devstack cinder-volume[82625]: DEBUG oslo_service.backend._eventlet.service [None req-e07b371f-9d7e-4557-9403-e5c3697cb5bf None None] ******************************************************************************** {{(pid=82625) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 09 12:41:51 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-fb970afa-c128-4f0b-91c9-76cac0ae696a None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82760) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 09 12:41:51 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.quobyte [None req-fb970afa-c128-4f0b-91c9-76cac0ae696a None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 09 12:41:51 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.quobyte [None req-fb970afa-c128-4f0b-91c9-76cac0ae696a None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 09 12:41:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-fb970afa-c128-4f0b-91c9-76cac0ae696a None None] Running cmd (subprocess): mount.quobyte {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:41:51 devstack quobyte-client[82770]: Reading configuration file: /etc/quobyte/client.cfg
Apr 09 12:41:51 devstack quobyte-client[82770]: Invalid parameters found, error: missing mount point.
Apr 09 12:41:51 devstack quobyte-client[82770]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 09 12:41:51 devstack quobyte-client[82770]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 09 12:41:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-fb970afa-c128-4f0b-91c9-76cac0ae696a None None] CMD "mount.quobyte" returned: 1 in 0.072s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:41:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-fb970afa-c128-4f0b-91c9-76cac0ae696a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:41:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-fb970afa-c128-4f0b-91c9-76cac0ae696a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:41:51 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-fb970afa-c128-4f0b-91c9-76cac0ae696a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:41:51 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-fb970afa-c128-4f0b-91c9-76cac0ae696a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:41:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-fb970afa-c128-4f0b-91c9-76cac0ae696a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:41:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-fb970afa-c128-4f0b-91c9-76cac0ae696a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:41:51 devstack sudo[82789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:41:51 devstack sudo[82789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:41:52 devstack sudo[82789]: pam_unix(sudo:session): session closed for user root
Apr 09 12:41:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-fb970afa-c128-4f0b-91c9-76cac0ae696a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.455s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:41:52 devstack cinder-volume[82760]: INFO cinder.volume.driver [None req-fb970afa-c128-4f0b-91c9-76cac0ae696a None None] Driver hasn't implemented _init_vendor_properties()
Apr 09 12:41:52 devstack cinder-volume[82760]: DEBUG cinder.volume.driver [None req-fb970afa-c128-4f0b-91c9-76cac0ae696a None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579765319824, 'free_capacity_gb': 1775.7579765319824, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82760) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 09 12:41:52 devstack cinder-volume[82760]: DEBUG oslo_db.sqlalchemy.engines [None req-fb970afa-c128-4f0b-91c9-76cac0ae696a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82760) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 09 12:41:52 devstack cinder-volume[82760]: DEBUG dbcounter [-] [82760] Writer thread running {{(pid=82760) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 09 12:41:52 devstack cinder-volume[82760]: DEBUG cinder.db.sqlalchemy.api [None req-fb970afa-c128-4f0b-91c9-76cac0ae696a None None] Building query based on filter {{(pid=82760) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 09 12:41:52 devstack cinder-volume[82760]: DEBUG cinder.image.image_utils [None req-fb970afa-c128-4f0b-91c9-76cac0ae696a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82760) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 09 12:41:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-fb970afa-c128-4f0b-91c9-76cac0ae696a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:41:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-fb970afa-c128-4f0b-91c9-76cac0ae696a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:41:52 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-fb970afa-c128-4f0b-91c9-76cac0ae696a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:41:52 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-fb970afa-c128-4f0b-91c9-76cac0ae696a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:41:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-fb970afa-c128-4f0b-91c9-76cac0ae696a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:41:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-fb970afa-c128-4f0b-91c9-76cac0ae696a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:41:52 devstack cinder-volume[82760]: INFO cinder.keymgr.migration [None req-cb6fac43-f3fb-48f3-b163-7e261bff859f None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 09 12:41:52 devstack sudo[82835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:41:52 devstack sudo[82835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:41:52 devstack sudo[82835]: pam_unix(sudo:session): session closed for user root
Apr 09 12:41:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-fb970afa-c128-4f0b-91c9-76cac0ae696a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.468s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:41:52 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-fb970afa-c128-4f0b-91c9-76cac0ae696a None None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:41:52 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-fb970afa-c128-4f0b-91c9-76cac0ae696a None None] Driver initialization completed successfully.
Apr 09 12:41:52 devstack cinder-volume[82760]: INFO cinder.manager [None req-fb970afa-c128-4f0b-91c9-76cac0ae696a None None] Initiating service 3 cleanup
Apr 09 12:41:52 devstack cinder-volume[82760]: INFO cinder.manager [None req-fb970afa-c128-4f0b-91c9-76cac0ae696a None None] Service 3 cleanup completed.
Apr 09 12:41:52 devstack cinder-volume[82760]: DEBUG cinder.service [None req-fb970afa-c128-4f0b-91c9-76cac0ae696a None None] Creating RPC server for service cinder-volume {{(pid=82760) start /opt/stack/cinder/cinder/service.py:231}}
Apr 09 12:41:52 devstack cinder-volume[82760]: DEBUG cinder.service [None req-fb970afa-c128-4f0b-91c9-76cac0ae696a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82760) start /opt/stack/cinder/cinder/service.py:237}}
Apr 09 12:41:52 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-fb970afa-c128-4f0b-91c9-76cac0ae696a None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 09 12:41:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-fb970afa-c128-4f0b-91c9-76cac0ae696a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:41:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-fb970afa-c128-4f0b-91c9-76cac0ae696a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:41:52 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-fb970afa-c128-4f0b-91c9-76cac0ae696a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:41:52 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-fb970afa-c128-4f0b-91c9-76cac0ae696a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:41:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-fb970afa-c128-4f0b-91c9-76cac0ae696a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:41:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-fb970afa-c128-4f0b-91c9-76cac0ae696a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:41:52 devstack sudo[82859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:41:52 devstack sudo[82859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:41:53 devstack sudo[82859]: pam_unix(sudo:session): session closed for user root
Apr 09 12:41:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-fb970afa-c128-4f0b-91c9-76cac0ae696a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.429s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:41:53 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-fb970afa-c128-4f0b-91c9-76cac0ae696a None None] Driver post RPC initialization completed successfully.
Apr 09 12:42:01 devstack cinder-volume[82625]: DEBUG dbcounter [-] [82625] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82625) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 12:42:02 devstack cinder-volume[82760]: DEBUG dbcounter [-] [82760] Writing DB stats cinder:SELECT=2 {{(pid=82760) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 12:42:03 devstack cinder-volume[82760]: DEBUG dbcounter [-] [82760] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=82760) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 12:42:49 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-80283ce4-a3cc-4944-b572-1609338af9d0 tempest-VolumesTestJSON-809111195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:42:49 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-80283ce4-a3cc-4944-b572-1609338af9d0 tempest-VolumesTestJSON-809111195 None] Flow 'volume_create_manager' (d8af45d5-5ade-4df6-bc56-ad7b1b9002da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:42:49 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-80283ce4-a3cc-4944-b572-1609338af9d0 tempest-VolumesTestJSON-809111195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39744462-9938-48fa-ac0f-789b214928e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:42:50 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-80283ce4-a3cc-4944-b572-1609338af9d0 tempest-VolumesTestJSON-809111195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39744462-9938-48fa-ac0f-789b214928e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:42:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2126394211',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3feab65-363e-46ef-a8b7-3c1704838bc9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='437506a9ba074b47a772436c95e4ba11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:42:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:42:50Z,use_quota=True,user_id='849c64c4256a4c46a401805703785fa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:42:50 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-80283ce4-a3cc-4944-b572-1609338af9d0 tempest-VolumesTestJSON-809111195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8dcea1d-b222-48cf-aed4-b5bc60f64463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:42:50 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-80283ce4-a3cc-4944-b572-1609338af9d0 tempest-VolumesTestJSON-809111195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8dcea1d-b222-48cf-aed4-b5bc60f64463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:42:50 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-80283ce4-a3cc-4944-b572-1609338af9d0 tempest-VolumesTestJSON-809111195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35c9fad2-5ccb-436c-a7dc-ab91d9166bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:42:50 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-80283ce4-a3cc-4944-b572-1609338af9d0 tempest-VolumesTestJSON-809111195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35c9fad2-5ccb-436c-a7dc-ab91d9166bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3feab65-363e-46ef-a8b7-3c1704838bc9', 'volume_name': 'volume-d3feab65-363e-46ef-a8b7-3c1704838bc9', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:42:50 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-80283ce4-a3cc-4944-b572-1609338af9d0 tempest-VolumesTestJSON-809111195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (751bf32e-2cbd-4033-bebd-f8c5dda5369e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:42:50 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-80283ce4-a3cc-4944-b572-1609338af9d0 tempest-VolumesTestJSON-809111195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (751bf32e-2cbd-4033-bebd-f8c5dda5369e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:42:50 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-80283ce4-a3cc-4944-b572-1609338af9d0 tempest-VolumesTestJSON-809111195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71876484-9522-4391-aa47-0b07392684fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:42:50 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-80283ce4-a3cc-4944-b572-1609338af9d0 tempest-VolumesTestJSON-809111195 None] Volume d3feab65-363e-46ef-a8b7-3c1704838bc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3feab65-363e-46ef-a8b7-3c1704838bc9', 'volume_size': 1}
Apr 09 12:42:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-80283ce4-a3cc-4944-b572-1609338af9d0 tempest-VolumesTestJSON-809111195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:42:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-80283ce4-a3cc-4944-b572-1609338af9d0 tempest-VolumesTestJSON-809111195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:42:50 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-80283ce4-a3cc-4944-b572-1609338af9d0 tempest-VolumesTestJSON-809111195 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:42:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2126394211',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3feab65-363e-46ef-a8b7-3c1704838bc9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='437506a9ba074b47a772436c95e4ba11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:42:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:42:50Z,use_quota=True,user_id='849c64c4256a4c46a401805703785fa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:42:50 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-80283ce4-a3cc-4944-b572-1609338af9d0 tempest-VolumesTestJSON-809111195 None] Creating volume d3feab65-363e-46ef-a8b7-3c1704838bc9 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:42:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-80283ce4-a3cc-4944-b572-1609338af9d0 tempest-VolumesTestJSON-809111195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:42:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-80283ce4-a3cc-4944-b572-1609338af9d0 tempest-VolumesTestJSON-809111195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:42:50 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-80283ce4-a3cc-4944-b572-1609338af9d0 tempest-VolumesTestJSON-809111195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:42:50 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-80283ce4-a3cc-4944-b572-1609338af9d0 tempest-VolumesTestJSON-809111195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:42:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-80283ce4-a3cc-4944-b572-1609338af9d0 tempest-VolumesTestJSON-809111195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:42:50 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-80283ce4-a3cc-4944-b572-1609338af9d0 tempest-VolumesTestJSON-809111195 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:42:50 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-80283ce4-a3cc-4944-b572-1609338af9d0 tempest-VolumesTestJSON-809111195 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:42:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-80283ce4-a3cc-4944-b572-1609338af9d0 tempest-VolumesTestJSON-809111195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d3feab65-363e-46ef-a8b7-3c1704838bc9 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:42:50 devstack sudo[83285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d3feab65-363e-46ef-a8b7-3c1704838bc9 1073741824
Apr 09 12:42:50 devstack sudo[83285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:42:51 devstack sudo[83285]: pam_unix(sudo:session): session closed for user root
Apr 09 12:42:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-80283ce4-a3cc-4944-b572-1609338af9d0 tempest-VolumesTestJSON-809111195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d3feab65-363e-46ef-a8b7-3c1704838bc9 1073741824" returned: 0 in 1.423s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:42:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-80283ce4-a3cc-4944-b572-1609338af9d0 tempest-VolumesTestJSON-809111195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d3feab65-363e-46ef-a8b7-3c1704838bc9 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:42:51 devstack sudo[83611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d3feab65-363e-46ef-a8b7-3c1704838bc9
Apr 09 12:42:51 devstack sudo[83611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:42:52 devstack sudo[83611]: pam_unix(sudo:session): session closed for user root
Apr 09 12:42:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-80283ce4-a3cc-4944-b572-1609338af9d0 tempest-VolumesTestJSON-809111195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d3feab65-363e-46ef-a8b7-3c1704838bc9" returned: 0 in 0.883s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:42:52 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-80283ce4-a3cc-4944-b572-1609338af9d0 tempest-VolumesTestJSON-809111195 None] <== create_volume: return (2437ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:42:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-80283ce4-a3cc-4944-b572-1609338af9d0 tempest-VolumesTestJSON-809111195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.439s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:42:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-80283ce4-a3cc-4944-b572-1609338af9d0 tempest-VolumesTestJSON-809111195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71876484-9522-4391-aa47-0b07392684fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3feab65-363e-46ef-a8b7-3c1704838bc9', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:42:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-80283ce4-a3cc-4944-b572-1609338af9d0 tempest-VolumesTestJSON-809111195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc67e045-823f-46b8-9ca1-72e84fcbd3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:42:52 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-80283ce4-a3cc-4944-b572-1609338af9d0 tempest-VolumesTestJSON-809111195 None] Volume volume-d3feab65-363e-46ef-a8b7-3c1704838bc9 (d3feab65-363e-46ef-a8b7-3c1704838bc9): created successfully
Apr 09 12:42:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-80283ce4-a3cc-4944-b572-1609338af9d0 tempest-VolumesTestJSON-809111195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc67e045-823f-46b8-9ca1-72e84fcbd3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:42:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-80283ce4-a3cc-4944-b572-1609338af9d0 tempest-VolumesTestJSON-809111195 None] Flow 'volume_create_manager' (d8af45d5-5ade-4df6-bc56-ad7b1b9002da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:42:52 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-80283ce4-a3cc-4944-b572-1609338af9d0 tempest-VolumesTestJSON-809111195 None] Created volume successfully.
Apr 09 12:42:53 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bb68745-7b03-4ca9-b5de-6a23491ab309 tempest-VolumesAdminNegativeTest-64426354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:42:53 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8bb68745-7b03-4ca9-b5de-6a23491ab309 tempest-VolumesAdminNegativeTest-64426354 None] Flow 'volume_create_manager' (4ecab3ee-972a-413c-8c82-acaa82c720a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:42:53 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8bb68745-7b03-4ca9-b5de-6a23491ab309 tempest-VolumesAdminNegativeTest-64426354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcd1dc33-c034-48ec-80ed-40fa2669c4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:42:53 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8bb68745-7b03-4ca9-b5de-6a23491ab309 tempest-VolumesAdminNegativeTest-64426354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcd1dc33-c034-48ec-80ed-40fa2669c4ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:42:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1168245508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fb6c0da-146c-4f4b-ab12-ad69b6f6693b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c69fa5fddc04713b2b1eb16beb9ade7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:42:53Z,use_quota=True,user_id='4705cd850bff4d6bb6abe0cd6ab0b673',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:42:53 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8bb68745-7b03-4ca9-b5de-6a23491ab309 tempest-VolumesAdminNegativeTest-64426354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (662375cb-c5c4-4def-bf25-2e9e81541a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:42:53 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8bb68745-7b03-4ca9-b5de-6a23491ab309 tempest-VolumesAdminNegativeTest-64426354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (662375cb-c5c4-4def-bf25-2e9e81541a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:42:53 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8bb68745-7b03-4ca9-b5de-6a23491ab309 tempest-VolumesAdminNegativeTest-64426354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a666e2e3-9175-4076-a120-1a1b5dac7dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:42:53 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8bb68745-7b03-4ca9-b5de-6a23491ab309 tempest-VolumesAdminNegativeTest-64426354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a666e2e3-9175-4076-a120-1a1b5dac7dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fb6c0da-146c-4f4b-ab12-ad69b6f6693b', 'volume_name': 'volume-7fb6c0da-146c-4f4b-ab12-ad69b6f6693b', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:42:53 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8bb68745-7b03-4ca9-b5de-6a23491ab309 tempest-VolumesAdminNegativeTest-64426354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb1a04a3-e168-4165-9dce-c3fb8b1f79eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:42:53 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8bb68745-7b03-4ca9-b5de-6a23491ab309 tempest-VolumesAdminNegativeTest-64426354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb1a04a3-e168-4165-9dce-c3fb8b1f79eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:42:53 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8bb68745-7b03-4ca9-b5de-6a23491ab309 tempest-VolumesAdminNegativeTest-64426354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8d418f2-dc39-490e-a190-5efff96ba4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:42:53 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-8bb68745-7b03-4ca9-b5de-6a23491ab309 tempest-VolumesAdminNegativeTest-64426354 None] Volume 7fb6c0da-146c-4f4b-ab12-ad69b6f6693b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fb6c0da-146c-4f4b-ab12-ad69b6f6693b', 'volume_size': 1}
Apr 09 12:42:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-8bb68745-7b03-4ca9-b5de-6a23491ab309 tempest-VolumesAdminNegativeTest-64426354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:42:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-8bb68745-7b03-4ca9-b5de-6a23491ab309 tempest-VolumesAdminNegativeTest-64426354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:42:53 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-8bb68745-7b03-4ca9-b5de-6a23491ab309 tempest-VolumesAdminNegativeTest-64426354 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:42:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1168245508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fb6c0da-146c-4f4b-ab12-ad69b6f6693b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c69fa5fddc04713b2b1eb16beb9ade7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:42:53Z,use_quota=True,user_id='4705cd850bff4d6bb6abe0cd6ab0b673',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:42:53 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-8bb68745-7b03-4ca9-b5de-6a23491ab309 tempest-VolumesAdminNegativeTest-64426354 None] Creating volume 7fb6c0da-146c-4f4b-ab12-ad69b6f6693b {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:42:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-8bb68745-7b03-4ca9-b5de-6a23491ab309 tempest-VolumesAdminNegativeTest-64426354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:42:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-8bb68745-7b03-4ca9-b5de-6a23491ab309 tempest-VolumesAdminNegativeTest-64426354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:42:53 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-8bb68745-7b03-4ca9-b5de-6a23491ab309 tempest-VolumesAdminNegativeTest-64426354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:42:53 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-8bb68745-7b03-4ca9-b5de-6a23491ab309 tempest-VolumesAdminNegativeTest-64426354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:42:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-8bb68745-7b03-4ca9-b5de-6a23491ab309 tempest-VolumesAdminNegativeTest-64426354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:42:53 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-8bb68745-7b03-4ca9-b5de-6a23491ab309 tempest-VolumesAdminNegativeTest-64426354 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:42:53 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-8bb68745-7b03-4ca9-b5de-6a23491ab309 tempest-VolumesAdminNegativeTest-64426354 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:42:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-8bb68745-7b03-4ca9-b5de-6a23491ab309 tempest-VolumesAdminNegativeTest-64426354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7fb6c0da-146c-4f4b-ab12-ad69b6f6693b 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:42:53 devstack sudo[83616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7fb6c0da-146c-4f4b-ab12-ad69b6f6693b 1073741824
Apr 09 12:42:53 devstack sudo[83616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:42:53 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-122e9f98-f479-483a-869d-cb782248bc21 tempest-VolumesTestJSON-809111195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:42:53 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-122e9f98-f479-483a-869d-cb782248bc21 tempest-VolumesTestJSON-809111195 None] Flow 'volume_create_manager' (56162a0a-dbb6-4b61-a1a0-7e3d90a8017f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:42:53 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-122e9f98-f479-483a-869d-cb782248bc21 tempest-VolumesTestJSON-809111195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f99cc4e-35eb-4fc5-92f3-08da4d0467dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:42:53 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-122e9f98-f479-483a-869d-cb782248bc21 tempest-VolumesTestJSON-809111195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f99cc4e-35eb-4fc5-92f3-08da4d0467dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:42:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-834437548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2a168b2-0f92-4e54-9c01-8e6309a0db60,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='437506a9ba074b47a772436c95e4ba11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:42:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:42:54Z,use_quota=True,user_id='849c64c4256a4c46a401805703785fa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:42:53 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-122e9f98-f479-483a-869d-cb782248bc21 tempest-VolumesTestJSON-809111195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d922412b-070f-4e1d-872f-96fadd6c74fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:42:53 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-122e9f98-f479-483a-869d-cb782248bc21 tempest-VolumesTestJSON-809111195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d922412b-070f-4e1d-872f-96fadd6c74fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:42:53 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-122e9f98-f479-483a-869d-cb782248bc21 tempest-VolumesTestJSON-809111195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8562f08f-c598-4c80-9f50-eb9984ef1784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:42:53 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-122e9f98-f479-483a-869d-cb782248bc21 tempest-VolumesTestJSON-809111195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8562f08f-c598-4c80-9f50-eb9984ef1784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2a168b2-0f92-4e54-9c01-8e6309a0db60', 'volume_name': 'volume-d2a168b2-0f92-4e54-9c01-8e6309a0db60', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:42:53 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-122e9f98-f479-483a-869d-cb782248bc21 tempest-VolumesTestJSON-809111195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4593a030-280d-4f26-830e-9a061fe4b976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:42:53 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-122e9f98-f479-483a-869d-cb782248bc21 tempest-VolumesTestJSON-809111195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4593a030-280d-4f26-830e-9a061fe4b976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:42:53 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-122e9f98-f479-483a-869d-cb782248bc21 tempest-VolumesTestJSON-809111195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0b94918-bbad-4014-971b-4f560244ad7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:42:53 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-122e9f98-f479-483a-869d-cb782248bc21 tempest-VolumesTestJSON-809111195 None] Volume d2a168b2-0f92-4e54-9c01-8e6309a0db60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2a168b2-0f92-4e54-9c01-8e6309a0db60', 'volume_size': 1}
Apr 09 12:42:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-122e9f98-f479-483a-869d-cb782248bc21 tempest-VolumesTestJSON-809111195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:42:54 devstack sudo[83616]: pam_unix(sudo:session): session closed for user root
Apr 09 12:42:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-8bb68745-7b03-4ca9-b5de-6a23491ab309 tempest-VolumesAdminNegativeTest-64426354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7fb6c0da-146c-4f4b-ab12-ad69b6f6693b 1073741824" returned: 0 in 0.949s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:42:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-8bb68745-7b03-4ca9-b5de-6a23491ab309 tempest-VolumesAdminNegativeTest-64426354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7fb6c0da-146c-4f4b-ab12-ad69b6f6693b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:42:54 devstack sudo[83622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7fb6c0da-146c-4f4b-ab12-ad69b6f6693b
Apr 09 12:42:54 devstack sudo[83622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:42:55 devstack sudo[83622]: pam_unix(sudo:session): session closed for user root
Apr 09 12:42:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-8bb68745-7b03-4ca9-b5de-6a23491ab309 tempest-VolumesAdminNegativeTest-64426354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7fb6c0da-146c-4f4b-ab12-ad69b6f6693b" returned: 0 in 0.649s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:42:55 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-8bb68745-7b03-4ca9-b5de-6a23491ab309 tempest-VolumesAdminNegativeTest-64426354 None] <== create_volume: return (1646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:42:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-8bb68745-7b03-4ca9-b5de-6a23491ab309 tempest-VolumesAdminNegativeTest-64426354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.649s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:42:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-122e9f98-f479-483a-869d-cb782248bc21 tempest-VolumesTestJSON-809111195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.098s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:42:55 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-122e9f98-f479-483a-869d-cb782248bc21 tempest-VolumesTestJSON-809111195 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:42:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-834437548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2a168b2-0f92-4e54-9c01-8e6309a0db60,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='437506a9ba074b47a772436c95e4ba11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:42:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:42:54Z,use_quota=True,user_id='849c64c4256a4c46a401805703785fa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:42:55 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-122e9f98-f479-483a-869d-cb782248bc21 tempest-VolumesTestJSON-809111195 None] Creating volume d2a168b2-0f92-4e54-9c01-8e6309a0db60 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:42:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-122e9f98-f479-483a-869d-cb782248bc21 tempest-VolumesTestJSON-809111195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:42:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-122e9f98-f479-483a-869d-cb782248bc21 tempest-VolumesTestJSON-809111195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:42:55 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-122e9f98-f479-483a-869d-cb782248bc21 tempest-VolumesTestJSON-809111195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:42:55 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-122e9f98-f479-483a-869d-cb782248bc21 tempest-VolumesTestJSON-809111195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:42:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-122e9f98-f479-483a-869d-cb782248bc21 tempest-VolumesTestJSON-809111195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:42:55 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-122e9f98-f479-483a-869d-cb782248bc21 tempest-VolumesTestJSON-809111195 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:42:55 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-122e9f98-f479-483a-869d-cb782248bc21 tempest-VolumesTestJSON-809111195 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:42:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-122e9f98-f479-483a-869d-cb782248bc21 tempest-VolumesTestJSON-809111195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d2a168b2-0f92-4e54-9c01-8e6309a0db60 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:42:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8bb68745-7b03-4ca9-b5de-6a23491ab309 tempest-VolumesAdminNegativeTest-64426354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8d418f2-dc39-490e-a190-5efff96ba4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fb6c0da-146c-4f4b-ab12-ad69b6f6693b', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:42:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8bb68745-7b03-4ca9-b5de-6a23491ab309 tempest-VolumesAdminNegativeTest-64426354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d403ff1c-0808-4e46-98d8-7afee6d83d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:42:55 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-8bb68745-7b03-4ca9-b5de-6a23491ab309 tempest-VolumesAdminNegativeTest-64426354 None] Volume volume-7fb6c0da-146c-4f4b-ab12-ad69b6f6693b (7fb6c0da-146c-4f4b-ab12-ad69b6f6693b): created successfully
Apr 09 12:42:55 devstack sudo[83625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d2a168b2-0f92-4e54-9c01-8e6309a0db60 1073741824
Apr 09 12:42:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8bb68745-7b03-4ca9-b5de-6a23491ab309 tempest-VolumesAdminNegativeTest-64426354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d403ff1c-0808-4e46-98d8-7afee6d83d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:42:55 devstack sudo[83625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:42:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8bb68745-7b03-4ca9-b5de-6a23491ab309 tempest-VolumesAdminNegativeTest-64426354 None] Flow 'volume_create_manager' (4ecab3ee-972a-413c-8c82-acaa82c720a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:42:55 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-8bb68745-7b03-4ca9-b5de-6a23491ab309 tempest-VolumesAdminNegativeTest-64426354 None] Created volume successfully.
Apr 09 12:42:55 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [req-f70fd50b-119b-46ad-a2dc-3c27d6e2c273 req-9982bddf-20b5-43cd-a112-4639ab51513c tempest-VolumesGetTestJSON-2098890165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:42:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-f70fd50b-119b-46ad-a2dc-3c27d6e2c273 req-9982bddf-20b5-43cd-a112-4639ab51513c tempest-VolumesGetTestJSON-2098890165 None] Flow 'volume_create_manager' (fd7b95f7-f2bf-4da6-a848-a1c92fd4653c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:42:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-f70fd50b-119b-46ad-a2dc-3c27d6e2c273 req-9982bddf-20b5-43cd-a112-4639ab51513c tempest-VolumesGetTestJSON-2098890165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6437550-8b21-47ef-b5e4-d05c3dd9a695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:42:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-f70fd50b-119b-46ad-a2dc-3c27d6e2c273 req-9982bddf-20b5-43cd-a112-4639ab51513c tempest-VolumesGetTestJSON-2098890165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6437550-8b21-47ef-b5e4-d05c3dd9a695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1548727004',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3935c9b-2c9c-46a8-9d54-de7809579741,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5e529ea5b8bf446aa2deb442f4cee1f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:42:56Z,use_quota=True,user_id='8e547e11ba36496682e4d98f591c5b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:42:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-f70fd50b-119b-46ad-a2dc-3c27d6e2c273 req-9982bddf-20b5-43cd-a112-4639ab51513c tempest-VolumesGetTestJSON-2098890165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35938c51-f025-4749-98c2-fa46e2ee6d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:42:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-f70fd50b-119b-46ad-a2dc-3c27d6e2c273 req-9982bddf-20b5-43cd-a112-4639ab51513c tempest-VolumesGetTestJSON-2098890165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35938c51-f025-4749-98c2-fa46e2ee6d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:42:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-f70fd50b-119b-46ad-a2dc-3c27d6e2c273 req-9982bddf-20b5-43cd-a112-4639ab51513c tempest-VolumesGetTestJSON-2098890165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7776d04-949b-40d4-9ea1-17e683f4e6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:42:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-f70fd50b-119b-46ad-a2dc-3c27d6e2c273 req-9982bddf-20b5-43cd-a112-4639ab51513c tempest-VolumesGetTestJSON-2098890165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7776d04-949b-40d4-9ea1-17e683f4e6ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3935c9b-2c9c-46a8-9d54-de7809579741', 'volume_name': 'volume-d3935c9b-2c9c-46a8-9d54-de7809579741', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:42:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-f70fd50b-119b-46ad-a2dc-3c27d6e2c273 req-9982bddf-20b5-43cd-a112-4639ab51513c tempest-VolumesGetTestJSON-2098890165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed0ab524-b61c-43a1-8480-14ec753e03d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:42:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-f70fd50b-119b-46ad-a2dc-3c27d6e2c273 req-9982bddf-20b5-43cd-a112-4639ab51513c tempest-VolumesGetTestJSON-2098890165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed0ab524-b61c-43a1-8480-14ec753e03d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:42:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-f70fd50b-119b-46ad-a2dc-3c27d6e2c273 req-9982bddf-20b5-43cd-a112-4639ab51513c tempest-VolumesGetTestJSON-2098890165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd2ca073-2615-40a3-b9af-b2f405c95015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:42:55 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [req-f70fd50b-119b-46ad-a2dc-3c27d6e2c273 req-9982bddf-20b5-43cd-a112-4639ab51513c tempest-VolumesGetTestJSON-2098890165 None] Volume d3935c9b-2c9c-46a8-9d54-de7809579741: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3935c9b-2c9c-46a8-9d54-de7809579741', 'volume_size': 1}
Apr 09 12:42:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [req-f70fd50b-119b-46ad-a2dc-3c27d6e2c273 req-9982bddf-20b5-43cd-a112-4639ab51513c tempest-VolumesGetTestJSON-2098890165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:42:56 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-49f0b566-3535-49e6-87e9-7170c0f88295 tempest-VolumesAdminNegativeTest-64426354 None] Acquiring lock "cinder-7fb6c0da-146c-4f4b-ab12-ad69b6f6693b-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:42:56 devstack sudo[83625]: pam_unix(sudo:session): session closed for user root
Apr 09 12:42:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-122e9f98-f479-483a-869d-cb782248bc21 tempest-VolumesTestJSON-809111195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d2a168b2-0f92-4e54-9c01-8e6309a0db60 1073741824" returned: 0 in 1.120s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:42:56 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-49f0b566-3535-49e6-87e9-7170c0f88295 tempest-VolumesAdminNegativeTest-64426354 None] Lock "cinder-7fb6c0da-146c-4f4b-ab12-ad69b6f6693b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:42:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-122e9f98-f479-483a-869d-cb782248bc21 tempest-VolumesTestJSON-809111195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d2a168b2-0f92-4e54-9c01-8e6309a0db60 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:42:56 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-49f0b566-3535-49e6-87e9-7170c0f88295 tempest-VolumesAdminNegativeTest-64426354 None] Acquiring lock "cinder-quobyte-7fb6c0da-146c-4f4b-ab12-ad69b6f6693b" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:42:56 devstack sudo[83635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d2a168b2-0f92-4e54-9c01-8e6309a0db60
Apr 09 12:42:56 devstack sudo[83635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:42:56 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-49f0b566-3535-49e6-87e9-7170c0f88295 tempest-VolumesAdminNegativeTest-64426354 None] Lock "cinder-quobyte-7fb6c0da-146c-4f4b-ab12-ad69b6f6693b" acquired by "delete_volume" :: waited 0.010s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:42:56 devstack cinder-volume[82760]: INFO oslo.privsep.daemon [None req-49f0b566-3535-49e6-87e9-7170c0f88295 tempest-VolumesAdminNegativeTest-64426354 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpmf1y1uoy/privsep.sock']
Apr 09 12:42:56 devstack sudo[83637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpmf1y1uoy/privsep.sock
Apr 09 12:42:56 devstack sudo[83637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:42:56 devstack cinder-volume[82760]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
Apr 09 12:42:56 devstack cinder-volume[82760]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 09 12:42:56 devstack cinder-volume[82760]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 09 12:42:56 devstack cinder-volume[82760]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 09 12:42:56 devstack cinder-volume[82760]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 09 12:42:56 devstack cinder-volume[82760]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 09 12:42:56 devstack cinder-volume[82760]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 09 12:42:56 devstack cinder-volume[82760]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 09 12:42:56 devstack cinder-volume[82760]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
Apr 09 12:42:56 devstack sudo[83635]: pam_unix(sudo:session): session closed for user root
Apr 09 12:42:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-122e9f98-f479-483a-869d-cb782248bc21 tempest-VolumesTestJSON-809111195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d2a168b2-0f92-4e54-9c01-8e6309a0db60" returned: 0 in 0.460s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:42:56 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-122e9f98-f479-483a-869d-cb782248bc21 tempest-VolumesTestJSON-809111195 None] <== create_volume: return (1638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:42:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-122e9f98-f479-483a-869d-cb782248bc21 tempest-VolumesTestJSON-809111195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.643s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:42:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [req-f70fd50b-119b-46ad-a2dc-3c27d6e2c273 req-9982bddf-20b5-43cd-a112-4639ab51513c tempest-VolumesGetTestJSON-2098890165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.807s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:42:56 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [req-f70fd50b-119b-46ad-a2dc-3c27d6e2c273 req-9982bddf-20b5-43cd-a112-4639ab51513c tempest-VolumesGetTestJSON-2098890165 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1548727004',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3935c9b-2c9c-46a8-9d54-de7809579741,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5e529ea5b8bf446aa2deb442f4cee1f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:42:56Z,use_quota=True,user_id='8e547e11ba36496682e4d98f591c5b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:42:56 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [req-f70fd50b-119b-46ad-a2dc-3c27d6e2c273 req-9982bddf-20b5-43cd-a112-4639ab51513c tempest-VolumesGetTestJSON-2098890165 None] Creating volume d3935c9b-2c9c-46a8-9d54-de7809579741 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:42:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [req-f70fd50b-119b-46ad-a2dc-3c27d6e2c273 req-9982bddf-20b5-43cd-a112-4639ab51513c tempest-VolumesGetTestJSON-2098890165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:42:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [req-f70fd50b-119b-46ad-a2dc-3c27d6e2c273 req-9982bddf-20b5-43cd-a112-4639ab51513c tempest-VolumesGetTestJSON-2098890165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:42:56 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [req-f70fd50b-119b-46ad-a2dc-3c27d6e2c273 req-9982bddf-20b5-43cd-a112-4639ab51513c tempest-VolumesGetTestJSON-2098890165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:42:56 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [req-f70fd50b-119b-46ad-a2dc-3c27d6e2c273 req-9982bddf-20b5-43cd-a112-4639ab51513c tempest-VolumesGetTestJSON-2098890165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:42:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [req-f70fd50b-119b-46ad-a2dc-3c27d6e2c273 req-9982bddf-20b5-43cd-a112-4639ab51513c tempest-VolumesGetTestJSON-2098890165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:42:56 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [req-f70fd50b-119b-46ad-a2dc-3c27d6e2c273 req-9982bddf-20b5-43cd-a112-4639ab51513c tempest-VolumesGetTestJSON-2098890165 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:42:56 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [req-f70fd50b-119b-46ad-a2dc-3c27d6e2c273 req-9982bddf-20b5-43cd-a112-4639ab51513c tempest-VolumesGetTestJSON-2098890165 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:42:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-f70fd50b-119b-46ad-a2dc-3c27d6e2c273 req-9982bddf-20b5-43cd-a112-4639ab51513c tempest-VolumesGetTestJSON-2098890165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d3935c9b-2c9c-46a8-9d54-de7809579741 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:42:56 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-122e9f98-f479-483a-869d-cb782248bc21 tempest-VolumesTestJSON-809111195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0b94918-bbad-4014-971b-4f560244ad7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2a168b2-0f92-4e54-9c01-8e6309a0db60', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:42:56 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-122e9f98-f479-483a-869d-cb782248bc21 tempest-VolumesTestJSON-809111195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (111045bb-5e5f-4f61-83c3-4be37e124845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:42:56 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-122e9f98-f479-483a-869d-cb782248bc21 tempest-VolumesTestJSON-809111195 None] Volume volume-d2a168b2-0f92-4e54-9c01-8e6309a0db60 (d2a168b2-0f92-4e54-9c01-8e6309a0db60): created successfully
Apr 09 12:42:56 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-122e9f98-f479-483a-869d-cb782248bc21 tempest-VolumesTestJSON-809111195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (111045bb-5e5f-4f61-83c3-4be37e124845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:42:56 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-122e9f98-f479-483a-869d-cb782248bc21 tempest-VolumesTestJSON-809111195 None] Flow 'volume_create_manager' (56162a0a-dbb6-4b61-a1a0-7e3d90a8017f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:42:56 devstack sudo[83642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d3935c9b-2c9c-46a8-9d54-de7809579741 1073741824
Apr 09 12:42:56 devstack sudo[83642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:42:56 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-122e9f98-f479-483a-869d-cb782248bc21 tempest-VolumesTestJSON-809111195 None] Created volume successfully.
Apr 09 12:42:57 devstack cinder-volume[82760]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning:
Apr 09 12:42:57 devstack cinder-volume[82760]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 09 12:42:57 devstack cinder-volume[82760]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 09 12:42:57 devstack cinder-volume[82760]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 09 12:42:57 devstack cinder-volume[82760]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 09 12:42:57 devstack cinder-volume[82760]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 09 12:42:57 devstack cinder-volume[82760]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 09 12:42:57 devstack cinder-volume[82760]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 09 12:42:57 devstack cinder-volume[82760]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Apr 09 12:42:57 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-d31de9a9-7d29-4182-8e4f-d94cf76c2cb1 tempest-VolumesTestJSON-809111195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:42:57 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d31de9a9-7d29-4182-8e4f-d94cf76c2cb1 tempest-VolumesTestJSON-809111195 None] Flow 'volume_create_manager' (b319928b-52b3-4dbc-9283-d13dd1765ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:42:57 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d31de9a9-7d29-4182-8e4f-d94cf76c2cb1 tempest-VolumesTestJSON-809111195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7c36316-f1c4-42c4-9c3e-1e9ba60977ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:42:57 devstack sudo[83642]: pam_unix(sudo:session): session closed for user root
Apr 09 12:42:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-f70fd50b-119b-46ad-a2dc-3c27d6e2c273 req-9982bddf-20b5-43cd-a112-4639ab51513c tempest-VolumesGetTestJSON-2098890165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d3935c9b-2c9c-46a8-9d54-de7809579741 1073741824" returned: 0 in 1.001s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:42:57 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d31de9a9-7d29-4182-8e4f-d94cf76c2cb1 tempest-VolumesTestJSON-809111195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7c36316-f1c4-42c4-9c3e-1e9ba60977ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1952546575',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2dcf89f-0cb7-499b-ba88-bc7b800e8b65,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='437506a9ba074b47a772436c95e4ba11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:42:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:42:58Z,use_quota=True,user_id='849c64c4256a4c46a401805703785fa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:42:57 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d31de9a9-7d29-4182-8e4f-d94cf76c2cb1 tempest-VolumesTestJSON-809111195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97893080-06d0-4610-a67b-5ca994d3003b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:42:57 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d31de9a9-7d29-4182-8e4f-d94cf76c2cb1 tempest-VolumesTestJSON-809111195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97893080-06d0-4610-a67b-5ca994d3003b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:42:57 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d31de9a9-7d29-4182-8e4f-d94cf76c2cb1 tempest-VolumesTestJSON-809111195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51cac23b-50cc-4ee4-a103-44a16f77b525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:42:57 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d31de9a9-7d29-4182-8e4f-d94cf76c2cb1 tempest-VolumesTestJSON-809111195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51cac23b-50cc-4ee4-a103-44a16f77b525) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2dcf89f-0cb7-499b-ba88-bc7b800e8b65', 'volume_name': 'volume-d2dcf89f-0cb7-499b-ba88-bc7b800e8b65', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:42:57 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d31de9a9-7d29-4182-8e4f-d94cf76c2cb1 tempest-VolumesTestJSON-809111195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be6437fc-cae0-4085-973a-06e4d917429f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:42:57 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d31de9a9-7d29-4182-8e4f-d94cf76c2cb1 tempest-VolumesTestJSON-809111195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be6437fc-cae0-4085-973a-06e4d917429f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:42:57 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d31de9a9-7d29-4182-8e4f-d94cf76c2cb1 tempest-VolumesTestJSON-809111195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe766960-2e4a-4351-87fa-4bb03772e672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:42:57 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-d31de9a9-7d29-4182-8e4f-d94cf76c2cb1 tempest-VolumesTestJSON-809111195 None] Volume d2dcf89f-0cb7-499b-ba88-bc7b800e8b65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2dcf89f-0cb7-499b-ba88-bc7b800e8b65', 'volume_size': 1}
Apr 09 12:42:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d31de9a9-7d29-4182-8e4f-d94cf76c2cb1 tempest-VolumesTestJSON-809111195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:42:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-f70fd50b-119b-46ad-a2dc-3c27d6e2c273 req-9982bddf-20b5-43cd-a112-4639ab51513c tempest-VolumesGetTestJSON-2098890165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d3935c9b-2c9c-46a8-9d54-de7809579741 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:42:57 devstack sudo[83637]: pam_unix(sudo:session): session closed for user root
Apr 09 12:42:57 devstack cinder-volume[82760]: INFO oslo.privsep.daemon [None req-49f0b566-3535-49e6-87e9-7170c0f88295 tempest-VolumesAdminNegativeTest-64426354 None] Spawned new privsep daemon via rootwrap
Apr 09 12:42:57 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [None req-49f0b566-3535-49e6-87e9-7170c0f88295 tempest-VolumesAdminNegativeTest-64426354 None] Accepted privsep connection to /tmp/tmpmf1y1uoy/privsep.sock {{(pid=82760) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}}
Apr 09 12:42:57 devstack cinder-volume[82760]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 09 12:42:57 devstack cinder-volume[82760]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 09 12:42:57 devstack cinder-volume[82760]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 09 12:42:57 devstack cinder-volume[82760]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83649
Apr 09 12:42:57 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be4a8fe-e55d-4e8d-bff1-eb335bfe7263]: (2,) {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:42:57 devstack sudo[83650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d3935c9b-2c9c-46a8-9d54-de7809579741
Apr 09 12:42:57 devstack sudo[83650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:42:57 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[24784869-c857-47d8-b5ef-70508526a73c]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:42:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-49f0b566-3535-49e6-87e9-7170c0f88295 tempest-VolumesAdminNegativeTest-64426354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7fb6c0da-146c-4f4b-ab12-ad69b6f6693b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:42:57 devstack sudo[83653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7fb6c0da-146c-4f4b-ab12-ad69b6f6693b
Apr 09 12:42:57 devstack sudo[83653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:42:58 devstack sudo[83650]: pam_unix(sudo:session): session closed for user root
Apr 09 12:42:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-f70fd50b-119b-46ad-a2dc-3c27d6e2c273 req-9982bddf-20b5-43cd-a112-4639ab51513c tempest-VolumesGetTestJSON-2098890165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d3935c9b-2c9c-46a8-9d54-de7809579741" returned: 0 in 0.508s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:42:58 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [req-f70fd50b-119b-46ad-a2dc-3c27d6e2c273 req-9982bddf-20b5-43cd-a112-4639ab51513c tempest-VolumesGetTestJSON-2098890165 None] <== create_volume: return (1586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:42:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [req-f70fd50b-119b-46ad-a2dc-3c27d6e2c273 req-9982bddf-20b5-43cd-a112-4639ab51513c tempest-VolumesGetTestJSON-2098890165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.588s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:42:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d31de9a9-7d29-4182-8e4f-d94cf76c2cb1 tempest-VolumesTestJSON-809111195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.545s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:42:58 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-d31de9a9-7d29-4182-8e4f-d94cf76c2cb1 tempest-VolumesTestJSON-809111195 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1952546575',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2dcf89f-0cb7-499b-ba88-bc7b800e8b65,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='437506a9ba074b47a772436c95e4ba11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:42:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:42:58Z,use_quota=True,user_id='849c64c4256a4c46a401805703785fa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:42:58 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-d31de9a9-7d29-4182-8e4f-d94cf76c2cb1 tempest-VolumesTestJSON-809111195 None] Creating volume d2dcf89f-0cb7-499b-ba88-bc7b800e8b65 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:42:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d31de9a9-7d29-4182-8e4f-d94cf76c2cb1 tempest-VolumesTestJSON-809111195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:42:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d31de9a9-7d29-4182-8e4f-d94cf76c2cb1 tempest-VolumesTestJSON-809111195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:42:58 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-d31de9a9-7d29-4182-8e4f-d94cf76c2cb1 tempest-VolumesTestJSON-809111195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:42:58 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-d31de9a9-7d29-4182-8e4f-d94cf76c2cb1 tempest-VolumesTestJSON-809111195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:42:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d31de9a9-7d29-4182-8e4f-d94cf76c2cb1 tempest-VolumesTestJSON-809111195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:42:58 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-d31de9a9-7d29-4182-8e4f-d94cf76c2cb1 tempest-VolumesTestJSON-809111195 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:42:58 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-d31de9a9-7d29-4182-8e4f-d94cf76c2cb1 tempest-VolumesTestJSON-809111195 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:42:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d31de9a9-7d29-4182-8e4f-d94cf76c2cb1 tempest-VolumesTestJSON-809111195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d2dcf89f-0cb7-499b-ba88-bc7b800e8b65 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:42:58 devstack sudo[83659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d2dcf89f-0cb7-499b-ba88-bc7b800e8b65 1073741824
Apr 09 12:42:58 devstack sudo[83659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:42:58 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-f70fd50b-119b-46ad-a2dc-3c27d6e2c273 req-9982bddf-20b5-43cd-a112-4639ab51513c tempest-VolumesGetTestJSON-2098890165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd2ca073-2615-40a3-b9af-b2f405c95015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3935c9b-2c9c-46a8-9d54-de7809579741', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:42:58 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-f70fd50b-119b-46ad-a2dc-3c27d6e2c273 req-9982bddf-20b5-43cd-a112-4639ab51513c tempest-VolumesGetTestJSON-2098890165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af259555-08fb-48bc-8cab-63c489a5c4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:42:58 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [req-f70fd50b-119b-46ad-a2dc-3c27d6e2c273 req-9982bddf-20b5-43cd-a112-4639ab51513c tempest-VolumesGetTestJSON-2098890165 None] Volume volume-d3935c9b-2c9c-46a8-9d54-de7809579741 (d3935c9b-2c9c-46a8-9d54-de7809579741): created successfully
Apr 09 12:42:58 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-f70fd50b-119b-46ad-a2dc-3c27d6e2c273 req-9982bddf-20b5-43cd-a112-4639ab51513c tempest-VolumesGetTestJSON-2098890165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af259555-08fb-48bc-8cab-63c489a5c4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:42:58 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-f70fd50b-119b-46ad-a2dc-3c27d6e2c273 req-9982bddf-20b5-43cd-a112-4639ab51513c tempest-VolumesGetTestJSON-2098890165 None] Flow 'volume_create_manager' (fd7b95f7-f2bf-4da6-a848-a1c92fd4653c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:42:58 devstack cinder-volume[82760]: INFO cinder.volume.manager [req-f70fd50b-119b-46ad-a2dc-3c27d6e2c273 req-9982bddf-20b5-43cd-a112-4639ab51513c tempest-VolumesGetTestJSON-2098890165 None] Created volume successfully.
Apr 09 12:42:58 devstack sudo[83653]: pam_unix(sudo:session): session closed for user root
Apr 09 12:42:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-49f0b566-3535-49e6-87e9-7170c0f88295 tempest-VolumesAdminNegativeTest-64426354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7fb6c0da-146c-4f4b-ab12-ad69b6f6693b" returned: 0 in 0.671s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:42:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-49f0b566-3535-49e6-87e9-7170c0f88295 tempest-VolumesAdminNegativeTest-64426354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7fb6c0da-146c-4f4b-ab12-ad69b6f6693b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:42:58 devstack sudo[83661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7fb6c0da-146c-4f4b-ab12-ad69b6f6693b
Apr 09 12:42:58 devstack sudo[83661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:42:59 devstack sudo[83659]: pam_unix(sudo:session): session closed for user root
Apr 09 12:42:59 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d31de9a9-7d29-4182-8e4f-d94cf76c2cb1 tempest-VolumesTestJSON-809111195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d2dcf89f-0cb7-499b-ba88-bc7b800e8b65 1073741824" returned: 0 in 0.656s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:42:59 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d31de9a9-7d29-4182-8e4f-d94cf76c2cb1 tempest-VolumesTestJSON-809111195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d2dcf89f-0cb7-499b-ba88-bc7b800e8b65 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:42:59 devstack sudo[83667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d2dcf89f-0cb7-499b-ba88-bc7b800e8b65
Apr 09 12:42:59 devstack sudo[83667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:42:59 devstack sudo[83661]: pam_unix(sudo:session): session closed for user root
Apr 09 12:42:59 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-49f0b566-3535-49e6-87e9-7170c0f88295 tempest-VolumesAdminNegativeTest-64426354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7fb6c0da-146c-4f4b-ab12-ad69b6f6693b" returned: 0 in 0.623s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:42:59 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-49f0b566-3535-49e6-87e9-7170c0f88295 tempest-VolumesAdminNegativeTest-64426354 None] Lock "cinder-quobyte-7fb6c0da-146c-4f4b-ab12-ad69b6f6693b" released by "delete_volume" :: held 2.869s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:42:59 devstack cinder-volume[82760]: WARNING cinder.quota [None req-49f0b566-3535-49e6-87e9-7170c0f88295 tempest-VolumesAdminNegativeTest-64426354 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 09 12:42:59 devstack cinder-volume[82760]: WARNING cinder.quota [None req-49f0b566-3535-49e6-87e9-7170c0f88295 tempest-VolumesAdminNegativeTest-64426354 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 09 12:42:59 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-49f0b566-3535-49e6-87e9-7170c0f88295 tempest-VolumesAdminNegativeTest-64426354 None] Created reservations ['eb5780c3-5f4e-4be2-9eca-84a33652229b', 'cf9ef5ee-6a18-4bb1-8e14-e4cf9e5d0e3d', '9ec4b375-e343-4dc7-8dce-254f967ac733', 'f14e9261-5ae1-444f-9d0b-3ee044e93595'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:42:59 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-49f0b566-3535-49e6-87e9-7170c0f88295 tempest-VolumesAdminNegativeTest-64426354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:42:59 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-49f0b566-3535-49e6-87e9-7170c0f88295 tempest-VolumesAdminNegativeTest-64426354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:42:59 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-49f0b566-3535-49e6-87e9-7170c0f88295 tempest-VolumesAdminNegativeTest-64426354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:42:59 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-49f0b566-3535-49e6-87e9-7170c0f88295 tempest-VolumesAdminNegativeTest-64426354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:42:59 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-49f0b566-3535-49e6-87e9-7170c0f88295 tempest-VolumesAdminNegativeTest-64426354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:42:59 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-49f0b566-3535-49e6-87e9-7170c0f88295 tempest-VolumesAdminNegativeTest-64426354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:42:59 devstack cinder-volume[82760]: DEBUG cinder.coordination [req-17451fe0-46a4-4116-a2d4-34622dc6497a req-02b1e4e7-8b16-49c6-ab73-b9f3e6d11e02 tempest-VolumesGetTestJSON-2098890165 None] Acquiring lock "cinder-d3935c9b-2c9c-46a8-9d54-de7809579741-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:42:59 devstack sudo[83669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:42:59 devstack sudo[83669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:42:59 devstack cinder-volume[82760]: DEBUG cinder.coordination [req-17451fe0-46a4-4116-a2d4-34622dc6497a req-02b1e4e7-8b16-49c6-ab73-b9f3e6d11e02 tempest-VolumesGetTestJSON-2098890165 None] Lock "cinder-d3935c9b-2c9c-46a8-9d54-de7809579741-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:42:59 devstack cinder-volume[82760]: DEBUG cinder.coordination [req-17451fe0-46a4-4116-a2d4-34622dc6497a req-02b1e4e7-8b16-49c6-ab73-b9f3e6d11e02 tempest-VolumesGetTestJSON-2098890165 None] Acquiring lock "cinder-quobyte-d3935c9b-2c9c-46a8-9d54-de7809579741" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:42:59 devstack cinder-volume[82760]: DEBUG cinder.coordination [req-17451fe0-46a4-4116-a2d4-34622dc6497a req-02b1e4e7-8b16-49c6-ab73-b9f3e6d11e02 tempest-VolumesGetTestJSON-2098890165 None] Lock "cinder-quobyte-d3935c9b-2c9c-46a8-9d54-de7809579741" acquired by "delete_volume" :: waited 0.032s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:42:59 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c733fe-c3ee-4c49-9bf0-f6bd9e5266ce]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:42:59 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-17451fe0-46a4-4116-a2d4-34622dc6497a req-02b1e4e7-8b16-49c6-ab73-b9f3e6d11e02 tempest-VolumesGetTestJSON-2098890165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d3935c9b-2c9c-46a8-9d54-de7809579741 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:42:59 devstack sudo[83671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d3935c9b-2c9c-46a8-9d54-de7809579741
Apr 09 12:42:59 devstack sudo[83671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:42:59 devstack sudo[83667]: pam_unix(sudo:session): session closed for user root
Apr 09 12:42:59 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d31de9a9-7d29-4182-8e4f-d94cf76c2cb1 tempest-VolumesTestJSON-809111195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d2dcf89f-0cb7-499b-ba88-bc7b800e8b65" returned: 0 in 0.906s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:42:59 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-d31de9a9-7d29-4182-8e4f-d94cf76c2cb1 tempest-VolumesTestJSON-809111195 None] <== create_volume: return (1591ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:42:59 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d31de9a9-7d29-4182-8e4f-d94cf76c2cb1 tempest-VolumesTestJSON-809111195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.594s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:42:59 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d31de9a9-7d29-4182-8e4f-d94cf76c2cb1 tempest-VolumesTestJSON-809111195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe766960-2e4a-4351-87fa-4bb03772e672) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2dcf89f-0cb7-499b-ba88-bc7b800e8b65', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:42:59 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d31de9a9-7d29-4182-8e4f-d94cf76c2cb1 tempest-VolumesTestJSON-809111195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dd58c91-aa71-4cf0-b2f8-8adb61615187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:42:59 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-d31de9a9-7d29-4182-8e4f-d94cf76c2cb1 tempest-VolumesTestJSON-809111195 None] Volume volume-d2dcf89f-0cb7-499b-ba88-bc7b800e8b65 (d2dcf89f-0cb7-499b-ba88-bc7b800e8b65): created successfully
Apr 09 12:42:59 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d31de9a9-7d29-4182-8e4f-d94cf76c2cb1 tempest-VolumesTestJSON-809111195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dd58c91-aa71-4cf0-b2f8-8adb61615187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:42:59 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d31de9a9-7d29-4182-8e4f-d94cf76c2cb1 tempest-VolumesTestJSON-809111195 None] Flow 'volume_create_manager' (b319928b-52b3-4dbc-9283-d13dd1765ce8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:42:59 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-d31de9a9-7d29-4182-8e4f-d94cf76c2cb1 tempest-VolumesTestJSON-809111195 None] Created volume successfully.
Apr 09 12:43:00 devstack sudo[83669]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-49f0b566-3535-49e6-87e9-7170c0f88295 tempest-VolumesAdminNegativeTest-64426354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.816s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:00 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-49f0b566-3535-49e6-87e9-7170c0f88295 tempest-VolumesAdminNegativeTest-64426354 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:43:00 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-49f0b566-3535-49e6-87e9-7170c0f88295 tempest-VolumesAdminNegativeTest-64426354 None] Deleted volume successfully.
Apr 09 12:43:00 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-49f0b566-3535-49e6-87e9-7170c0f88295 tempest-VolumesAdminNegativeTest-64426354 None] Lock "cinder-7fb6c0da-146c-4f4b-ab12-ad69b6f6693b-delete_volume" released by "delete_volume" :: held 3.975s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:43:00 devstack sudo[83671]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-17451fe0-46a4-4116-a2d4-34622dc6497a req-02b1e4e7-8b16-49c6-ab73-b9f3e6d11e02 tempest-VolumesGetTestJSON-2098890165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d3935c9b-2c9c-46a8-9d54-de7809579741" returned: 0 in 0.816s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-17451fe0-46a4-4116-a2d4-34622dc6497a req-02b1e4e7-8b16-49c6-ab73-b9f3e6d11e02 tempest-VolumesGetTestJSON-2098890165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d3935c9b-2c9c-46a8-9d54-de7809579741 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:00 devstack sudo[83679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d3935c9b-2c9c-46a8-9d54-de7809579741
Apr 09 12:43:00 devstack sudo[83679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:00 devstack sudo[83679]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-17451fe0-46a4-4116-a2d4-34622dc6497a req-02b1e4e7-8b16-49c6-ab73-b9f3e6d11e02 tempest-VolumesGetTestJSON-2098890165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d3935c9b-2c9c-46a8-9d54-de7809579741" returned: 0 in 0.536s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:00 devstack cinder-volume[82760]: DEBUG cinder.coordination [req-17451fe0-46a4-4116-a2d4-34622dc6497a req-02b1e4e7-8b16-49c6-ab73-b9f3e6d11e02 tempest-VolumesGetTestJSON-2098890165 None] Lock "cinder-quobyte-d3935c9b-2c9c-46a8-9d54-de7809579741" released by "delete_volume" :: held 1.413s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:43:01 devstack cinder-volume[82760]: DEBUG cinder.quota [req-17451fe0-46a4-4116-a2d4-34622dc6497a req-02b1e4e7-8b16-49c6-ab73-b9f3e6d11e02 tempest-VolumesGetTestJSON-2098890165 None] Created reservations ['7a7f6b05-7e0b-42a0-9f49-2fd11bca5a89', 'c094d264-2857-4641-a2ac-ecac7343e2e5', '9fcc3120-09b8-47d7-b718-2e6c9f9baa2c', '8af7cb8a-2545-4787-a8f5-1f069b6af8d4'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:43:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [req-17451fe0-46a4-4116-a2d4-34622dc6497a req-02b1e4e7-8b16-49c6-ab73-b9f3e6d11e02 tempest-VolumesGetTestJSON-2098890165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:43:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [req-17451fe0-46a4-4116-a2d4-34622dc6497a req-02b1e4e7-8b16-49c6-ab73-b9f3e6d11e02 tempest-VolumesGetTestJSON-2098890165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:43:01 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [req-17451fe0-46a4-4116-a2d4-34622dc6497a req-02b1e4e7-8b16-49c6-ab73-b9f3e6d11e02 tempest-VolumesGetTestJSON-2098890165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:43:01 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [req-17451fe0-46a4-4116-a2d4-34622dc6497a req-02b1e4e7-8b16-49c6-ab73-b9f3e6d11e02 tempest-VolumesGetTestJSON-2098890165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:43:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [req-17451fe0-46a4-4116-a2d4-34622dc6497a req-02b1e4e7-8b16-49c6-ab73-b9f3e6d11e02 tempest-VolumesGetTestJSON-2098890165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:43:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-17451fe0-46a4-4116-a2d4-34622dc6497a req-02b1e4e7-8b16-49c6-ab73-b9f3e6d11e02 tempest-VolumesGetTestJSON-2098890165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:01 devstack sudo[83707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:43:01 devstack sudo[83707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:02 devstack sudo[83707]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-17451fe0-46a4-4116-a2d4-34622dc6497a req-02b1e4e7-8b16-49c6-ab73-b9f3e6d11e02 tempest-VolumesGetTestJSON-2098890165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.795s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:02 devstack cinder-volume[82760]: DEBUG cinder.manager [req-17451fe0-46a4-4116-a2d4-34622dc6497a req-02b1e4e7-8b16-49c6-ab73-b9f3e6d11e02 tempest-VolumesGetTestJSON-2098890165 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:43:02 devstack cinder-volume[82760]: INFO cinder.volume.manager [req-17451fe0-46a4-4116-a2d4-34622dc6497a req-02b1e4e7-8b16-49c6-ab73-b9f3e6d11e02 tempest-VolumesGetTestJSON-2098890165 None] Deleted volume successfully.
Apr 09 12:43:02 devstack cinder-volume[82760]: DEBUG cinder.coordination [req-17451fe0-46a4-4116-a2d4-34622dc6497a req-02b1e4e7-8b16-49c6-ab73-b9f3e6d11e02 tempest-VolumesGetTestJSON-2098890165 None] Lock "cinder-d3935c9b-2c9c-46a8-9d54-de7809579741-delete_volume" released by "delete_volume" :: held 2.603s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:43:02 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [req-5fa81082-7c9b-4184-aeca-71a8616ceda0 req-17aa915a-93a8-4d4d-95e4-5daeac19a6f4 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:43:02 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-5fa81082-7c9b-4184-aeca-71a8616ceda0 req-17aa915a-93a8-4d4d-95e4-5daeac19a6f4 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Flow 'volume_create_manager' (98200b04-5932-414a-bef4-d88be4a82a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:43:02 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-5fa81082-7c9b-4184-aeca-71a8616ceda0 req-17aa915a-93a8-4d4d-95e4-5daeac19a6f4 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98039002-4f31-4cb1-b490-4ad83bc0bb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:43:02 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-5fa81082-7c9b-4184-aeca-71a8616ceda0 req-17aa915a-93a8-4d4d-95e4-5daeac19a6f4 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98039002-4f31-4cb1-b490-4ad83bc0bb88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:43:02Z,deleted=False,deleted_at=None,display_description='',display_name='b3141a6c-c3b4-41d5-b572-fde687b8bca9-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1abe0eb1-6189-4ca3-a071-efbcb69e9053,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e15791107f854be98ddb925641896e75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:43:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:43:03Z,use_quota=True,user_id='9222dcc8f09740c8a8505ce9bf7d5888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:43:02 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-5fa81082-7c9b-4184-aeca-71a8616ceda0 req-17aa915a-93a8-4d4d-95e4-5daeac19a6f4 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c5da75e-7e08-47bc-8f34-a0c2b3a79bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:43:02 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-5fa81082-7c9b-4184-aeca-71a8616ceda0 req-17aa915a-93a8-4d4d-95e4-5daeac19a6f4 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c5da75e-7e08-47bc-8f34-a0c2b3a79bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:43:02 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-5fa81082-7c9b-4184-aeca-71a8616ceda0 req-17aa915a-93a8-4d4d-95e4-5daeac19a6f4 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cf5e9e4-4d32-468a-9dec-5e86fcd97f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:43:02 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-5fa81082-7c9b-4184-aeca-71a8616ceda0 req-17aa915a-93a8-4d4d-95e4-5daeac19a6f4 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cf5e9e4-4d32-468a-9dec-5e86fcd97f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1abe0eb1-6189-4ca3-a071-efbcb69e9053', 'volume_name': 'volume-1abe0eb1-6189-4ca3-a071-efbcb69e9053', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:43:02 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-5fa81082-7c9b-4184-aeca-71a8616ceda0 req-17aa915a-93a8-4d4d-95e4-5daeac19a6f4 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29247a6e-89d7-4352-b940-5f67977ef3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:43:02 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-5fa81082-7c9b-4184-aeca-71a8616ceda0 req-17aa915a-93a8-4d4d-95e4-5daeac19a6f4 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29247a6e-89d7-4352-b940-5f67977ef3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:43:02 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-5fa81082-7c9b-4184-aeca-71a8616ceda0 req-17aa915a-93a8-4d4d-95e4-5daeac19a6f4 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (157cd34d-344e-4bb1-b30c-a693640a38d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:43:02 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [req-5fa81082-7c9b-4184-aeca-71a8616ceda0 req-17aa915a-93a8-4d4d-95e4-5daeac19a6f4 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Volume 1abe0eb1-6189-4ca3-a071-efbcb69e9053: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1abe0eb1-6189-4ca3-a071-efbcb69e9053', 'volume_size': 1}
Apr 09 12:43:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [req-5fa81082-7c9b-4184-aeca-71a8616ceda0 req-17aa915a-93a8-4d4d-95e4-5daeac19a6f4 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:43:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [req-5fa81082-7c9b-4184-aeca-71a8616ceda0 req-17aa915a-93a8-4d4d-95e4-5daeac19a6f4 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:43:02 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [req-5fa81082-7c9b-4184-aeca-71a8616ceda0 req-17aa915a-93a8-4d4d-95e4-5daeac19a6f4 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:43:02Z,deleted=False,deleted_at=None,display_description='',display_name='b3141a6c-c3b4-41d5-b572-fde687b8bca9-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1abe0eb1-6189-4ca3-a071-efbcb69e9053,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e15791107f854be98ddb925641896e75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:43:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:43:03Z,use_quota=True,user_id='9222dcc8f09740c8a8505ce9bf7d5888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:43:02 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [req-5fa81082-7c9b-4184-aeca-71a8616ceda0 req-17aa915a-93a8-4d4d-95e4-5daeac19a6f4 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Creating volume 1abe0eb1-6189-4ca3-a071-efbcb69e9053 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:43:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [req-5fa81082-7c9b-4184-aeca-71a8616ceda0 req-17aa915a-93a8-4d4d-95e4-5daeac19a6f4 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:43:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [req-5fa81082-7c9b-4184-aeca-71a8616ceda0 req-17aa915a-93a8-4d4d-95e4-5daeac19a6f4 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:43:02 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [req-5fa81082-7c9b-4184-aeca-71a8616ceda0 req-17aa915a-93a8-4d4d-95e4-5daeac19a6f4 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:43:02 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [req-5fa81082-7c9b-4184-aeca-71a8616ceda0 req-17aa915a-93a8-4d4d-95e4-5daeac19a6f4 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:43:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [req-5fa81082-7c9b-4184-aeca-71a8616ceda0 req-17aa915a-93a8-4d4d-95e4-5daeac19a6f4 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:43:02 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [req-5fa81082-7c9b-4184-aeca-71a8616ceda0 req-17aa915a-93a8-4d4d-95e4-5daeac19a6f4 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:43:02 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [req-5fa81082-7c9b-4184-aeca-71a8616ceda0 req-17aa915a-93a8-4d4d-95e4-5daeac19a6f4 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:43:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-5fa81082-7c9b-4184-aeca-71a8616ceda0 req-17aa915a-93a8-4d4d-95e4-5daeac19a6f4 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1abe0eb1-6189-4ca3-a071-efbcb69e9053 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:02 devstack sudo[83717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1abe0eb1-6189-4ca3-a071-efbcb69e9053 1073741824
Apr 09 12:43:02 devstack sudo[83717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:03 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-dd50b9c2-f4df-4ab3-b65c-a14384cd8de2 tempest-VolumesTestJSON-809111195 None] Acquiring lock "cinder-d2dcf89f-0cb7-499b-ba88-bc7b800e8b65-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:43:03 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-dd50b9c2-f4df-4ab3-b65c-a14384cd8de2 tempest-VolumesTestJSON-809111195 None] Lock "cinder-d2dcf89f-0cb7-499b-ba88-bc7b800e8b65-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:43:03 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-dd50b9c2-f4df-4ab3-b65c-a14384cd8de2 tempest-VolumesTestJSON-809111195 None] Acquiring lock "cinder-quobyte-d2dcf89f-0cb7-499b-ba88-bc7b800e8b65" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:43:03 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-dd50b9c2-f4df-4ab3-b65c-a14384cd8de2 tempest-VolumesTestJSON-809111195 None] Lock "cinder-quobyte-d2dcf89f-0cb7-499b-ba88-bc7b800e8b65" acquired by "delete_volume" :: waited 0.023s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:43:03 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a52aed7-02a7-45d9-b70a-d2d51518416c]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:43:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-dd50b9c2-f4df-4ab3-b65c-a14384cd8de2 tempest-VolumesTestJSON-809111195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d2dcf89f-0cb7-499b-ba88-bc7b800e8b65 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:03 devstack sudo[83720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d2dcf89f-0cb7-499b-ba88-bc7b800e8b65
Apr 09 12:43:03 devstack sudo[83720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:04 devstack sudo[83717]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-5fa81082-7c9b-4184-aeca-71a8616ceda0 req-17aa915a-93a8-4d4d-95e4-5daeac19a6f4 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1abe0eb1-6189-4ca3-a071-efbcb69e9053 1073741824" returned: 0 in 1.104s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-5fa81082-7c9b-4184-aeca-71a8616ceda0 req-17aa915a-93a8-4d4d-95e4-5daeac19a6f4 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1abe0eb1-6189-4ca3-a071-efbcb69e9053 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:04 devstack sudo[83731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1abe0eb1-6189-4ca3-a071-efbcb69e9053
Apr 09 12:43:04 devstack sudo[83731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:04 devstack sudo[83720]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-dd50b9c2-f4df-4ab3-b65c-a14384cd8de2 tempest-VolumesTestJSON-809111195 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d2dcf89f-0cb7-499b-ba88-bc7b800e8b65" returned: 0 in 1.020s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-dd50b9c2-f4df-4ab3-b65c-a14384cd8de2 tempest-VolumesTestJSON-809111195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d2dcf89f-0cb7-499b-ba88-bc7b800e8b65 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:04 devstack sudo[83736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d2dcf89f-0cb7-499b-ba88-bc7b800e8b65
Apr 09 12:43:04 devstack sudo[83736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:04 devstack sudo[83731]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-5fa81082-7c9b-4184-aeca-71a8616ceda0 req-17aa915a-93a8-4d4d-95e4-5daeac19a6f4 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1abe0eb1-6189-4ca3-a071-efbcb69e9053" returned: 0 in 0.590s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:04 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [req-5fa81082-7c9b-4184-aeca-71a8616ceda0 req-17aa915a-93a8-4d4d-95e4-5daeac19a6f4 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] <== create_volume: return (1741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:43:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [req-5fa81082-7c9b-4184-aeca-71a8616ceda0 req-17aa915a-93a8-4d4d-95e4-5daeac19a6f4 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.744s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:43:04 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-5fa81082-7c9b-4184-aeca-71a8616ceda0 req-17aa915a-93a8-4d4d-95e4-5daeac19a6f4 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (157cd34d-344e-4bb1-b30c-a693640a38d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1abe0eb1-6189-4ca3-a071-efbcb69e9053', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:43:04 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-5fa81082-7c9b-4184-aeca-71a8616ceda0 req-17aa915a-93a8-4d4d-95e4-5daeac19a6f4 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dab9f598-4528-4852-98ad-f8a5866fbaaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:43:04 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [req-5fa81082-7c9b-4184-aeca-71a8616ceda0 req-17aa915a-93a8-4d4d-95e4-5daeac19a6f4 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Volume volume-1abe0eb1-6189-4ca3-a071-efbcb69e9053 (1abe0eb1-6189-4ca3-a071-efbcb69e9053): created successfully
Apr 09 12:43:04 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-5fa81082-7c9b-4184-aeca-71a8616ceda0 req-17aa915a-93a8-4d4d-95e4-5daeac19a6f4 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dab9f598-4528-4852-98ad-f8a5866fbaaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:43:04 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-5fa81082-7c9b-4184-aeca-71a8616ceda0 req-17aa915a-93a8-4d4d-95e4-5daeac19a6f4 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Flow 'volume_create_manager' (98200b04-5932-414a-bef4-d88be4a82a23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:43:04 devstack cinder-volume[82760]: INFO cinder.volume.manager [req-5fa81082-7c9b-4184-aeca-71a8616ceda0 req-17aa915a-93a8-4d4d-95e4-5daeac19a6f4 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Created volume successfully.
Apr 09 12:43:04 devstack sudo[83736]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-dd50b9c2-f4df-4ab3-b65c-a14384cd8de2 tempest-VolumesTestJSON-809111195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d2dcf89f-0cb7-499b-ba88-bc7b800e8b65" returned: 0 in 0.692s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:04 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-dd50b9c2-f4df-4ab3-b65c-a14384cd8de2 tempest-VolumesTestJSON-809111195 None] Lock "cinder-quobyte-d2dcf89f-0cb7-499b-ba88-bc7b800e8b65" released by "delete_volume" :: held 1.744s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:43:04 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-dd50b9c2-f4df-4ab3-b65c-a14384cd8de2 tempest-VolumesTestJSON-809111195 None] Created reservations ['0a2f6b30-dc95-4c18-9c27-335ee4df08c5', '6926ca01-5f67-4067-befb-de3e86e71938', 'fbda547d-c94a-4bd5-843d-80d08e4e777b', '8954b05e-1f81-42fc-a476-842b8437a777'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:43:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-dd50b9c2-f4df-4ab3-b65c-a14384cd8de2 tempest-VolumesTestJSON-809111195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:43:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-dd50b9c2-f4df-4ab3-b65c-a14384cd8de2 tempest-VolumesTestJSON-809111195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:43:04 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-dd50b9c2-f4df-4ab3-b65c-a14384cd8de2 tempest-VolumesTestJSON-809111195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:43:05 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-dd50b9c2-f4df-4ab3-b65c-a14384cd8de2 tempest-VolumesTestJSON-809111195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:43:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-dd50b9c2-f4df-4ab3-b65c-a14384cd8de2 tempest-VolumesTestJSON-809111195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:43:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-dd50b9c2-f4df-4ab3-b65c-a14384cd8de2 tempest-VolumesTestJSON-809111195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:05 devstack sudo[83740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:43:05 devstack sudo[83740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:05 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-63a56928-f320-48f9-a095-a242c5da8912 tempest-VolumesTestJSON-809111195 None] Acquiring lock "cinder-d2a168b2-0f92-4e54-9c01-8e6309a0db60-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:43:05 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-63a56928-f320-48f9-a095-a242c5da8912 tempest-VolumesTestJSON-809111195 None] Lock "cinder-d2a168b2-0f92-4e54-9c01-8e6309a0db60-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:43:05 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-63a56928-f320-48f9-a095-a242c5da8912 tempest-VolumesTestJSON-809111195 None] Acquiring lock "cinder-quobyte-d2a168b2-0f92-4e54-9c01-8e6309a0db60" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:43:05 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-63a56928-f320-48f9-a095-a242c5da8912 tempest-VolumesTestJSON-809111195 None] Lock "cinder-quobyte-d2a168b2-0f92-4e54-9c01-8e6309a0db60" acquired by "delete_volume" :: waited 0.014s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:43:05 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[953cd2ae-6a55-4d25-b2c6-0da4a09994c2]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:43:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-63a56928-f320-48f9-a095-a242c5da8912 tempest-VolumesTestJSON-809111195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d2a168b2-0f92-4e54-9c01-8e6309a0db60 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:05 devstack sudo[83742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d2a168b2-0f92-4e54-9c01-8e6309a0db60
Apr 09 12:43:05 devstack sudo[83742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:05 devstack sudo[83740]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-dd50b9c2-f4df-4ab3-b65c-a14384cd8de2 tempest-VolumesTestJSON-809111195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.674s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:05 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-dd50b9c2-f4df-4ab3-b65c-a14384cd8de2 tempest-VolumesTestJSON-809111195 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:43:05 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-dd50b9c2-f4df-4ab3-b65c-a14384cd8de2 tempest-VolumesTestJSON-809111195 None] Deleted volume successfully.
Apr 09 12:43:05 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-dd50b9c2-f4df-4ab3-b65c-a14384cd8de2 tempest-VolumesTestJSON-809111195 None] Lock "cinder-d2dcf89f-0cb7-499b-ba88-bc7b800e8b65-delete_volume" released by "delete_volume" :: held 2.609s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:43:06 devstack sudo[83742]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:06 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-63a56928-f320-48f9-a095-a242c5da8912 tempest-VolumesTestJSON-809111195 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d2a168b2-0f92-4e54-9c01-8e6309a0db60" returned: 0 in 0.722s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:06 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-63a56928-f320-48f9-a095-a242c5da8912 tempest-VolumesTestJSON-809111195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d2a168b2-0f92-4e54-9c01-8e6309a0db60 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:06 devstack sudo[83752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d2a168b2-0f92-4e54-9c01-8e6309a0db60
Apr 09 12:43:06 devstack sudo[83752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:06 devstack sudo[83752]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:06 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-63a56928-f320-48f9-a095-a242c5da8912 tempest-VolumesTestJSON-809111195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d2a168b2-0f92-4e54-9c01-8e6309a0db60" returned: 0 in 0.676s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:06 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-63a56928-f320-48f9-a095-a242c5da8912 tempest-VolumesTestJSON-809111195 None] Lock "cinder-quobyte-d2a168b2-0f92-4e54-9c01-8e6309a0db60" released by "delete_volume" :: held 1.444s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:43:06 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-2640326e-684c-4125-8419-65ba701c707b tempest-GroupSnapshotsTest-799393923 None] Group tempest-GroupSnapshotsTest-Group-2091072949: creating
Apr 09 12:43:07 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-2640326e-684c-4125-8419-65ba701c707b tempest-GroupSnapshotsTest-799393923 None] Group tempest-GroupSnapshotsTest-Group-2091072949: created successfully
Apr 09 12:43:07 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-63a56928-f320-48f9-a095-a242c5da8912 tempest-VolumesTestJSON-809111195 None] Created reservations ['8d952cd9-5154-418d-be31-6b1620ea487f', 'e043cc49-eb97-4a80-81cf-eab7b5f6b51f', 'a3d72749-43cf-48fd-9dea-68b437d1424f', '546f3da4-49e5-4d7c-bb7a-d6f94b89d394'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:43:07 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-2640326e-684c-4125-8419-65ba701c707b tempest-GroupSnapshotsTest-799393923 None] Create group completed successfully.
Apr 09 12:43:07 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-63a56928-f320-48f9-a095-a242c5da8912 tempest-VolumesTestJSON-809111195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:43:07 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-63a56928-f320-48f9-a095-a242c5da8912 tempest-VolumesTestJSON-809111195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:43:07 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-63a56928-f320-48f9-a095-a242c5da8912 tempest-VolumesTestJSON-809111195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:43:07 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-63a56928-f320-48f9-a095-a242c5da8912 tempest-VolumesTestJSON-809111195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:43:07 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-63a56928-f320-48f9-a095-a242c5da8912 tempest-VolumesTestJSON-809111195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:43:07 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-63a56928-f320-48f9-a095-a242c5da8912 tempest-VolumesTestJSON-809111195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:07 devstack sudo[83763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:43:07 devstack sudo[83763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:07 devstack sudo[83763]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:07 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-63a56928-f320-48f9-a095-a242c5da8912 tempest-VolumesTestJSON-809111195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.497s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:07 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-63a56928-f320-48f9-a095-a242c5da8912 tempest-VolumesTestJSON-809111195 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:43:07 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-63a56928-f320-48f9-a095-a242c5da8912 tempest-VolumesTestJSON-809111195 None] Deleted volume successfully.
Apr 09 12:43:07 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-63a56928-f320-48f9-a095-a242c5da8912 tempest-VolumesTestJSON-809111195 None] Lock "cinder-d2a168b2-0f92-4e54-9c01-8e6309a0db60-delete_volume" released by "delete_volume" :: held 2.238s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:43:07 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-25c22249-1a6a-451c-9602-320775a9fa01 tempest-VolumesTestJSON-809111195 None] Acquiring lock "cinder-d3feab65-363e-46ef-a8b7-3c1704838bc9-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:43:07 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-25c22249-1a6a-451c-9602-320775a9fa01 tempest-VolumesTestJSON-809111195 None] Lock "cinder-d3feab65-363e-46ef-a8b7-3c1704838bc9-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:43:07 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-25c22249-1a6a-451c-9602-320775a9fa01 tempest-VolumesTestJSON-809111195 None] Acquiring lock "cinder-quobyte-d3feab65-363e-46ef-a8b7-3c1704838bc9" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:43:07 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-25c22249-1a6a-451c-9602-320775a9fa01 tempest-VolumesTestJSON-809111195 None] Lock "cinder-quobyte-d3feab65-363e-46ef-a8b7-3c1704838bc9" acquired by "delete_volume" :: waited 0.009s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:43:07 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[89fc1b94-7408-4251-8198-d4bf836a8bbd]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:43:07 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-25c22249-1a6a-451c-9602-320775a9fa01 tempest-VolumesTestJSON-809111195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d3feab65-363e-46ef-a8b7-3c1704838bc9 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:07 devstack sudo[83769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d3feab65-363e-46ef-a8b7-3c1704838bc9
Apr 09 12:43:07 devstack sudo[83769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:08 devstack cinder-volume[82760]: WARNING py.warnings [req-5fa81082-7c9b-4184-aeca-71a8616ceda0 req-af414f39-22e4-4267-bb4b-4ad0279d932d tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment".  Apply join condition(s) between each element to resolve.
Apr 09 12:43:08 devstack cinder-volume[82760]:   .first()
Apr 09 12:43:08 devstack cinder-volume[82760]: 
Apr 09 12:43:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [req-5fa81082-7c9b-4184-aeca-71a8616ceda0 req-af414f39-22e4-4267-bb4b-4ad0279d932d tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:43:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [req-5fa81082-7c9b-4184-aeca-71a8616ceda0 req-af414f39-22e4-4267-bb4b-4ad0279d932d tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:43:08 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[acfebba8-e2e1-413c-bed4-d047b87d685f]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:43:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-5fa81082-7c9b-4184-aeca-71a8616ceda0 req-af414f39-22e4-4267-bb4b-4ad0279d932d tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1abe0eb1-6189-4ca3-a071-efbcb69e9053 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:08 devstack sudo[83794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1abe0eb1-6189-4ca3-a071-efbcb69e9053
Apr 09 12:43:08 devstack sudo[83794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:08 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3aeb1e1-f475-474c-bdeb-47e1b6d47f8a tempest-GroupSnapshotsTest-799393923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:43:08 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d3aeb1e1-f475-474c-bdeb-47e1b6d47f8a tempest-GroupSnapshotsTest-799393923 None] Flow 'volume_create_manager' (32ba0ca7-1bd6-4ca6-967b-8a85ade8e57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:43:08 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d3aeb1e1-f475-474c-bdeb-47e1b6d47f8a tempest-GroupSnapshotsTest-799393923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac52558c-e430-41ed-bdc2-3ff7133741c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:43:08 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d3aeb1e1-f475-474c-bdeb-47e1b6d47f8a tempest-GroupSnapshotsTest-799393923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac52558c-e430-41ed-bdc2-3ff7133741c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1805488802',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7ebfcf15-d8f6-4dc3-b4a6-bbdb3211371d,host='devstack@QuobyteHD#QuobyteHD',id=0cc5d573-0920-41db-a9d0-cdb1ae517bea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83e45adb00064a50a6989c331c3a5d5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:43:08Z,use_quota=True,user_id='1b822ed89860427ab9cc8837876445e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1914d070-a15e-496f-b042-206775ee123f),volume_type_id=1914d070-a15e-496f-b042-206775ee123f)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:43:08 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d3aeb1e1-f475-474c-bdeb-47e1b6d47f8a tempest-GroupSnapshotsTest-799393923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4479aec-2e55-466f-b09a-b123631a7766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:43:08 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d3aeb1e1-f475-474c-bdeb-47e1b6d47f8a tempest-GroupSnapshotsTest-799393923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4479aec-2e55-466f-b09a-b123631a7766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:43:08 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d3aeb1e1-f475-474c-bdeb-47e1b6d47f8a tempest-GroupSnapshotsTest-799393923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cc9affc-9949-445e-89a8-60cb0f0eab86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:43:08 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d3aeb1e1-f475-474c-bdeb-47e1b6d47f8a tempest-GroupSnapshotsTest-799393923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cc9affc-9949-445e-89a8-60cb0f0eab86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cc5d573-0920-41db-a9d0-cdb1ae517bea', 'volume_name': 'volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:43:08 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d3aeb1e1-f475-474c-bdeb-47e1b6d47f8a tempest-GroupSnapshotsTest-799393923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46b47325-adc3-4eb8-9c7d-e3b119ce5a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:43:08 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d3aeb1e1-f475-474c-bdeb-47e1b6d47f8a tempest-GroupSnapshotsTest-799393923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46b47325-adc3-4eb8-9c7d-e3b119ce5a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:43:08 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d3aeb1e1-f475-474c-bdeb-47e1b6d47f8a tempest-GroupSnapshotsTest-799393923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d971b7c1-299d-4817-8d13-5ef57f27ff15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:43:08 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-d3aeb1e1-f475-474c-bdeb-47e1b6d47f8a tempest-GroupSnapshotsTest-799393923 None] Volume 0cc5d573-0920-41db-a9d0-cdb1ae517bea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea', 'volume_size': 1}
Apr 09 12:43:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d3aeb1e1-f475-474c-bdeb-47e1b6d47f8a tempest-GroupSnapshotsTest-799393923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:43:08 devstack sudo[83769]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-25c22249-1a6a-451c-9602-320775a9fa01 tempest-VolumesTestJSON-809111195 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d3feab65-363e-46ef-a8b7-3c1704838bc9" returned: 0 in 0.763s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-25c22249-1a6a-451c-9602-320775a9fa01 tempest-VolumesTestJSON-809111195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d3feab65-363e-46ef-a8b7-3c1704838bc9 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:08 devstack sudo[83799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d3feab65-363e-46ef-a8b7-3c1704838bc9
Apr 09 12:43:08 devstack sudo[83799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:08 devstack sudo[83794]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-5fa81082-7c9b-4184-aeca-71a8616ceda0 req-af414f39-22e4-4267-bb4b-4ad0279d932d tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1abe0eb1-6189-4ca3-a071-efbcb69e9053" returned: 0 in 0.631s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [req-5fa81082-7c9b-4184-aeca-71a8616ceda0 req-af414f39-22e4-4267-bb4b-4ad0279d932d tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.643s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:43:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d3aeb1e1-f475-474c-bdeb-47e1b6d47f8a tempest-GroupSnapshotsTest-799393923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.290s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:43:08 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-d3aeb1e1-f475-474c-bdeb-47e1b6d47f8a tempest-GroupSnapshotsTest-799393923 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=7ebfcf15-d8f6-4dc3-b4a6-bbdb3211371d,created_at=2026-04-09T10:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1805488802',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7ebfcf15-d8f6-4dc3-b4a6-bbdb3211371d,host='devstack@QuobyteHD#QuobyteHD',id=0cc5d573-0920-41db-a9d0-cdb1ae517bea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83e45adb00064a50a6989c331c3a5d5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:43:08Z,use_quota=True,user_id='1b822ed89860427ab9cc8837876445e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1914d070-a15e-496f-b042-206775ee123f),volume_type_id=1914d070-a15e-496f-b042-206775ee123f)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:43:08 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-d3aeb1e1-f475-474c-bdeb-47e1b6d47f8a tempest-GroupSnapshotsTest-799393923 None] Creating volume 0cc5d573-0920-41db-a9d0-cdb1ae517bea {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:43:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d3aeb1e1-f475-474c-bdeb-47e1b6d47f8a tempest-GroupSnapshotsTest-799393923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:43:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d3aeb1e1-f475-474c-bdeb-47e1b6d47f8a tempest-GroupSnapshotsTest-799393923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:43:08 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-d3aeb1e1-f475-474c-bdeb-47e1b6d47f8a tempest-GroupSnapshotsTest-799393923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:43:08 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-d3aeb1e1-f475-474c-bdeb-47e1b6d47f8a tempest-GroupSnapshotsTest-799393923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:43:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d3aeb1e1-f475-474c-bdeb-47e1b6d47f8a tempest-GroupSnapshotsTest-799393923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:43:08 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-d3aeb1e1-f475-474c-bdeb-47e1b6d47f8a tempest-GroupSnapshotsTest-799393923 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:43:08 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-d3aeb1e1-f475-474c-bdeb-47e1b6d47f8a tempest-GroupSnapshotsTest-799393923 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:43:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d3aeb1e1-f475-474c-bdeb-47e1b6d47f8a tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:08 devstack sudo[83805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea 1073741824
Apr 09 12:43:08 devstack sudo[83805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:08 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-5fa81082-7c9b-4184-aeca-71a8616ceda0 req-af414f39-22e4-4267-bb4b-4ad0279d932d tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5', 'name': 'volume-1abe0eb1-6189-4ca3-a071-efbcb69e9053', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '277b0064-2dc8-4f95-9cdd-75f5353a876d', 'enforce_multipath': True} {{(pid=82760) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 09 12:43:09 devstack cinder-volume[82760]: INFO cinder.volume.manager [req-5fa81082-7c9b-4184-aeca-71a8616ceda0 req-af414f39-22e4-4267-bb4b-4ad0279d932d tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] attachment_update completed successfully.
Apr 09 12:43:09 devstack sudo[83799]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-25c22249-1a6a-451c-9602-320775a9fa01 tempest-VolumesTestJSON-809111195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d3feab65-363e-46ef-a8b7-3c1704838bc9" returned: 0 in 0.607s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:09 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-25c22249-1a6a-451c-9602-320775a9fa01 tempest-VolumesTestJSON-809111195 None] Lock "cinder-quobyte-d3feab65-363e-46ef-a8b7-3c1704838bc9" released by "delete_volume" :: held 1.412s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:43:09 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-25c22249-1a6a-451c-9602-320775a9fa01 tempest-VolumesTestJSON-809111195 None] Created reservations ['c3522aed-f110-49c4-96d3-27e455939c27', 'ab0edecc-3fc6-4fa1-be62-36b8f4322867', '424e4a9b-5047-4181-8630-c66ecdab9468', 'a00c7743-3ce5-4e48-8c00-0a64dabbd7b4'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:43:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-25c22249-1a6a-451c-9602-320775a9fa01 tempest-VolumesTestJSON-809111195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:43:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-25c22249-1a6a-451c-9602-320775a9fa01 tempest-VolumesTestJSON-809111195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:43:09 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-25c22249-1a6a-451c-9602-320775a9fa01 tempest-VolumesTestJSON-809111195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:43:09 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-25c22249-1a6a-451c-9602-320775a9fa01 tempest-VolumesTestJSON-809111195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:43:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-25c22249-1a6a-451c-9602-320775a9fa01 tempest-VolumesTestJSON-809111195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:43:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-25c22249-1a6a-451c-9602-320775a9fa01 tempest-VolumesTestJSON-809111195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:09 devstack sudo[83809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:43:09 devstack sudo[83809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:09 devstack cinder-volume[82760]: DEBUG oslo_service.periodic_task [None req-f8337202-8290-4658-916e-19cfa929172e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82760) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 09 12:43:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f8337202-8290-4658-916e-19cfa929172e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:43:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f8337202-8290-4658-916e-19cfa929172e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:43:09 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f8337202-8290-4658-916e-19cfa929172e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:43:09 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f8337202-8290-4658-916e-19cfa929172e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:43:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f8337202-8290-4658-916e-19cfa929172e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:43:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f8337202-8290-4658-916e-19cfa929172e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:09 devstack sudo[83813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:43:09 devstack sudo[83813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:09 devstack sudo[83805]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d3aeb1e1-f475-474c-bdeb-47e1b6d47f8a tempest-GroupSnapshotsTest-799393923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea 1073741824" returned: 0 in 0.725s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d3aeb1e1-f475-474c-bdeb-47e1b6d47f8a tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:09 devstack sudo[83815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea
Apr 09 12:43:09 devstack sudo[83815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:09 devstack sudo[83809]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-25c22249-1a6a-451c-9602-320775a9fa01 tempest-VolumesTestJSON-809111195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.590s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:09 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-25c22249-1a6a-451c-9602-320775a9fa01 tempest-VolumesTestJSON-809111195 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:43:09 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-25c22249-1a6a-451c-9602-320775a9fa01 tempest-VolumesTestJSON-809111195 None] Deleted volume successfully.
Apr 09 12:43:09 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-25c22249-1a6a-451c-9602-320775a9fa01 tempest-VolumesTestJSON-809111195 None] Lock "cinder-d3feab65-363e-46ef-a8b7-3c1704838bc9-delete_volume" released by "delete_volume" :: held 2.209s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:43:10 devstack sudo[83813]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f8337202-8290-4658-916e-19cfa929172e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.851s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:10 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-f8337202-8290-4658-916e-19cfa929172e None None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:43:10 devstack sudo[83815]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d3aeb1e1-f475-474c-bdeb-47e1b6d47f8a tempest-GroupSnapshotsTest-799393923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea" returned: 0 in 0.803s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:10 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-d3aeb1e1-f475-474c-bdeb-47e1b6d47f8a tempest-GroupSnapshotsTest-799393923 None] <== create_volume: return (1573ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:43:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d3aeb1e1-f475-474c-bdeb-47e1b6d47f8a tempest-GroupSnapshotsTest-799393923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:43:10 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d3aeb1e1-f475-474c-bdeb-47e1b6d47f8a tempest-GroupSnapshotsTest-799393923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d971b7c1-299d-4817-8d13-5ef57f27ff15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:43:10 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d3aeb1e1-f475-474c-bdeb-47e1b6d47f8a tempest-GroupSnapshotsTest-799393923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5183c855-c445-4016-b828-6045003add00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:43:10 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-d3aeb1e1-f475-474c-bdeb-47e1b6d47f8a tempest-GroupSnapshotsTest-799393923 None] Volume volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea (0cc5d573-0920-41db-a9d0-cdb1ae517bea): created successfully
Apr 09 12:43:10 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d3aeb1e1-f475-474c-bdeb-47e1b6d47f8a tempest-GroupSnapshotsTest-799393923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5183c855-c445-4016-b828-6045003add00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:43:10 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d3aeb1e1-f475-474c-bdeb-47e1b6d47f8a tempest-GroupSnapshotsTest-799393923 None] Flow 'volume_create_manager' (32ba0ca7-1bd6-4ca6-967b-8a85ade8e57e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:43:10 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-d3aeb1e1-f475-474c-bdeb-47e1b6d47f8a tempest-GroupSnapshotsTest-799393923 None] Created volume successfully.
Apr 09 12:43:11 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-12fa9d01-50ba-440e-829b-0a436eccdaeb tempest-GroupSnapshotsTest-799393923 None] GroupSnapshot 6716c4a1-7ed4-4235-80f7-18f84cbadfd1: creating.
Apr 09 12:43:11 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-12fa9d01-50ba-440e-829b-0a436eccdaeb tempest-GroupSnapshotsTest-799393923 None] Group snapshot 6716c4a1-7ed4-4235-80f7-18f84cbadfd1: creating. {{(pid=82760) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 09 12:43:11 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-12fa9d01-50ba-440e-829b-0a436eccdaeb tempest-GroupSnapshotsTest-799393923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:43:11 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-12fa9d01-50ba-440e-829b-0a436eccdaeb tempest-GroupSnapshotsTest-799393923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:43:11 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-12fa9d01-50ba-440e-829b-0a436eccdaeb tempest-GroupSnapshotsTest-799393923 None] Creating offline snapshot 824dcb35-ba8c-4001-9b49-dc594d358aa6 of volume 0cc5d573-0920-41db-a9d0-cdb1ae517bea {{(pid=82760) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 12:43:11 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45ba1ac-c43d-4d3f-ac2d-dcc1f3c5d4b7]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:43:11 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-12fa9d01-50ba-440e-829b-0a436eccdaeb tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:11 devstack sudo[83821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea
Apr 09 12:43:11 devstack sudo[83821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:11 devstack sudo[83821]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:11 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-12fa9d01-50ba-440e-829b-0a436eccdaeb tempest-GroupSnapshotsTest-799393923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea" returned: 0 in 0.745s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:11 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-12fa9d01-50ba-440e-829b-0a436eccdaeb tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea.824dcb35-ba8c-4001-9b49-dc594d358aa6 1G {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:11 devstack sudo[83895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea.824dcb35-ba8c-4001-9b49-dc594d358aa6 1G
Apr 09 12:43:11 devstack sudo[83895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:12 devstack sudo[83895]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:12 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-12fa9d01-50ba-440e-829b-0a436eccdaeb tempest-GroupSnapshotsTest-799393923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea.824dcb35-ba8c-4001-9b49-dc594d358aa6 1G" returned: 0 in 0.901s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:12 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-12fa9d01-50ba-440e-829b-0a436eccdaeb tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea.824dcb35-ba8c-4001-9b49-dc594d358aa6 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:12 devstack sudo[83904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea.824dcb35-ba8c-4001-9b49-dc594d358aa6
Apr 09 12:43:12 devstack sudo[83904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:13 devstack sudo[83904]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:13 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-12fa9d01-50ba-440e-829b-0a436eccdaeb tempest-GroupSnapshotsTest-799393923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea.824dcb35-ba8c-4001-9b49-dc594d358aa6" returned: 0 in 0.555s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:13 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-12fa9d01-50ba-440e-829b-0a436eccdaeb tempest-GroupSnapshotsTest-799393923 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea.824dcb35-ba8c-4001-9b49-dc594d358aa6 is being set with open permissions: ugo+rw: NotImplementedError
Apr 09 12:43:13 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-12fa9d01-50ba-440e-829b-0a436eccdaeb tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea.824dcb35-ba8c-4001-9b49-dc594d358aa6 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:13 devstack sudo[83910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea.824dcb35-ba8c-4001-9b49-dc594d358aa6
Apr 09 12:43:13 devstack sudo[83910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:13 devstack sudo[83910]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:13 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-12fa9d01-50ba-440e-829b-0a436eccdaeb tempest-GroupSnapshotsTest-799393923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea.824dcb35-ba8c-4001-9b49-dc594d358aa6" returned: 0 in 0.490s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:13 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-12fa9d01-50ba-440e-829b-0a436eccdaeb tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:13 devstack sudo[83914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea.info
Apr 09 12:43:13 devstack sudo[83914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:14 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-0b2a536a-eb3c-4643-ba8b-01784ddd9ca8 tempest-BackendsCapabilitiesAdminTestsJSON-1787126166 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579765319824, 'free_capacity_gb': 1775.7579765319824, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82760) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 09 12:43:14 devstack sudo[83914]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-12fa9d01-50ba-440e-829b-0a436eccdaeb tempest-GroupSnapshotsTest-799393923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea.info" returned: 0 in 0.702s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:14 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-12fa9d01-50ba-440e-829b-0a436eccdaeb tempest-GroupSnapshotsTest-799393923 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 09 12:43:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-12fa9d01-50ba-440e-829b-0a436eccdaeb tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:14 devstack sudo[84256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea.info
Apr 09 12:43:14 devstack sudo[84256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:14 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-e756312e-cf7f-4254-882b-1300bccb945e tempest-BackendsCapabilitiesAdminTestsJSON-1787126166 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579765319824, 'free_capacity_gb': 1775.7579765319824, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82760) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 09 12:43:15 devstack sudo[84256]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:15 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-12fa9d01-50ba-440e-829b-0a436eccdaeb tempest-GroupSnapshotsTest-799393923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea.info" returned: 0 in 0.664s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:15 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-12fa9d01-50ba-440e-829b-0a436eccdaeb tempest-GroupSnapshotsTest-799393923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.134s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:43:15 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-12fa9d01-50ba-440e-829b-0a436eccdaeb tempest-GroupSnapshotsTest-799393923 None] group_snapshot 6716c4a1-7ed4-4235-80f7-18f84cbadfd1: created successfully
Apr 09 12:43:17 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-7535eb33-d617-4b18-ad51-64bb2916cf1b tempest-GroupSnapshotsTest-799393923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:43:17 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-7535eb33-d617-4b18-ad51-64bb2916cf1b tempest-GroupSnapshotsTest-799393923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:43:17 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-7535eb33-d617-4b18-ad51-64bb2916cf1b tempest-GroupSnapshotsTest-799393923 None] Acquiring lock "cinder-quobyte-824dcb35-ba8c-4001-9b49-dc594d358aa6-28fea479-1a6e-4e9d-aa45-83f86cb3a56a" by "_create_volume_from_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:43:17 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-7535eb33-d617-4b18-ad51-64bb2916cf1b tempest-GroupSnapshotsTest-799393923 None] Lock "cinder-quobyte-824dcb35-ba8c-4001-9b49-dc594d358aa6-28fea479-1a6e-4e9d-aa45-83f86cb3a56a" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:43:17 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-7535eb33-d617-4b18-ad51-64bb2916cf1b tempest-GroupSnapshotsTest-799393923 None] Creating volume 28fea479-1a6e-4e9d-aa45-83f86cb3a56a from snapshot 824dcb35-ba8c-4001-9b49-dc594d358aa6 {{(pid=82760) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 09 12:43:17 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-7535eb33-d617-4b18-ad51-64bb2916cf1b tempest-GroupSnapshotsTest-799393923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:43:17 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-7535eb33-d617-4b18-ad51-64bb2916cf1b tempest-GroupSnapshotsTest-799393923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:43:17 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-7535eb33-d617-4b18-ad51-64bb2916cf1b tempest-GroupSnapshotsTest-799393923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:43:17 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-7535eb33-d617-4b18-ad51-64bb2916cf1b tempest-GroupSnapshotsTest-799393923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:43:17 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-7535eb33-d617-4b18-ad51-64bb2916cf1b tempest-GroupSnapshotsTest-799393923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:43:17 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-7535eb33-d617-4b18-ad51-64bb2916cf1b tempest-GroupSnapshotsTest-799393923 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:43:17 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-7535eb33-d617-4b18-ad51-64bb2916cf1b tempest-GroupSnapshotsTest-799393923 None] Acquiring lock "cinder-quobyte-28fea479-1a6e-4e9d-aa45-83f86cb3a56a" by "_copy_volume_from_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:43:17 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-7535eb33-d617-4b18-ad51-64bb2916cf1b tempest-GroupSnapshotsTest-799393923 None] Lock "cinder-quobyte-28fea479-1a6e-4e9d-aa45-83f86cb3a56a" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:43:17 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-7535eb33-d617-4b18-ad51-64bb2916cf1b tempest-GroupSnapshotsTest-799393923 None] snapshot: 824dcb35-ba8c-4001-9b49-dc594d358aa6, volume: 28fea479-1a6e-4e9d-aa45-83f86cb3a56a,  {{(pid=82760) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 09 12:43:17 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-7535eb33-d617-4b18-ad51-64bb2916cf1b tempest-GroupSnapshotsTest-799393923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:43:17 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-7535eb33-d617-4b18-ad51-64bb2916cf1b tempest-GroupSnapshotsTest-799393923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:43:17 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-7535eb33-d617-4b18-ad51-64bb2916cf1b tempest-GroupSnapshotsTest-799393923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:43:17 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-7535eb33-d617-4b18-ad51-64bb2916cf1b tempest-GroupSnapshotsTest-799393923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:43:17 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-7535eb33-d617-4b18-ad51-64bb2916cf1b tempest-GroupSnapshotsTest-799393923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:43:17 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc77830-7656-4647-9159-fff0d3fcb832]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:43:17 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-7535eb33-d617-4b18-ad51-64bb2916cf1b tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea.824dcb35-ba8c-4001-9b49-dc594d358aa6 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:18 devstack sudo[84265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea.824dcb35-ba8c-4001-9b49-dc594d358aa6
Apr 09 12:43:18 devstack sudo[84265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:18 devstack sudo[84265]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-7535eb33-d617-4b18-ad51-64bb2916cf1b tempest-GroupSnapshotsTest-799393923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea.824dcb35-ba8c-4001-9b49-dc594d358aa6" returned: 0 in 0.726s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:18 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-7535eb33-d617-4b18-ad51-64bb2916cf1b tempest-GroupSnapshotsTest-799393923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:43:18 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-7535eb33-d617-4b18-ad51-64bb2916cf1b tempest-GroupSnapshotsTest-799393923 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea {{(pid=82760) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 09 12:43:18 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-7535eb33-d617-4b18-ad51-64bb2916cf1b tempest-GroupSnapshotsTest-799393923 None] Creating direct copy from snapshot {{(pid=82760) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 09 12:43:18 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c4fa79-74a2-4806-b521-215e21580dbe]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:43:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-7535eb33-d617-4b18-ad51-64bb2916cf1b tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:18 devstack sudo[84271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea
Apr 09 12:43:18 devstack sudo[84271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:19 devstack sudo[84271]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-7535eb33-d617-4b18-ad51-64bb2916cf1b tempest-GroupSnapshotsTest-799393923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea" returned: 0 in 0.546s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:19 devstack cinder-volume[82760]: DEBUG cinder.utils [None req-7535eb33-d617-4b18-ad51-64bb2916cf1b tempest-GroupSnapshotsTest-799393923 None] Path /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-28fea479-1a6e-4e9d-aa45-83f86cb3a56a not found in is_blk_device check {{(pid=82760) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 09 12:43:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-7535eb33-d617-4b18-ad51-64bb2916cf1b tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-28fea479-1a6e-4e9d-aa45-83f86cb3a56a {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:19 devstack sudo[84276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-28fea479-1a6e-4e9d-aa45-83f86cb3a56a
Apr 09 12:43:19 devstack sudo[84276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:22 devstack sudo[84276]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:22 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-7535eb33-d617-4b18-ad51-64bb2916cf1b tempest-GroupSnapshotsTest-799393923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-28fea479-1a6e-4e9d-aa45-83f86cb3a56a" returned: 0 in 3.456s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:22 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e9b3f1-5ec6-4136-a60d-e55ae6adbe06]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:43:22 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-7535eb33-d617-4b18-ad51-64bb2916cf1b tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:22 devstack sudo[84327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea
Apr 09 12:43:22 devstack sudo[84327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:23 devstack sudo[84327]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-7535eb33-d617-4b18-ad51-64bb2916cf1b tempest-GroupSnapshotsTest-799393923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea" returned: 0 in 0.958s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:23 devstack cinder-volume[82760]: DEBUG cinder.image.image_utils [None req-7535eb33-d617-4b18-ad51-64bb2916cf1b tempest-GroupSnapshotsTest-799393923 None] Image conversion details: src /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea, size 1024.00 MB, duration 3.46 sec, destination /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-28fea479-1a6e-4e9d-aa45-83f86cb3a56a {{(pid=82760) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 12:43:23 devstack cinder-volume[82760]: INFO cinder.image.image_utils [None req-7535eb33-d617-4b18-ad51-64bb2916cf1b tempest-GroupSnapshotsTest-799393923 None] Converted 1024.00 MB image at 296.22 MB/s
Apr 09 12:43:23 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-7535eb33-d617-4b18-ad51-64bb2916cf1b tempest-GroupSnapshotsTest-799393923 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-28fea479-1a6e-4e9d-aa45-83f86cb3a56a is being set with open permissions: ugo+rw: NotImplementedError
Apr 09 12:43:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-7535eb33-d617-4b18-ad51-64bb2916cf1b tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-28fea479-1a6e-4e9d-aa45-83f86cb3a56a {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:23 devstack sudo[84339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-28fea479-1a6e-4e9d-aa45-83f86cb3a56a
Apr 09 12:43:23 devstack sudo[84339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:24 devstack sudo[84339]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-7535eb33-d617-4b18-ad51-64bb2916cf1b tempest-GroupSnapshotsTest-799393923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-28fea479-1a6e-4e9d-aa45-83f86cb3a56a" returned: 0 in 0.585s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:24 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-7535eb33-d617-4b18-ad51-64bb2916cf1b tempest-GroupSnapshotsTest-799393923 None] Lock "cinder-quobyte-28fea479-1a6e-4e9d-aa45-83f86cb3a56a" released by "_copy_volume_from_snapshot" :: held 6.370s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:43:24 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-7535eb33-d617-4b18-ad51-64bb2916cf1b tempest-GroupSnapshotsTest-799393923 None] Lock "cinder-quobyte-824dcb35-ba8c-4001-9b49-dc594d358aa6-28fea479-1a6e-4e9d-aa45-83f86cb3a56a" released by "_create_volume_from_snapshot" :: held 6.392s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:43:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-7535eb33-d617-4b18-ad51-64bb2916cf1b tempest-GroupSnapshotsTest-799393923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.420s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:43:24 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-7535eb33-d617-4b18-ad51-64bb2916cf1b tempest-GroupSnapshotsTest-799393923 None] Create group from source-snapshot-6716c4a1-7ed4-4235-80f7-18f84cbadfd1 completed successfully.
Apr 09 12:43:25 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-04722059-d6f8-40fb-a334-2519697a8065 tempest-GroupSnapshotsTest-799393923 None] Acquiring lock "cinder-quobyte-28fea479-1a6e-4e9d-aa45-83f86cb3a56a" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:43:25 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-04722059-d6f8-40fb-a334-2519697a8065 tempest-GroupSnapshotsTest-799393923 None] Lock "cinder-quobyte-28fea479-1a6e-4e9d-aa45-83f86cb3a56a" acquired by "delete_volume" :: waited 0.006s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:43:25 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fecb7a8-a334-4a9c-a19c-1d7d5bd45b0c]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:43:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-04722059-d6f8-40fb-a334-2519697a8065 tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-28fea479-1a6e-4e9d-aa45-83f86cb3a56a {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:25 devstack sudo[84364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-28fea479-1a6e-4e9d-aa45-83f86cb3a56a
Apr 09 12:43:25 devstack sudo[84364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:26 devstack sudo[84364]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-04722059-d6f8-40fb-a334-2519697a8065 tempest-GroupSnapshotsTest-799393923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-28fea479-1a6e-4e9d-aa45-83f86cb3a56a" returned: 0 in 0.912s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-04722059-d6f8-40fb-a334-2519697a8065 tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-28fea479-1a6e-4e9d-aa45-83f86cb3a56a {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:26 devstack sudo[84369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-28fea479-1a6e-4e9d-aa45-83f86cb3a56a
Apr 09 12:43:26 devstack sudo[84369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:26 devstack sudo[84369]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-04722059-d6f8-40fb-a334-2519697a8065 tempest-GroupSnapshotsTest-799393923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-28fea479-1a6e-4e9d-aa45-83f86cb3a56a" returned: 0 in 0.612s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:26 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-04722059-d6f8-40fb-a334-2519697a8065 tempest-GroupSnapshotsTest-799393923 None] Lock "cinder-quobyte-28fea479-1a6e-4e9d-aa45-83f86cb3a56a" released by "delete_volume" :: held 1.558s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:43:26 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-04722059-d6f8-40fb-a334-2519697a8065 tempest-GroupSnapshotsTest-799393923 None] Created reservations ['168d6517-5f7d-4959-81ed-6a175bb9d5fc'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:43:26 devstack cinder-volume[82760]: WARNING cinder.quota [None req-04722059-d6f8-40fb-a334-2519697a8065 tempest-GroupSnapshotsTest-799393923 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1747512783 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1747512783, it is now deprecated. Please use the default quota class for default quota.
Apr 09 12:43:26 devstack cinder-volume[82760]: WARNING cinder.quota [None req-04722059-d6f8-40fb-a334-2519697a8065 tempest-GroupSnapshotsTest-799393923 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1747512783 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1747512783, it is now deprecated. Please use the default quota class for default quota.
Apr 09 12:43:26 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-04722059-d6f8-40fb-a334-2519697a8065 tempest-GroupSnapshotsTest-799393923 None] Created reservations ['d984586e-1b66-4081-bf38-7b3082bd50b0', '5e63e5e8-17a8-4f5e-99c6-d061e0d56801', 'a4e0093c-0ea3-4324-b83f-5763fe0828ee', '80c1cc04-1bb7-4b79-afd3-7e0fa4012690'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:43:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-04722059-d6f8-40fb-a334-2519697a8065 tempest-GroupSnapshotsTest-799393923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:43:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-04722059-d6f8-40fb-a334-2519697a8065 tempest-GroupSnapshotsTest-799393923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:43:26 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-04722059-d6f8-40fb-a334-2519697a8065 tempest-GroupSnapshotsTest-799393923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:43:26 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-04722059-d6f8-40fb-a334-2519697a8065 tempest-GroupSnapshotsTest-799393923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:43:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-04722059-d6f8-40fb-a334-2519697a8065 tempest-GroupSnapshotsTest-799393923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:43:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-04722059-d6f8-40fb-a334-2519697a8065 tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:26 devstack sudo[84373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:43:26 devstack sudo[84373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:27 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-1cdc1cf3-5169-458a-9186-410b22166c0f tempest-GroupSnapshotsTest-799393923 None] group_snapshot 6716c4a1-7ed4-4235-80f7-18f84cbadfd1: deleting
Apr 09 12:43:27 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-1cdc1cf3-5169-458a-9186-410b22166c0f tempest-GroupSnapshotsTest-799393923 None] group_snapshot 6716c4a1-7ed4-4235-80f7-18f84cbadfd1: deleting {{(pid=82760) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 09 12:43:27 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-1cdc1cf3-5169-458a-9186-410b22166c0f tempest-GroupSnapshotsTest-799393923 None] Acquiring lock "cinder-quobyte-0cc5d573-0920-41db-a9d0-cdb1ae517bea" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:43:27 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-1cdc1cf3-5169-458a-9186-410b22166c0f tempest-GroupSnapshotsTest-799393923 None] Lock "cinder-quobyte-0cc5d573-0920-41db-a9d0-cdb1ae517bea" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:43:27 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-1cdc1cf3-5169-458a-9186-410b22166c0f tempest-GroupSnapshotsTest-799393923 None] Acquiring lock "cinder-quobyte-824dcb35-ba8c-4001-9b49-dc594d358aa6" by "_delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:43:27 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-1cdc1cf3-5169-458a-9186-410b22166c0f tempest-GroupSnapshotsTest-799393923 None] Lock "cinder-quobyte-824dcb35-ba8c-4001-9b49-dc594d358aa6" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:43:27 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-1cdc1cf3-5169-458a-9186-410b22166c0f tempest-GroupSnapshotsTest-799393923 None] Deleting offline snapshot 824dcb35-ba8c-4001-9b49-dc594d358aa6 of volume 0cc5d573-0920-41db-a9d0-cdb1ae517bea {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 12:43:27 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-1cdc1cf3-5169-458a-9186-410b22166c0f tempest-GroupSnapshotsTest-799393923 None] snapshot_file for this snap is: volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea.824dcb35-ba8c-4001-9b49-dc594d358aa6 {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 12:43:27 devstack sudo[84373]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-04722059-d6f8-40fb-a334-2519697a8065 tempest-GroupSnapshotsTest-799393923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.626s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:27 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-04722059-d6f8-40fb-a334-2519697a8065 tempest-GroupSnapshotsTest-799393923 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:43:27 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-04722059-d6f8-40fb-a334-2519697a8065 tempest-GroupSnapshotsTest-799393923 None] Delete group completed successfully.
Apr 09 12:43:27 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[36689500-d4f7-4c5a-842c-e4bd4d141de5]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:43:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-1cdc1cf3-5169-458a-9186-410b22166c0f tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea.824dcb35-ba8c-4001-9b49-dc594d358aa6 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:27 devstack sudo[84376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea.824dcb35-ba8c-4001-9b49-dc594d358aa6
Apr 09 12:43:27 devstack sudo[84376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:28 devstack sudo[84376]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:28 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-1cdc1cf3-5169-458a-9186-410b22166c0f tempest-GroupSnapshotsTest-799393923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea.824dcb35-ba8c-4001-9b49-dc594d358aa6" returned: 0 in 0.743s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:28 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-1cdc1cf3-5169-458a-9186-410b22166c0f tempest-GroupSnapshotsTest-799393923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:43:28 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[c282f39f-822e-4adf-8e56-0a2ac57607f9]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:43:28 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-1cdc1cf3-5169-458a-9186-410b22166c0f tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:28 devstack sudo[84381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea
Apr 09 12:43:28 devstack sudo[84381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:29 devstack sudo[84381]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:29 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-1cdc1cf3-5169-458a-9186-410b22166c0f tempest-GroupSnapshotsTest-799393923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea" returned: 0 in 0.777s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:29 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-1cdc1cf3-5169-458a-9186-410b22166c0f tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea.824dcb35-ba8c-4001-9b49-dc594d358aa6 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:29 devstack sudo[84414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea.824dcb35-ba8c-4001-9b49-dc594d358aa6
Apr 09 12:43:29 devstack sudo[84414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:29 devstack sudo[84414]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:29 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-1cdc1cf3-5169-458a-9186-410b22166c0f tempest-GroupSnapshotsTest-799393923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea.824dcb35-ba8c-4001-9b49-dc594d358aa6" returned: 0 in 0.800s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:29 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-1cdc1cf3-5169-458a-9186-410b22166c0f tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea.824dcb35-ba8c-4001-9b49-dc594d358aa6 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:29 devstack sudo[84420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea.824dcb35-ba8c-4001-9b49-dc594d358aa6
Apr 09 12:43:29 devstack sudo[84420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:30 devstack sudo[84420]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:30 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-1cdc1cf3-5169-458a-9186-410b22166c0f tempest-GroupSnapshotsTest-799393923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea.824dcb35-ba8c-4001-9b49-dc594d358aa6" returned: 0 in 0.696s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:30 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-1cdc1cf3-5169-458a-9186-410b22166c0f tempest-GroupSnapshotsTest-799393923 None] Lock "cinder-quobyte-824dcb35-ba8c-4001-9b49-dc594d358aa6" released by "_delete_snapshot" :: held 3.154s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:43:30 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-1cdc1cf3-5169-458a-9186-410b22166c0f tempest-GroupSnapshotsTest-799393923 None] Lock "cinder-quobyte-0cc5d573-0920-41db-a9d0-cdb1ae517bea" released by "delete_snapshot" :: held 3.193s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:43:30 devstack cinder-volume[82760]: WARNING cinder.quota [None req-1cdc1cf3-5169-458a-9186-410b22166c0f tempest-GroupSnapshotsTest-799393923 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1747512783 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1747512783, it is now deprecated. Please use the default quota class for default quota.
Apr 09 12:43:30 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-1cdc1cf3-5169-458a-9186-410b22166c0f tempest-GroupSnapshotsTest-799393923 None] Created reservations ['89c708cb-4f62-4b7e-b906-3c699d74024a', 'f174c2cd-2215-4c36-a2c7-67cca2ce1a32', '4d7e2d1c-88ba-48bc-9617-8910baf224c7', '478f645a-0f2a-452e-9cbe-7ce6f45d3d57'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:43:31 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-1cdc1cf3-5169-458a-9186-410b22166c0f tempest-GroupSnapshotsTest-799393923 None] group_snapshot 6716c4a1-7ed4-4235-80f7-18f84cbadfd1: deleted successfully
Apr 09 12:43:32 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-f17982b5-4158-47ab-bf66-d65939a1fba4 tempest-GroupSnapshotsTest-799393923 None] Acquiring lock "cinder-quobyte-0cc5d573-0920-41db-a9d0-cdb1ae517bea" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:43:32 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-f17982b5-4158-47ab-bf66-d65939a1fba4 tempest-GroupSnapshotsTest-799393923 None] Lock "cinder-quobyte-0cc5d573-0920-41db-a9d0-cdb1ae517bea" acquired by "delete_volume" :: waited 0.031s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:43:32 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bbe2eae-e45d-4371-a74b-6d200f5436ba]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:43:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f17982b5-4158-47ab-bf66-d65939a1fba4 tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:32 devstack sudo[84450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea
Apr 09 12:43:32 devstack sudo[84450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:33 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-6a55e425-91c5-478d-abc4-fa495e24d0e0 tempest-GroupsV320Test-1789889488 None] Group tempest-GroupsV320Test-Group-1902947657: creating
Apr 09 12:43:33 devstack sudo[84450]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:33 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-6a55e425-91c5-478d-abc4-fa495e24d0e0 tempest-GroupsV320Test-1789889488 None] Group tempest-GroupsV320Test-Group-1902947657: created successfully
Apr 09 12:43:33 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f17982b5-4158-47ab-bf66-d65939a1fba4 tempest-GroupSnapshotsTest-799393923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea" returned: 0 in 1.407s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:33 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f17982b5-4158-47ab-bf66-d65939a1fba4 tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:34 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-6a55e425-91c5-478d-abc4-fa495e24d0e0 tempest-GroupsV320Test-1789889488 None] Create group completed successfully.
Apr 09 12:43:34 devstack sudo[84455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea
Apr 09 12:43:34 devstack sudo[84455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:34 devstack sudo[84455]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:34 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f17982b5-4158-47ab-bf66-d65939a1fba4 tempest-GroupSnapshotsTest-799393923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0cc5d573-0920-41db-a9d0-cdb1ae517bea" returned: 0 in 0.874s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:34 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-f17982b5-4158-47ab-bf66-d65939a1fba4 tempest-GroupSnapshotsTest-799393923 None] Lock "cinder-quobyte-0cc5d573-0920-41db-a9d0-cdb1ae517bea" released by "delete_volume" :: held 2.420s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:43:34 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-f17982b5-4158-47ab-bf66-d65939a1fba4 tempest-GroupSnapshotsTest-799393923 None] Created reservations ['3dc6b631-3e9c-43a5-9246-d2d8ca37dfa0'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:43:34 devstack cinder-volume[82760]: WARNING cinder.db.sqlalchemy.api [None req-f17982b5-4158-47ab-bf66-d65939a1fba4 tempest-GroupSnapshotsTest-799393923 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1747512783']
Apr 09 12:43:34 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-f17982b5-4158-47ab-bf66-d65939a1fba4 tempest-GroupSnapshotsTest-799393923 None] Created reservations ['f97211bb-1f40-461a-b3fc-d071262473b2', '61736990-b1ec-44cf-81b6-8fe7812bac61', '0bf59f3e-28de-4cb9-a1ce-2cb940dc100c', 'bfdc6861-1be5-42ea-9f52-492f1ec724aa'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:43:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f17982b5-4158-47ab-bf66-d65939a1fba4 tempest-GroupSnapshotsTest-799393923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:43:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f17982b5-4158-47ab-bf66-d65939a1fba4 tempest-GroupSnapshotsTest-799393923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:43:35 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f17982b5-4158-47ab-bf66-d65939a1fba4 tempest-GroupSnapshotsTest-799393923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:43:35 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f17982b5-4158-47ab-bf66-d65939a1fba4 tempest-GroupSnapshotsTest-799393923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:43:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f17982b5-4158-47ab-bf66-d65939a1fba4 tempest-GroupSnapshotsTest-799393923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:43:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f17982b5-4158-47ab-bf66-d65939a1fba4 tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:35 devstack sudo[84478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:43:35 devstack sudo[84478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:35 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-54d23721-955c-469a-a15d-dbc247bc8d3d tempest-GroupsV320Test-1789889488 None] Created reservations ['757bacd1-aab6-49c4-98a5-25c24292d6e8'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:43:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-54d23721-955c-469a-a15d-dbc247bc8d3d tempest-GroupsV320Test-1789889488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:43:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-54d23721-955c-469a-a15d-dbc247bc8d3d tempest-GroupsV320Test-1789889488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:43:35 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-54d23721-955c-469a-a15d-dbc247bc8d3d tempest-GroupsV320Test-1789889488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:43:35 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-54d23721-955c-469a-a15d-dbc247bc8d3d tempest-GroupsV320Test-1789889488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:43:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-54d23721-955c-469a-a15d-dbc247bc8d3d tempest-GroupsV320Test-1789889488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:43:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-54d23721-955c-469a-a15d-dbc247bc8d3d tempest-GroupsV320Test-1789889488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:35 devstack sudo[84501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:43:35 devstack sudo[84501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:36 devstack sudo[84478]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:36 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f17982b5-4158-47ab-bf66-d65939a1fba4 tempest-GroupSnapshotsTest-799393923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.892s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:36 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-f17982b5-4158-47ab-bf66-d65939a1fba4 tempest-GroupSnapshotsTest-799393923 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:43:36 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-f17982b5-4158-47ab-bf66-d65939a1fba4 tempest-GroupSnapshotsTest-799393923 None] Delete group completed successfully.
Apr 09 12:43:36 devstack sudo[84501]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:36 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-54d23721-955c-469a-a15d-dbc247bc8d3d tempest-GroupsV320Test-1789889488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.674s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:36 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-54d23721-955c-469a-a15d-dbc247bc8d3d tempest-GroupsV320Test-1789889488 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:43:36 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-54d23721-955c-469a-a15d-dbc247bc8d3d tempest-GroupsV320Test-1789889488 None] Delete group completed successfully.
Apr 09 12:43:36 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-bc7161b0-44fb-4889-ba2d-a5354d6e57ee tempest-GroupSnapshotsTest-799393923 None] Group tempest-GroupSnapshotsTest-Group-1364860376: creating
Apr 09 12:43:36 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-bc7161b0-44fb-4889-ba2d-a5354d6e57ee tempest-GroupSnapshotsTest-799393923 None] Group tempest-GroupSnapshotsTest-Group-1364860376: created successfully
Apr 09 12:43:36 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-bc7161b0-44fb-4889-ba2d-a5354d6e57ee tempest-GroupSnapshotsTest-799393923 None] Create group completed successfully.
Apr 09 12:43:37 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-438e349c-4b03-4d82-8eac-eb11499a4d6d tempest-GroupSnapshotsTest-799393923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:43:38 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-438e349c-4b03-4d82-8eac-eb11499a4d6d tempest-GroupSnapshotsTest-799393923 None] Flow 'volume_create_manager' (405e78b7-be64-4dcc-8b3d-8d54707e8ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:43:38 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-438e349c-4b03-4d82-8eac-eb11499a4d6d tempest-GroupSnapshotsTest-799393923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d58dc991-ad1c-4dac-85a3-d45817a6726c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:43:38 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-438e349c-4b03-4d82-8eac-eb11499a4d6d tempest-GroupSnapshotsTest-799393923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d58dc991-ad1c-4dac-85a3-d45817a6726c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:43:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1259025746',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=74cbb134-3e47-4d9f-8441-6458be3dc2c1,host='devstack@QuobyteHD#QuobyteHD',id=6927acc7-7704-4548-baa5-9486612aa40e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83e45adb00064a50a6989c331c3a5d5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:43:38Z,use_quota=True,user_id='1b822ed89860427ab9cc8837876445e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37e685fb-4acb-401e-9d40-3a08acb6700b),volume_type_id=37e685fb-4acb-401e-9d40-3a08acb6700b)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:43:38 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-438e349c-4b03-4d82-8eac-eb11499a4d6d tempest-GroupSnapshotsTest-799393923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7ee61cd-7953-491c-8c18-20997c665960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:43:38 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-438e349c-4b03-4d82-8eac-eb11499a4d6d tempest-GroupSnapshotsTest-799393923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7ee61cd-7953-491c-8c18-20997c665960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:43:38 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-438e349c-4b03-4d82-8eac-eb11499a4d6d tempest-GroupSnapshotsTest-799393923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32135ef9-7901-41a2-9487-3e6652eea231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:43:38 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-438e349c-4b03-4d82-8eac-eb11499a4d6d tempest-GroupSnapshotsTest-799393923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32135ef9-7901-41a2-9487-3e6652eea231) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6927acc7-7704-4548-baa5-9486612aa40e', 'volume_name': 'volume-6927acc7-7704-4548-baa5-9486612aa40e', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:43:38 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-438e349c-4b03-4d82-8eac-eb11499a4d6d tempest-GroupSnapshotsTest-799393923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e741ac49-dad8-480a-83e8-ea7b81885f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:43:38 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-438e349c-4b03-4d82-8eac-eb11499a4d6d tempest-GroupSnapshotsTest-799393923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e741ac49-dad8-480a-83e8-ea7b81885f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:43:38 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-438e349c-4b03-4d82-8eac-eb11499a4d6d tempest-GroupSnapshotsTest-799393923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78ba2782-9193-4380-a08d-a3d5d34beab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:43:38 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-438e349c-4b03-4d82-8eac-eb11499a4d6d tempest-GroupSnapshotsTest-799393923 None] Volume 6927acc7-7704-4548-baa5-9486612aa40e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6927acc7-7704-4548-baa5-9486612aa40e', 'volume_size': 1}
Apr 09 12:43:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-438e349c-4b03-4d82-8eac-eb11499a4d6d tempest-GroupSnapshotsTest-799393923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:43:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-438e349c-4b03-4d82-8eac-eb11499a4d6d tempest-GroupSnapshotsTest-799393923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:43:38 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-438e349c-4b03-4d82-8eac-eb11499a4d6d tempest-GroupSnapshotsTest-799393923 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=74cbb134-3e47-4d9f-8441-6458be3dc2c1,created_at=2026-04-09T10:43:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1259025746',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=74cbb134-3e47-4d9f-8441-6458be3dc2c1,host='devstack@QuobyteHD#QuobyteHD',id=6927acc7-7704-4548-baa5-9486612aa40e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83e45adb00064a50a6989c331c3a5d5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:43:38Z,use_quota=True,user_id='1b822ed89860427ab9cc8837876445e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37e685fb-4acb-401e-9d40-3a08acb6700b),volume_type_id=37e685fb-4acb-401e-9d40-3a08acb6700b)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:43:38 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-438e349c-4b03-4d82-8eac-eb11499a4d6d tempest-GroupSnapshotsTest-799393923 None] Creating volume 6927acc7-7704-4548-baa5-9486612aa40e {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:43:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-438e349c-4b03-4d82-8eac-eb11499a4d6d tempest-GroupSnapshotsTest-799393923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:43:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-438e349c-4b03-4d82-8eac-eb11499a4d6d tempest-GroupSnapshotsTest-799393923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:43:38 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-438e349c-4b03-4d82-8eac-eb11499a4d6d tempest-GroupSnapshotsTest-799393923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:43:38 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-438e349c-4b03-4d82-8eac-eb11499a4d6d tempest-GroupSnapshotsTest-799393923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:43:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-438e349c-4b03-4d82-8eac-eb11499a4d6d tempest-GroupSnapshotsTest-799393923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:43:38 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-438e349c-4b03-4d82-8eac-eb11499a4d6d tempest-GroupSnapshotsTest-799393923 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:43:38 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-438e349c-4b03-4d82-8eac-eb11499a4d6d tempest-GroupSnapshotsTest-799393923 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:43:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-438e349c-4b03-4d82-8eac-eb11499a4d6d tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6927acc7-7704-4548-baa5-9486612aa40e 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:38 devstack sudo[84546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6927acc7-7704-4548-baa5-9486612aa40e 1073741824
Apr 09 12:43:38 devstack sudo[84546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:38 devstack sudo[84546]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-438e349c-4b03-4d82-8eac-eb11499a4d6d tempest-GroupSnapshotsTest-799393923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6927acc7-7704-4548-baa5-9486612aa40e 1073741824" returned: 0 in 0.715s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-438e349c-4b03-4d82-8eac-eb11499a4d6d tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6927acc7-7704-4548-baa5-9486612aa40e {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:38 devstack sudo[84555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6927acc7-7704-4548-baa5-9486612aa40e
Apr 09 12:43:38 devstack sudo[84555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:39 devstack sudo[84555]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-438e349c-4b03-4d82-8eac-eb11499a4d6d tempest-GroupSnapshotsTest-799393923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6927acc7-7704-4548-baa5-9486612aa40e" returned: 0 in 0.542s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:39 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-438e349c-4b03-4d82-8eac-eb11499a4d6d tempest-GroupSnapshotsTest-799393923 None] <== create_volume: return (1295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:43:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-438e349c-4b03-4d82-8eac-eb11499a4d6d tempest-GroupSnapshotsTest-799393923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.297s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:43:39 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-438e349c-4b03-4d82-8eac-eb11499a4d6d tempest-GroupSnapshotsTest-799393923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78ba2782-9193-4380-a08d-a3d5d34beab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6927acc7-7704-4548-baa5-9486612aa40e', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:43:39 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-438e349c-4b03-4d82-8eac-eb11499a4d6d tempest-GroupSnapshotsTest-799393923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f14dfd4-2c65-4ee5-ae88-611b201f183b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:43:39 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-438e349c-4b03-4d82-8eac-eb11499a4d6d tempest-GroupSnapshotsTest-799393923 None] Volume volume-6927acc7-7704-4548-baa5-9486612aa40e (6927acc7-7704-4548-baa5-9486612aa40e): created successfully
Apr 09 12:43:39 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-438e349c-4b03-4d82-8eac-eb11499a4d6d tempest-GroupSnapshotsTest-799393923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f14dfd4-2c65-4ee5-ae88-611b201f183b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:43:39 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-438e349c-4b03-4d82-8eac-eb11499a4d6d tempest-GroupSnapshotsTest-799393923 None] Flow 'volume_create_manager' (405e78b7-be64-4dcc-8b3d-8d54707e8ba1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:43:39 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-438e349c-4b03-4d82-8eac-eb11499a4d6d tempest-GroupSnapshotsTest-799393923 None] Created volume successfully.
Apr 09 12:43:40 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-e77d2df3-044a-490d-bd4e-f80a1aeb7a14 tempest-GroupSnapshotsTest-799393923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:43:40 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-e77d2df3-044a-490d-bd4e-f80a1aeb7a14 tempest-GroupSnapshotsTest-799393923 None] Flow 'volume_create_manager' (3087396b-6745-41b3-b55b-99037932fff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:43:40 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-e77d2df3-044a-490d-bd4e-f80a1aeb7a14 tempest-GroupSnapshotsTest-799393923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6cabde7-e581-4fc1-b52f-42b7d8f78e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:43:40 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-e77d2df3-044a-490d-bd4e-f80a1aeb7a14 tempest-GroupSnapshotsTest-799393923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6cabde7-e581-4fc1-b52f-42b7d8f78e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:43:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-800387936',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=74cbb134-3e47-4d9f-8441-6458be3dc2c1,host='devstack@QuobyteHD#QuobyteHD',id=882c049d-c8cf-4e3b-8b48-ca60830b3749,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83e45adb00064a50a6989c331c3a5d5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:43:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:43:40Z,use_quota=True,user_id='1b822ed89860427ab9cc8837876445e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37e685fb-4acb-401e-9d40-3a08acb6700b),volume_type_id=37e685fb-4acb-401e-9d40-3a08acb6700b)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:43:40 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-e77d2df3-044a-490d-bd4e-f80a1aeb7a14 tempest-GroupSnapshotsTest-799393923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcb70734-061f-42ba-8b28-0968a46a7591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:43:40 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-e77d2df3-044a-490d-bd4e-f80a1aeb7a14 tempest-GroupSnapshotsTest-799393923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcb70734-061f-42ba-8b28-0968a46a7591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:43:40 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-e77d2df3-044a-490d-bd4e-f80a1aeb7a14 tempest-GroupSnapshotsTest-799393923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90f438ef-f36e-4d9c-8184-cf02f3ccf9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:43:40 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-e77d2df3-044a-490d-bd4e-f80a1aeb7a14 tempest-GroupSnapshotsTest-799393923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90f438ef-f36e-4d9c-8184-cf02f3ccf9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '882c049d-c8cf-4e3b-8b48-ca60830b3749', 'volume_name': 'volume-882c049d-c8cf-4e3b-8b48-ca60830b3749', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:43:40 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-e77d2df3-044a-490d-bd4e-f80a1aeb7a14 tempest-GroupSnapshotsTest-799393923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4e48c46-abfb-4674-9fc4-291cedc44e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:43:40 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-e77d2df3-044a-490d-bd4e-f80a1aeb7a14 tempest-GroupSnapshotsTest-799393923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4e48c46-abfb-4674-9fc4-291cedc44e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:43:40 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-e77d2df3-044a-490d-bd4e-f80a1aeb7a14 tempest-GroupSnapshotsTest-799393923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e42ae27f-abc3-4097-bc3f-a495018f350f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:43:40 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-e77d2df3-044a-490d-bd4e-f80a1aeb7a14 tempest-GroupSnapshotsTest-799393923 None] Volume 882c049d-c8cf-4e3b-8b48-ca60830b3749: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-882c049d-c8cf-4e3b-8b48-ca60830b3749', 'volume_size': 1}
Apr 09 12:43:40 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-e77d2df3-044a-490d-bd4e-f80a1aeb7a14 tempest-GroupSnapshotsTest-799393923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:43:40 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-e77d2df3-044a-490d-bd4e-f80a1aeb7a14 tempest-GroupSnapshotsTest-799393923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:43:40 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-e77d2df3-044a-490d-bd4e-f80a1aeb7a14 tempest-GroupSnapshotsTest-799393923 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=74cbb134-3e47-4d9f-8441-6458be3dc2c1,created_at=2026-04-09T10:43:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-800387936',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=74cbb134-3e47-4d9f-8441-6458be3dc2c1,host='devstack@QuobyteHD#QuobyteHD',id=882c049d-c8cf-4e3b-8b48-ca60830b3749,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83e45adb00064a50a6989c331c3a5d5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:43:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:43:40Z,use_quota=True,user_id='1b822ed89860427ab9cc8837876445e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37e685fb-4acb-401e-9d40-3a08acb6700b),volume_type_id=37e685fb-4acb-401e-9d40-3a08acb6700b)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:43:40 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-e77d2df3-044a-490d-bd4e-f80a1aeb7a14 tempest-GroupSnapshotsTest-799393923 None] Creating volume 882c049d-c8cf-4e3b-8b48-ca60830b3749 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:43:40 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-e77d2df3-044a-490d-bd4e-f80a1aeb7a14 tempest-GroupSnapshotsTest-799393923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:43:40 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-e77d2df3-044a-490d-bd4e-f80a1aeb7a14 tempest-GroupSnapshotsTest-799393923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:43:40 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-e77d2df3-044a-490d-bd4e-f80a1aeb7a14 tempest-GroupSnapshotsTest-799393923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:43:40 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-e77d2df3-044a-490d-bd4e-f80a1aeb7a14 tempest-GroupSnapshotsTest-799393923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:43:40 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-e77d2df3-044a-490d-bd4e-f80a1aeb7a14 tempest-GroupSnapshotsTest-799393923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:43:40 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-e77d2df3-044a-490d-bd4e-f80a1aeb7a14 tempest-GroupSnapshotsTest-799393923 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:43:40 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-e77d2df3-044a-490d-bd4e-f80a1aeb7a14 tempest-GroupSnapshotsTest-799393923 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:43:40 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e77d2df3-044a-490d-bd4e-f80a1aeb7a14 tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-882c049d-c8cf-4e3b-8b48-ca60830b3749 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:40 devstack sudo[84560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-882c049d-c8cf-4e3b-8b48-ca60830b3749 1073741824
Apr 09 12:43:40 devstack sudo[84560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:41 devstack sudo[84560]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:41 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e77d2df3-044a-490d-bd4e-f80a1aeb7a14 tempest-GroupSnapshotsTest-799393923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-882c049d-c8cf-4e3b-8b48-ca60830b3749 1073741824" returned: 0 in 0.758s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:41 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e77d2df3-044a-490d-bd4e-f80a1aeb7a14 tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-882c049d-c8cf-4e3b-8b48-ca60830b3749 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:41 devstack sudo[84568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-882c049d-c8cf-4e3b-8b48-ca60830b3749
Apr 09 12:43:41 devstack sudo[84568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:42 devstack sudo[84568]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:42 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e77d2df3-044a-490d-bd4e-f80a1aeb7a14 tempest-GroupSnapshotsTest-799393923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-882c049d-c8cf-4e3b-8b48-ca60830b3749" returned: 0 in 0.717s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:42 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-e77d2df3-044a-490d-bd4e-f80a1aeb7a14 tempest-GroupSnapshotsTest-799393923 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:43:42 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-e77d2df3-044a-490d-bd4e-f80a1aeb7a14 tempest-GroupSnapshotsTest-799393923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.541s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:43:42 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1a37c5e-3738-4058-a2d3-720e4b6ddf4c tempest-VolumeQuotasAdminTestJSON-921599032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:43:42 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-a1a37c5e-3738-4058-a2d3-720e4b6ddf4c tempest-VolumeQuotasAdminTestJSON-921599032 None] Flow 'volume_create_manager' (5b7ff3f0-9b44-4505-aa48-b539254908bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:43:42 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-a1a37c5e-3738-4058-a2d3-720e4b6ddf4c tempest-VolumeQuotasAdminTestJSON-921599032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ef1c847-cbbc-4e99-b605-155f5da040dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:43:42 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-e77d2df3-044a-490d-bd4e-f80a1aeb7a14 tempest-GroupSnapshotsTest-799393923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e42ae27f-abc3-4097-bc3f-a495018f350f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-882c049d-c8cf-4e3b-8b48-ca60830b3749', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:43:42 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-e77d2df3-044a-490d-bd4e-f80a1aeb7a14 tempest-GroupSnapshotsTest-799393923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d54cc9e8-de69-400e-808a-3806a82f8814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:43:42 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-a1a37c5e-3738-4058-a2d3-720e4b6ddf4c tempest-VolumeQuotasAdminTestJSON-921599032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ef1c847-cbbc-4e99-b605-155f5da040dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:43:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-248557551',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4811705-46b9-4a54-a93e-af53941f0b0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='224a89f247a2421ebd334a0306cf6ef1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:43:42Z,use_quota=True,user_id='6a6aaaacc43e4beea2c28548fef0f2cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:43:42 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-a1a37c5e-3738-4058-a2d3-720e4b6ddf4c tempest-VolumeQuotasAdminTestJSON-921599032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e1ffc68-842d-4deb-85b4-d1af35f9f458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:43:42 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-a1a37c5e-3738-4058-a2d3-720e4b6ddf4c tempest-VolumeQuotasAdminTestJSON-921599032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e1ffc68-842d-4deb-85b4-d1af35f9f458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:43:42 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-a1a37c5e-3738-4058-a2d3-720e4b6ddf4c tempest-VolumeQuotasAdminTestJSON-921599032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56bef38b-72af-43a1-874a-23641eadda61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:43:42 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-a1a37c5e-3738-4058-a2d3-720e4b6ddf4c tempest-VolumeQuotasAdminTestJSON-921599032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56bef38b-72af-43a1-874a-23641eadda61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4811705-46b9-4a54-a93e-af53941f0b0b', 'volume_name': 'volume-c4811705-46b9-4a54-a93e-af53941f0b0b', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:43:42 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-a1a37c5e-3738-4058-a2d3-720e4b6ddf4c tempest-VolumeQuotasAdminTestJSON-921599032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a05195df-ed63-4471-9355-db0700fc1923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:43:42 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-a1a37c5e-3738-4058-a2d3-720e4b6ddf4c tempest-VolumeQuotasAdminTestJSON-921599032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a05195df-ed63-4471-9355-db0700fc1923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:43:42 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-a1a37c5e-3738-4058-a2d3-720e4b6ddf4c tempest-VolumeQuotasAdminTestJSON-921599032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03aedc91-5aa9-4dac-9862-afc959771157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:43:42 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-a1a37c5e-3738-4058-a2d3-720e4b6ddf4c tempest-VolumeQuotasAdminTestJSON-921599032 None] Volume c4811705-46b9-4a54-a93e-af53941f0b0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4811705-46b9-4a54-a93e-af53941f0b0b', 'volume_size': 1}
Apr 09 12:43:42 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-a1a37c5e-3738-4058-a2d3-720e4b6ddf4c tempest-VolumeQuotasAdminTestJSON-921599032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:43:42 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-a1a37c5e-3738-4058-a2d3-720e4b6ddf4c tempest-VolumeQuotasAdminTestJSON-921599032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:43:42 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-a1a37c5e-3738-4058-a2d3-720e4b6ddf4c tempest-VolumeQuotasAdminTestJSON-921599032 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:43:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-248557551',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4811705-46b9-4a54-a93e-af53941f0b0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='224a89f247a2421ebd334a0306cf6ef1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:43:42Z,use_quota=True,user_id='6a6aaaacc43e4beea2c28548fef0f2cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:43:42 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-a1a37c5e-3738-4058-a2d3-720e4b6ddf4c tempest-VolumeQuotasAdminTestJSON-921599032 None] Creating volume c4811705-46b9-4a54-a93e-af53941f0b0b {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:43:42 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-a1a37c5e-3738-4058-a2d3-720e4b6ddf4c tempest-VolumeQuotasAdminTestJSON-921599032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:43:42 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-a1a37c5e-3738-4058-a2d3-720e4b6ddf4c tempest-VolumeQuotasAdminTestJSON-921599032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:43:42 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-a1a37c5e-3738-4058-a2d3-720e4b6ddf4c tempest-VolumeQuotasAdminTestJSON-921599032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:43:42 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-a1a37c5e-3738-4058-a2d3-720e4b6ddf4c tempest-VolumeQuotasAdminTestJSON-921599032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:43:42 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-a1a37c5e-3738-4058-a2d3-720e4b6ddf4c tempest-VolumeQuotasAdminTestJSON-921599032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:43:42 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-a1a37c5e-3738-4058-a2d3-720e4b6ddf4c tempest-VolumeQuotasAdminTestJSON-921599032 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:43:42 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-a1a37c5e-3738-4058-a2d3-720e4b6ddf4c tempest-VolumeQuotasAdminTestJSON-921599032 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:43:42 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-a1a37c5e-3738-4058-a2d3-720e4b6ddf4c tempest-VolumeQuotasAdminTestJSON-921599032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c4811705-46b9-4a54-a93e-af53941f0b0b 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:42 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-e77d2df3-044a-490d-bd4e-f80a1aeb7a14 tempest-GroupSnapshotsTest-799393923 None] Volume volume-882c049d-c8cf-4e3b-8b48-ca60830b3749 (882c049d-c8cf-4e3b-8b48-ca60830b3749): created successfully
Apr 09 12:43:42 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-e77d2df3-044a-490d-bd4e-f80a1aeb7a14 tempest-GroupSnapshotsTest-799393923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d54cc9e8-de69-400e-808a-3806a82f8814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:43:42 devstack sudo[84573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c4811705-46b9-4a54-a93e-af53941f0b0b 1073741824
Apr 09 12:43:42 devstack sudo[84573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:42 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-e77d2df3-044a-490d-bd4e-f80a1aeb7a14 tempest-GroupSnapshotsTest-799393923 None] Flow 'volume_create_manager' (3087396b-6745-41b3-b55b-99037932fff0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:43:42 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-e77d2df3-044a-490d-bd4e-f80a1aeb7a14 tempest-GroupSnapshotsTest-799393923 None] Created volume successfully.
Apr 09 12:43:42 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-d775ae22-0a8f-40a7-917d-8382ffcbd830 tempest-GroupSnapshotsTest-799393923 None] Update group completed successfully.
Apr 09 12:43:42 devstack sudo[84573]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:42 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-a1a37c5e-3738-4058-a2d3-720e4b6ddf4c tempest-VolumeQuotasAdminTestJSON-921599032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c4811705-46b9-4a54-a93e-af53941f0b0b 1073741824" returned: 0 in 0.692s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:42 devstack cinder-volume[82760]: DEBUG dbcounter [-] [82760] Writing DB stats cinder:SELECT=96,cinder:UPDATE=115,cinder:INSERT=26,cinder:DELETE=9 {{(pid=82760) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 12:43:43 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-a1a37c5e-3738-4058-a2d3-720e4b6ddf4c tempest-VolumeQuotasAdminTestJSON-921599032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c4811705-46b9-4a54-a93e-af53941f0b0b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:43 devstack sudo[84582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c4811705-46b9-4a54-a93e-af53941f0b0b
Apr 09 12:43:43 devstack sudo[84582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:43 devstack sudo[84582]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:43 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-a1a37c5e-3738-4058-a2d3-720e4b6ddf4c tempest-VolumeQuotasAdminTestJSON-921599032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c4811705-46b9-4a54-a93e-af53941f0b0b" returned: 0 in 0.603s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:43 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-a1a37c5e-3738-4058-a2d3-720e4b6ddf4c tempest-VolumeQuotasAdminTestJSON-921599032 None] <== create_volume: return (1332ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:43:43 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-a1a37c5e-3738-4058-a2d3-720e4b6ddf4c tempest-VolumeQuotasAdminTestJSON-921599032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.335s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:43:43 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-a1a37c5e-3738-4058-a2d3-720e4b6ddf4c tempest-VolumeQuotasAdminTestJSON-921599032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03aedc91-5aa9-4dac-9862-afc959771157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4811705-46b9-4a54-a93e-af53941f0b0b', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:43:43 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-a1a37c5e-3738-4058-a2d3-720e4b6ddf4c tempest-VolumeQuotasAdminTestJSON-921599032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b35061f-e691-46a2-b226-0f4c25d353aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:43:43 devstack cinder-volume[82760]: DEBUG dbcounter [-] [82760] Writing DB stats cinder:SELECT=100,cinder:UPDATE=100,cinder:INSERT=20,cinder:DELETE=5 {{(pid=82760) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 12:43:43 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-a1a37c5e-3738-4058-a2d3-720e4b6ddf4c tempest-VolumeQuotasAdminTestJSON-921599032 None] Volume volume-c4811705-46b9-4a54-a93e-af53941f0b0b (c4811705-46b9-4a54-a93e-af53941f0b0b): created successfully
Apr 09 12:43:43 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-a1a37c5e-3738-4058-a2d3-720e4b6ddf4c tempest-VolumeQuotasAdminTestJSON-921599032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b35061f-e691-46a2-b226-0f4c25d353aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:43:43 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-a1a37c5e-3738-4058-a2d3-720e4b6ddf4c tempest-VolumeQuotasAdminTestJSON-921599032 None] Flow 'volume_create_manager' (5b7ff3f0-9b44-4505-aa48-b539254908bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:43:43 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-a1a37c5e-3738-4058-a2d3-720e4b6ddf4c tempest-VolumeQuotasAdminTestJSON-921599032 None] Created volume successfully.
Apr 09 12:43:43 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-2e87a16d-25a0-487c-81f6-4b1d8889e6a0 tempest-GroupSnapshotsTest-799393923 None] Update group completed successfully.
Apr 09 12:43:44 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-a1461292-642a-4893-9319-6da3d5c2fd0a tempest-VolumeQuotasAdminTestJSON-921599032 None] Acquiring lock "cinder-c4811705-46b9-4a54-a93e-af53941f0b0b-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:43:44 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-a1461292-642a-4893-9319-6da3d5c2fd0a tempest-VolumeQuotasAdminTestJSON-921599032 None] Lock "cinder-c4811705-46b9-4a54-a93e-af53941f0b0b-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:43:44 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-a1461292-642a-4893-9319-6da3d5c2fd0a tempest-VolumeQuotasAdminTestJSON-921599032 None] Acquiring lock "cinder-quobyte-c4811705-46b9-4a54-a93e-af53941f0b0b" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:43:44 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-a1461292-642a-4893-9319-6da3d5c2fd0a tempest-VolumeQuotasAdminTestJSON-921599032 None] Lock "cinder-quobyte-c4811705-46b9-4a54-a93e-af53941f0b0b" acquired by "delete_volume" :: waited 0.008s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:43:44 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[5397f7c8-afb7-4486-af5a-84e257e0fb69]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:43:44 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-a1461292-642a-4893-9319-6da3d5c2fd0a tempest-VolumeQuotasAdminTestJSON-921599032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c4811705-46b9-4a54-a93e-af53941f0b0b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:44 devstack sudo[84606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c4811705-46b9-4a54-a93e-af53941f0b0b
Apr 09 12:43:44 devstack sudo[84606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:45 devstack sudo[84606]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:45 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-a1461292-642a-4893-9319-6da3d5c2fd0a tempest-VolumeQuotasAdminTestJSON-921599032 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c4811705-46b9-4a54-a93e-af53941f0b0b" returned: 0 in 0.627s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:45 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-a1461292-642a-4893-9319-6da3d5c2fd0a tempest-VolumeQuotasAdminTestJSON-921599032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c4811705-46b9-4a54-a93e-af53941f0b0b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:45 devstack sudo[84612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c4811705-46b9-4a54-a93e-af53941f0b0b
Apr 09 12:43:45 devstack sudo[84612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:45 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-3d2091d9-2d78-4a3a-b398-9caa312fa972 tempest-GroupSnapshotsTest-799393923 None] Update group completed successfully.
Apr 09 12:43:45 devstack sudo[84612]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:45 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-a1461292-642a-4893-9319-6da3d5c2fd0a tempest-VolumeQuotasAdminTestJSON-921599032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c4811705-46b9-4a54-a93e-af53941f0b0b" returned: 0 in 0.560s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:45 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-a1461292-642a-4893-9319-6da3d5c2fd0a tempest-VolumeQuotasAdminTestJSON-921599032 None] Lock "cinder-quobyte-c4811705-46b9-4a54-a93e-af53941f0b0b" released by "delete_volume" :: held 1.222s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:43:45 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-a1461292-642a-4893-9319-6da3d5c2fd0a tempest-VolumeQuotasAdminTestJSON-921599032 None] Created reservations ['18ff0836-0dfc-4049-9ec0-836ac3f60e08', '7d22f62a-d63f-4ef8-8c72-fba10ace7a17', '445a53f8-6fac-4d06-a2f7-6754e038ab09', '252630fc-e39e-43d0-8704-ad50e68664b3'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:43:45 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-a1461292-642a-4893-9319-6da3d5c2fd0a tempest-VolumeQuotasAdminTestJSON-921599032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:43:45 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-a1461292-642a-4893-9319-6da3d5c2fd0a tempest-VolumeQuotasAdminTestJSON-921599032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:43:45 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-a1461292-642a-4893-9319-6da3d5c2fd0a tempest-VolumeQuotasAdminTestJSON-921599032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:43:45 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-a1461292-642a-4893-9319-6da3d5c2fd0a tempest-VolumeQuotasAdminTestJSON-921599032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:43:45 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-a1461292-642a-4893-9319-6da3d5c2fd0a tempest-VolumeQuotasAdminTestJSON-921599032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:43:45 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-a1461292-642a-4893-9319-6da3d5c2fd0a tempest-VolumeQuotasAdminTestJSON-921599032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:45 devstack sudo[84633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:43:45 devstack sudo[84633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:46 devstack sudo[84633]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-a1461292-642a-4893-9319-6da3d5c2fd0a tempest-VolumeQuotasAdminTestJSON-921599032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.474s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:46 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-a1461292-642a-4893-9319-6da3d5c2fd0a tempest-VolumeQuotasAdminTestJSON-921599032 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:43:46 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-a1461292-642a-4893-9319-6da3d5c2fd0a tempest-VolumeQuotasAdminTestJSON-921599032 None] Deleted volume successfully.
Apr 09 12:43:46 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-a1461292-642a-4893-9319-6da3d5c2fd0a tempest-VolumeQuotasAdminTestJSON-921599032 None] Lock "cinder-c4811705-46b9-4a54-a93e-af53941f0b0b-delete_volume" released by "delete_volume" :: held 1.887s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:43:46 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-ed128c6e-ccd4-4d48-8758-d109f86820fb tempest-GroupSnapshotsTest-799393923 None] Update group completed successfully.
Apr 09 12:43:46 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-46452b91-62c6-4dfc-85f7-f5fcbb65cbbe tempest-VolumeQuotasAdminTestJSON-921599032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:43:46 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-46452b91-62c6-4dfc-85f7-f5fcbb65cbbe tempest-VolumeQuotasAdminTestJSON-921599032 None] Flow 'volume_create_manager' (f05cc7a2-c9ee-4339-818f-667fa7afe55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:43:46 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-46452b91-62c6-4dfc-85f7-f5fcbb65cbbe tempest-VolumeQuotasAdminTestJSON-921599032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f438e8fd-b2cb-47d3-b6f3-4508ac2d23b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:43:46 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-46452b91-62c6-4dfc-85f7-f5fcbb65cbbe tempest-VolumeQuotasAdminTestJSON-921599032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f438e8fd-b2cb-47d3-b6f3-4508ac2d23b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:43:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-415764515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e40ef4eb-a2dd-474b-9780-993a2c29d224,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='224a89f247a2421ebd334a0306cf6ef1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:43:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:43:47Z,use_quota=True,user_id='6a6aaaacc43e4beea2c28548fef0f2cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:43:46 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-46452b91-62c6-4dfc-85f7-f5fcbb65cbbe tempest-VolumeQuotasAdminTestJSON-921599032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (617763fa-f689-46ea-a7f9-2806a2ce19ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:43:46 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-46452b91-62c6-4dfc-85f7-f5fcbb65cbbe tempest-VolumeQuotasAdminTestJSON-921599032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (617763fa-f689-46ea-a7f9-2806a2ce19ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:43:46 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-46452b91-62c6-4dfc-85f7-f5fcbb65cbbe tempest-VolumeQuotasAdminTestJSON-921599032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cebe289e-8ff1-4f18-b312-f74313ef7b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:43:46 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-46452b91-62c6-4dfc-85f7-f5fcbb65cbbe tempest-VolumeQuotasAdminTestJSON-921599032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cebe289e-8ff1-4f18-b312-f74313ef7b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e40ef4eb-a2dd-474b-9780-993a2c29d224', 'volume_name': 'volume-e40ef4eb-a2dd-474b-9780-993a2c29d224', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:43:46 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-46452b91-62c6-4dfc-85f7-f5fcbb65cbbe tempest-VolumeQuotasAdminTestJSON-921599032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c01e7f4-8857-48d3-98de-8e03d5424c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:43:46 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-46452b91-62c6-4dfc-85f7-f5fcbb65cbbe tempest-VolumeQuotasAdminTestJSON-921599032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c01e7f4-8857-48d3-98de-8e03d5424c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:43:46 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-46452b91-62c6-4dfc-85f7-f5fcbb65cbbe tempest-VolumeQuotasAdminTestJSON-921599032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cada05ac-eb80-4913-bdf8-aef9e2971ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:43:46 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-46452b91-62c6-4dfc-85f7-f5fcbb65cbbe tempest-VolumeQuotasAdminTestJSON-921599032 None] Volume e40ef4eb-a2dd-474b-9780-993a2c29d224: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e40ef4eb-a2dd-474b-9780-993a2c29d224', 'volume_size': 1}
Apr 09 12:43:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-46452b91-62c6-4dfc-85f7-f5fcbb65cbbe tempest-VolumeQuotasAdminTestJSON-921599032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:43:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-46452b91-62c6-4dfc-85f7-f5fcbb65cbbe tempest-VolumeQuotasAdminTestJSON-921599032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:43:46 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-46452b91-62c6-4dfc-85f7-f5fcbb65cbbe tempest-VolumeQuotasAdminTestJSON-921599032 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:43:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-415764515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e40ef4eb-a2dd-474b-9780-993a2c29d224,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='224a89f247a2421ebd334a0306cf6ef1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:43:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:43:47Z,use_quota=True,user_id='6a6aaaacc43e4beea2c28548fef0f2cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:43:46 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-46452b91-62c6-4dfc-85f7-f5fcbb65cbbe tempest-VolumeQuotasAdminTestJSON-921599032 None] Creating volume e40ef4eb-a2dd-474b-9780-993a2c29d224 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:43:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-46452b91-62c6-4dfc-85f7-f5fcbb65cbbe tempest-VolumeQuotasAdminTestJSON-921599032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:43:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-46452b91-62c6-4dfc-85f7-f5fcbb65cbbe tempest-VolumeQuotasAdminTestJSON-921599032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:43:46 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-46452b91-62c6-4dfc-85f7-f5fcbb65cbbe tempest-VolumeQuotasAdminTestJSON-921599032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:43:46 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-46452b91-62c6-4dfc-85f7-f5fcbb65cbbe tempest-VolumeQuotasAdminTestJSON-921599032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:43:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-46452b91-62c6-4dfc-85f7-f5fcbb65cbbe tempest-VolumeQuotasAdminTestJSON-921599032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:43:46 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-46452b91-62c6-4dfc-85f7-f5fcbb65cbbe tempest-VolumeQuotasAdminTestJSON-921599032 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:43:46 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-46452b91-62c6-4dfc-85f7-f5fcbb65cbbe tempest-VolumeQuotasAdminTestJSON-921599032 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:43:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-46452b91-62c6-4dfc-85f7-f5fcbb65cbbe tempest-VolumeQuotasAdminTestJSON-921599032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e40ef4eb-a2dd-474b-9780-993a2c29d224 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:46 devstack sudo[84639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e40ef4eb-a2dd-474b-9780-993a2c29d224 1073741824
Apr 09 12:43:46 devstack sudo[84639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:47 devstack sudo[84639]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:47 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-46452b91-62c6-4dfc-85f7-f5fcbb65cbbe tempest-VolumeQuotasAdminTestJSON-921599032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e40ef4eb-a2dd-474b-9780-993a2c29d224 1073741824" returned: 0 in 0.555s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:47 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-46452b91-62c6-4dfc-85f7-f5fcbb65cbbe tempest-VolumeQuotasAdminTestJSON-921599032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e40ef4eb-a2dd-474b-9780-993a2c29d224 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:47 devstack sudo[84644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e40ef4eb-a2dd-474b-9780-993a2c29d224
Apr 09 12:43:47 devstack sudo[84644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:47 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-b2efb5ee-a0ce-473e-9df7-5adf1031a68a tempest-GroupSnapshotsTest-799393923 None] GroupSnapshot 4103d4d1-c669-41f5-9016-8d8950f2e6ec: creating.
Apr 09 12:43:47 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b2efb5ee-a0ce-473e-9df7-5adf1031a68a tempest-GroupSnapshotsTest-799393923 None] Group snapshot 4103d4d1-c669-41f5-9016-8d8950f2e6ec: creating. {{(pid=82760) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 09 12:43:47 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b2efb5ee-a0ce-473e-9df7-5adf1031a68a tempest-GroupSnapshotsTest-799393923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:43:48 devstack sudo[84644]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:48 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-46452b91-62c6-4dfc-85f7-f5fcbb65cbbe tempest-VolumeQuotasAdminTestJSON-921599032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e40ef4eb-a2dd-474b-9780-993a2c29d224" returned: 0 in 0.524s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:48 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-46452b91-62c6-4dfc-85f7-f5fcbb65cbbe tempest-VolumeQuotasAdminTestJSON-921599032 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:43:48 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-46452b91-62c6-4dfc-85f7-f5fcbb65cbbe tempest-VolumeQuotasAdminTestJSON-921599032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:43:48 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b2efb5ee-a0ce-473e-9df7-5adf1031a68a tempest-GroupSnapshotsTest-799393923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.379s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:43:48 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-46452b91-62c6-4dfc-85f7-f5fcbb65cbbe tempest-VolumeQuotasAdminTestJSON-921599032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cada05ac-eb80-4913-bdf8-aef9e2971ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e40ef4eb-a2dd-474b-9780-993a2c29d224', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:43:48 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-46452b91-62c6-4dfc-85f7-f5fcbb65cbbe tempest-VolumeQuotasAdminTestJSON-921599032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12c66d34-07df-48d4-9f0c-60f806559ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:43:48 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-b2efb5ee-a0ce-473e-9df7-5adf1031a68a tempest-GroupSnapshotsTest-799393923 None] Creating offline snapshot 0ff87123-78e5-4157-b65d-aec9fa7df8c2 of volume 882c049d-c8cf-4e3b-8b48-ca60830b3749 {{(pid=82760) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 12:43:48 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-46452b91-62c6-4dfc-85f7-f5fcbb65cbbe tempest-VolumeQuotasAdminTestJSON-921599032 None] Volume volume-e40ef4eb-a2dd-474b-9780-993a2c29d224 (e40ef4eb-a2dd-474b-9780-993a2c29d224): created successfully
Apr 09 12:43:48 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-46452b91-62c6-4dfc-85f7-f5fcbb65cbbe tempest-VolumeQuotasAdminTestJSON-921599032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12c66d34-07df-48d4-9f0c-60f806559ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:43:48 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-46452b91-62c6-4dfc-85f7-f5fcbb65cbbe tempest-VolumeQuotasAdminTestJSON-921599032 None] Flow 'volume_create_manager' (f05cc7a2-c9ee-4339-818f-667fa7afe55c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:43:48 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[544b4f88-67a0-4755-90a3-d8ed6c338075]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:43:48 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b2efb5ee-a0ce-473e-9df7-5adf1031a68a tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-882c049d-c8cf-4e3b-8b48-ca60830b3749 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:48 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-46452b91-62c6-4dfc-85f7-f5fcbb65cbbe tempest-VolumeQuotasAdminTestJSON-921599032 None] Created volume successfully.
Apr 09 12:43:48 devstack sudo[84674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-882c049d-c8cf-4e3b-8b48-ca60830b3749
Apr 09 12:43:48 devstack sudo[84674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:48 devstack sudo[84674]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:48 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b2efb5ee-a0ce-473e-9df7-5adf1031a68a tempest-GroupSnapshotsTest-799393923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-882c049d-c8cf-4e3b-8b48-ca60830b3749" returned: 0 in 0.641s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:48 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b2efb5ee-a0ce-473e-9df7-5adf1031a68a tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-882c049d-c8cf-4e3b-8b48-ca60830b3749,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-882c049d-c8cf-4e3b-8b48-ca60830b3749.0ff87123-78e5-4157-b65d-aec9fa7df8c2 1G {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:48 devstack sudo[84683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-882c049d-c8cf-4e3b-8b48-ca60830b3749,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-882c049d-c8cf-4e3b-8b48-ca60830b3749.0ff87123-78e5-4157-b65d-aec9fa7df8c2 1G
Apr 09 12:43:48 devstack sudo[84683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:49 devstack sudo[84683]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:49 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b2efb5ee-a0ce-473e-9df7-5adf1031a68a tempest-GroupSnapshotsTest-799393923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-882c049d-c8cf-4e3b-8b48-ca60830b3749,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-882c049d-c8cf-4e3b-8b48-ca60830b3749.0ff87123-78e5-4157-b65d-aec9fa7df8c2 1G" returned: 0 in 0.618s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:49 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b2efb5ee-a0ce-473e-9df7-5adf1031a68a tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-882c049d-c8cf-4e3b-8b48-ca60830b3749 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-882c049d-c8cf-4e3b-8b48-ca60830b3749.0ff87123-78e5-4157-b65d-aec9fa7df8c2 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:49 devstack sudo[84688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-882c049d-c8cf-4e3b-8b48-ca60830b3749 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-882c049d-c8cf-4e3b-8b48-ca60830b3749.0ff87123-78e5-4157-b65d-aec9fa7df8c2
Apr 09 12:43:49 devstack sudo[84688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:49 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-35a7dc10-9a64-4fc1-8c36-1314933f1cdd tempest-VolumeQuotasAdminTestJSON-643485072 None] Transfer volume completed successfully.
Apr 09 12:43:50 devstack sudo[84688]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b2efb5ee-a0ce-473e-9df7-5adf1031a68a tempest-GroupSnapshotsTest-799393923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-882c049d-c8cf-4e3b-8b48-ca60830b3749 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-882c049d-c8cf-4e3b-8b48-ca60830b3749.0ff87123-78e5-4157-b65d-aec9fa7df8c2" returned: 0 in 0.858s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:50 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-b2efb5ee-a0ce-473e-9df7-5adf1031a68a tempest-GroupSnapshotsTest-799393923 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-882c049d-c8cf-4e3b-8b48-ca60830b3749.0ff87123-78e5-4157-b65d-aec9fa7df8c2 is being set with open permissions: ugo+rw: NotImplementedError
Apr 09 12:43:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b2efb5ee-a0ce-473e-9df7-5adf1031a68a tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-882c049d-c8cf-4e3b-8b48-ca60830b3749.0ff87123-78e5-4157-b65d-aec9fa7df8c2 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:50 devstack sudo[84719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-882c049d-c8cf-4e3b-8b48-ca60830b3749.0ff87123-78e5-4157-b65d-aec9fa7df8c2
Apr 09 12:43:50 devstack sudo[84719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:50 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-36e22b71-265f-42d9-a018-6b0f0ba5db0a tempest-VolumeQuotasAdminTestJSON-2000780624 None] Acquiring lock "cinder-e40ef4eb-a2dd-474b-9780-993a2c29d224-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:43:50 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-36e22b71-265f-42d9-a018-6b0f0ba5db0a tempest-VolumeQuotasAdminTestJSON-2000780624 None] Lock "cinder-e40ef4eb-a2dd-474b-9780-993a2c29d224-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:43:50 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-36e22b71-265f-42d9-a018-6b0f0ba5db0a tempest-VolumeQuotasAdminTestJSON-2000780624 None] Acquiring lock "cinder-quobyte-e40ef4eb-a2dd-474b-9780-993a2c29d224" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:43:50 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-36e22b71-265f-42d9-a018-6b0f0ba5db0a tempest-VolumeQuotasAdminTestJSON-2000780624 None] Lock "cinder-quobyte-e40ef4eb-a2dd-474b-9780-993a2c29d224" acquired by "delete_volume" :: waited 0.012s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:43:50 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[580f8854-43b2-4012-a710-58aa9976a56c]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:43:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-36e22b71-265f-42d9-a018-6b0f0ba5db0a tempest-VolumeQuotasAdminTestJSON-2000780624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e40ef4eb-a2dd-474b-9780-993a2c29d224 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:51 devstack sudo[84723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e40ef4eb-a2dd-474b-9780-993a2c29d224
Apr 09 12:43:51 devstack sudo[84723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:51 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddc7bea9-c6f2-4cc1-adf1-8f90a58ad3ca tempest-DeleteServersTestJSON-830079198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:43:51 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ddc7bea9-c6f2-4cc1-adf1-8f90a58ad3ca tempest-DeleteServersTestJSON-830079198 None] Flow 'volume_create_manager' (9bffdfdb-1312-4b7f-a219-c42110d0f1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:43:51 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ddc7bea9-c6f2-4cc1-adf1-8f90a58ad3ca tempest-DeleteServersTestJSON-830079198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c83a8e46-8666-4b6f-894b-b7bafa9a55cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:43:51 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ddc7bea9-c6f2-4cc1-adf1-8f90a58ad3ca tempest-DeleteServersTestJSON-830079198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c83a8e46-8666-4b6f-894b-b7bafa9a55cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:43:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1843784075',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99fe9163-133e-4b81-b639-097d7329718d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b8b1448649c4c9abbc4808a50f9d548',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:43:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:43:51Z,use_quota=True,user_id='483057bc7544490499a8fea61c9c9faf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:43:51 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ddc7bea9-c6f2-4cc1-adf1-8f90a58ad3ca tempest-DeleteServersTestJSON-830079198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34d37355-81aa-4906-8ba5-f8695f5bf5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:43:51 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ddc7bea9-c6f2-4cc1-adf1-8f90a58ad3ca tempest-DeleteServersTestJSON-830079198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34d37355-81aa-4906-8ba5-f8695f5bf5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:43:51 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ddc7bea9-c6f2-4cc1-adf1-8f90a58ad3ca tempest-DeleteServersTestJSON-830079198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (946e4256-e9a9-4d20-b030-596e667efdb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:43:51 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ddc7bea9-c6f2-4cc1-adf1-8f90a58ad3ca tempest-DeleteServersTestJSON-830079198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (946e4256-e9a9-4d20-b030-596e667efdb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99fe9163-133e-4b81-b639-097d7329718d', 'volume_name': 'volume-99fe9163-133e-4b81-b639-097d7329718d', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:43:51 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ddc7bea9-c6f2-4cc1-adf1-8f90a58ad3ca tempest-DeleteServersTestJSON-830079198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (795a6ca9-9842-457a-bced-9cb6a54a7c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:43:51 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ddc7bea9-c6f2-4cc1-adf1-8f90a58ad3ca tempest-DeleteServersTestJSON-830079198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (795a6ca9-9842-457a-bced-9cb6a54a7c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:43:51 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ddc7bea9-c6f2-4cc1-adf1-8f90a58ad3ca tempest-DeleteServersTestJSON-830079198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62085b6b-8bcb-489f-af98-83ca487d2e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:43:51 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-ddc7bea9-c6f2-4cc1-adf1-8f90a58ad3ca tempest-DeleteServersTestJSON-830079198 None] Volume 99fe9163-133e-4b81-b639-097d7329718d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99fe9163-133e-4b81-b639-097d7329718d', 'volume_size': 1}
Apr 09 12:43:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ddc7bea9-c6f2-4cc1-adf1-8f90a58ad3ca tempest-DeleteServersTestJSON-830079198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:43:51 devstack sudo[84719]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b2efb5ee-a0ce-473e-9df7-5adf1031a68a tempest-GroupSnapshotsTest-799393923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-882c049d-c8cf-4e3b-8b48-ca60830b3749.0ff87123-78e5-4157-b65d-aec9fa7df8c2" returned: 0 in 0.966s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b2efb5ee-a0ce-473e-9df7-5adf1031a68a tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-882c049d-c8cf-4e3b-8b48-ca60830b3749.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:51 devstack sudo[84726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-882c049d-c8cf-4e3b-8b48-ca60830b3749.info
Apr 09 12:43:51 devstack sudo[84726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:51 devstack sudo[84723]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-36e22b71-265f-42d9-a018-6b0f0ba5db0a tempest-VolumeQuotasAdminTestJSON-2000780624 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e40ef4eb-a2dd-474b-9780-993a2c29d224" returned: 0 in 0.676s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-36e22b71-265f-42d9-a018-6b0f0ba5db0a tempest-VolumeQuotasAdminTestJSON-2000780624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e40ef4eb-a2dd-474b-9780-993a2c29d224 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:51 devstack sudo[84731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e40ef4eb-a2dd-474b-9780-993a2c29d224
Apr 09 12:43:51 devstack sudo[84731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:51 devstack sudo[84726]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b2efb5ee-a0ce-473e-9df7-5adf1031a68a tempest-GroupSnapshotsTest-799393923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-882c049d-c8cf-4e3b-8b48-ca60830b3749.info" returned: 0 in 0.462s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:51 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-b2efb5ee-a0ce-473e-9df7-5adf1031a68a tempest-GroupSnapshotsTest-799393923 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-882c049d-c8cf-4e3b-8b48-ca60830b3749.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 09 12:43:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b2efb5ee-a0ce-473e-9df7-5adf1031a68a tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-882c049d-c8cf-4e3b-8b48-ca60830b3749.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:51 devstack sudo[84734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-882c049d-c8cf-4e3b-8b48-ca60830b3749.info
Apr 09 12:43:51 devstack sudo[84734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:52 devstack sudo[84731]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-36e22b71-265f-42d9-a018-6b0f0ba5db0a tempest-VolumeQuotasAdminTestJSON-2000780624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e40ef4eb-a2dd-474b-9780-993a2c29d224" returned: 0 in 0.589s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:52 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-36e22b71-265f-42d9-a018-6b0f0ba5db0a tempest-VolumeQuotasAdminTestJSON-2000780624 None] Lock "cinder-quobyte-e40ef4eb-a2dd-474b-9780-993a2c29d224" released by "delete_volume" :: held 1.313s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:43:52 devstack sudo[84734]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b2efb5ee-a0ce-473e-9df7-5adf1031a68a tempest-GroupSnapshotsTest-799393923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-882c049d-c8cf-4e3b-8b48-ca60830b3749.info" returned: 0 in 0.508s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b2efb5ee-a0ce-473e-9df7-5adf1031a68a tempest-GroupSnapshotsTest-799393923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.188s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:43:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b2efb5ee-a0ce-473e-9df7-5adf1031a68a tempest-GroupSnapshotsTest-799393923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:43:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b2efb5ee-a0ce-473e-9df7-5adf1031a68a tempest-GroupSnapshotsTest-799393923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:43:52 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-36e22b71-265f-42d9-a018-6b0f0ba5db0a tempest-VolumeQuotasAdminTestJSON-2000780624 None] Created reservations ['ea7c7f4d-d3c4-4fcd-b8f0-f8217141dec6', '3790c3f8-7bd6-4443-9297-a7d901736601', 'fa1c54ca-9288-48f0-8dc2-28af9684d21d', '6fe184d8-71ac-4f74-9997-1eb3506b30ea'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:43:52 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-b2efb5ee-a0ce-473e-9df7-5adf1031a68a tempest-GroupSnapshotsTest-799393923 None] Creating offline snapshot e1d59f62-cdf2-41b2-a9f2-ec67a081401e of volume 6927acc7-7704-4548-baa5-9486612aa40e {{(pid=82760) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 12:43:52 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[655c0e7d-f3f7-4756-b150-79eae2507220]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:43:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b2efb5ee-a0ce-473e-9df7-5adf1031a68a tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6927acc7-7704-4548-baa5-9486612aa40e {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-36e22b71-265f-42d9-a018-6b0f0ba5db0a tempest-VolumeQuotasAdminTestJSON-2000780624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:43:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-36e22b71-265f-42d9-a018-6b0f0ba5db0a tempest-VolumeQuotasAdminTestJSON-2000780624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:43:52 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-36e22b71-265f-42d9-a018-6b0f0ba5db0a tempest-VolumeQuotasAdminTestJSON-2000780624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:43:52 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-36e22b71-265f-42d9-a018-6b0f0ba5db0a tempest-VolumeQuotasAdminTestJSON-2000780624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:43:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-36e22b71-265f-42d9-a018-6b0f0ba5db0a tempest-VolumeQuotasAdminTestJSON-2000780624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:43:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-36e22b71-265f-42d9-a018-6b0f0ba5db0a tempest-VolumeQuotasAdminTestJSON-2000780624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:52 devstack sudo[84741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:43:52 devstack sudo[84741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:52 devstack sudo[84738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6927acc7-7704-4548-baa5-9486612aa40e
Apr 09 12:43:52 devstack sudo[84738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:52 devstack sudo[84741]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-36e22b71-265f-42d9-a018-6b0f0ba5db0a tempest-VolumeQuotasAdminTestJSON-2000780624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.552s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:52 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-36e22b71-265f-42d9-a018-6b0f0ba5db0a tempest-VolumeQuotasAdminTestJSON-2000780624 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:43:52 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-36e22b71-265f-42d9-a018-6b0f0ba5db0a tempest-VolumeQuotasAdminTestJSON-2000780624 None] Deleted volume successfully.
Apr 09 12:43:52 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-36e22b71-265f-42d9-a018-6b0f0ba5db0a tempest-VolumeQuotasAdminTestJSON-2000780624 None] Lock "cinder-e40ef4eb-a2dd-474b-9780-993a2c29d224-delete_volume" released by "delete_volume" :: held 2.186s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:43:53 devstack sudo[84738]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b2efb5ee-a0ce-473e-9df7-5adf1031a68a tempest-GroupSnapshotsTest-799393923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6927acc7-7704-4548-baa5-9486612aa40e" returned: 0 in 0.904s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b2efb5ee-a0ce-473e-9df7-5adf1031a68a tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6927acc7-7704-4548-baa5-9486612aa40e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6927acc7-7704-4548-baa5-9486612aa40e.e1d59f62-cdf2-41b2-a9f2-ec67a081401e 1G {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:53 devstack sudo[84748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6927acc7-7704-4548-baa5-9486612aa40e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6927acc7-7704-4548-baa5-9486612aa40e.e1d59f62-cdf2-41b2-a9f2-ec67a081401e 1G
Apr 09 12:43:53 devstack sudo[84748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:53 devstack sudo[84748]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b2efb5ee-a0ce-473e-9df7-5adf1031a68a tempest-GroupSnapshotsTest-799393923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6927acc7-7704-4548-baa5-9486612aa40e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6927acc7-7704-4548-baa5-9486612aa40e.e1d59f62-cdf2-41b2-a9f2-ec67a081401e 1G" returned: 0 in 0.756s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b2efb5ee-a0ce-473e-9df7-5adf1031a68a tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6927acc7-7704-4548-baa5-9486612aa40e -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6927acc7-7704-4548-baa5-9486612aa40e.e1d59f62-cdf2-41b2-a9f2-ec67a081401e {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:53 devstack sudo[84758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6927acc7-7704-4548-baa5-9486612aa40e -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6927acc7-7704-4548-baa5-9486612aa40e.e1d59f62-cdf2-41b2-a9f2-ec67a081401e
Apr 09 12:43:53 devstack sudo[84758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:54 devstack sudo[84758]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b2efb5ee-a0ce-473e-9df7-5adf1031a68a tempest-GroupSnapshotsTest-799393923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6927acc7-7704-4548-baa5-9486612aa40e -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6927acc7-7704-4548-baa5-9486612aa40e.e1d59f62-cdf2-41b2-a9f2-ec67a081401e" returned: 0 in 0.918s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:54 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-b2efb5ee-a0ce-473e-9df7-5adf1031a68a tempest-GroupSnapshotsTest-799393923 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6927acc7-7704-4548-baa5-9486612aa40e.e1d59f62-cdf2-41b2-a9f2-ec67a081401e is being set with open permissions: ugo+rw: NotImplementedError
Apr 09 12:43:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b2efb5ee-a0ce-473e-9df7-5adf1031a68a tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6927acc7-7704-4548-baa5-9486612aa40e.e1d59f62-cdf2-41b2-a9f2-ec67a081401e {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:54 devstack sudo[84778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6927acc7-7704-4548-baa5-9486612aa40e.e1d59f62-cdf2-41b2-a9f2-ec67a081401e
Apr 09 12:43:54 devstack sudo[84778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:55 devstack sudo[84778]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b2efb5ee-a0ce-473e-9df7-5adf1031a68a tempest-GroupSnapshotsTest-799393923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6927acc7-7704-4548-baa5-9486612aa40e.e1d59f62-cdf2-41b2-a9f2-ec67a081401e" returned: 0 in 0.544s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b2efb5ee-a0ce-473e-9df7-5adf1031a68a tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6927acc7-7704-4548-baa5-9486612aa40e.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:55 devstack sudo[84782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6927acc7-7704-4548-baa5-9486612aa40e.info
Apr 09 12:43:55 devstack sudo[84782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:55 devstack sudo[84782]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b2efb5ee-a0ce-473e-9df7-5adf1031a68a tempest-GroupSnapshotsTest-799393923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6927acc7-7704-4548-baa5-9486612aa40e.info" returned: 0 in 0.511s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:55 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-b2efb5ee-a0ce-473e-9df7-5adf1031a68a tempest-GroupSnapshotsTest-799393923 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6927acc7-7704-4548-baa5-9486612aa40e.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 09 12:43:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b2efb5ee-a0ce-473e-9df7-5adf1031a68a tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6927acc7-7704-4548-baa5-9486612aa40e.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:56 devstack sudo[84785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6927acc7-7704-4548-baa5-9486612aa40e.info
Apr 09 12:43:56 devstack sudo[84785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:56 devstack sudo[84785]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b2efb5ee-a0ce-473e-9df7-5adf1031a68a tempest-GroupSnapshotsTest-799393923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6927acc7-7704-4548-baa5-9486612aa40e.info" returned: 0 in 0.705s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b2efb5ee-a0ce-473e-9df7-5adf1031a68a tempest-GroupSnapshotsTest-799393923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.433s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:43:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ddc7bea9-c6f2-4cc1-adf1-8f90a58ad3ca tempest-DeleteServersTestJSON-830079198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.530s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:43:56 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-ddc7bea9-c6f2-4cc1-adf1-8f90a58ad3ca tempest-DeleteServersTestJSON-830079198 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:43:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1843784075',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99fe9163-133e-4b81-b639-097d7329718d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b8b1448649c4c9abbc4808a50f9d548',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:43:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:43:51Z,use_quota=True,user_id='483057bc7544490499a8fea61c9c9faf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:43:56 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-ddc7bea9-c6f2-4cc1-adf1-8f90a58ad3ca tempest-DeleteServersTestJSON-830079198 None] Creating volume 99fe9163-133e-4b81-b639-097d7329718d {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:43:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ddc7bea9-c6f2-4cc1-adf1-8f90a58ad3ca tempest-DeleteServersTestJSON-830079198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:43:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ddc7bea9-c6f2-4cc1-adf1-8f90a58ad3ca tempest-DeleteServersTestJSON-830079198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:43:56 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-ddc7bea9-c6f2-4cc1-adf1-8f90a58ad3ca tempest-DeleteServersTestJSON-830079198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:43:56 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-ddc7bea9-c6f2-4cc1-adf1-8f90a58ad3ca tempest-DeleteServersTestJSON-830079198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:43:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ddc7bea9-c6f2-4cc1-adf1-8f90a58ad3ca tempest-DeleteServersTestJSON-830079198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:43:56 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-ddc7bea9-c6f2-4cc1-adf1-8f90a58ad3ca tempest-DeleteServersTestJSON-830079198 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:43:56 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-ddc7bea9-c6f2-4cc1-adf1-8f90a58ad3ca tempest-DeleteServersTestJSON-830079198 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:43:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ddc7bea9-c6f2-4cc1-adf1-8f90a58ad3ca tempest-DeleteServersTestJSON-830079198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-99fe9163-133e-4b81-b639-097d7329718d 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:56 devstack sudo[84788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-99fe9163-133e-4b81-b639-097d7329718d 1073741824
Apr 09 12:43:56 devstack sudo[84788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:56 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-b2efb5ee-a0ce-473e-9df7-5adf1031a68a tempest-GroupSnapshotsTest-799393923 None] group_snapshot 4103d4d1-c669-41f5-9016-8d8950f2e6ec: created successfully
Apr 09 12:43:57 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-06619bb1-683d-4ee6-861c-81ba918787da tempest-GroupSnapshotsTest-799393923 None] group_snapshot 4103d4d1-c669-41f5-9016-8d8950f2e6ec: deleting
Apr 09 12:43:57 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-06619bb1-683d-4ee6-861c-81ba918787da tempest-GroupSnapshotsTest-799393923 None] group_snapshot 4103d4d1-c669-41f5-9016-8d8950f2e6ec: deleting {{(pid=82760) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 09 12:43:57 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-06619bb1-683d-4ee6-861c-81ba918787da tempest-GroupSnapshotsTest-799393923 None] Acquiring lock "cinder-quobyte-882c049d-c8cf-4e3b-8b48-ca60830b3749" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:43:57 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-06619bb1-683d-4ee6-861c-81ba918787da tempest-GroupSnapshotsTest-799393923 None] Lock "cinder-quobyte-882c049d-c8cf-4e3b-8b48-ca60830b3749" acquired by "delete_snapshot" :: waited 0.028s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:43:57 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-06619bb1-683d-4ee6-861c-81ba918787da tempest-GroupSnapshotsTest-799393923 None] Acquiring lock "cinder-quobyte-0ff87123-78e5-4157-b65d-aec9fa7df8c2" by "_delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:43:57 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-06619bb1-683d-4ee6-861c-81ba918787da tempest-GroupSnapshotsTest-799393923 None] Lock "cinder-quobyte-0ff87123-78e5-4157-b65d-aec9fa7df8c2" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:43:57 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-06619bb1-683d-4ee6-861c-81ba918787da tempest-GroupSnapshotsTest-799393923 None] Deleting offline snapshot 0ff87123-78e5-4157-b65d-aec9fa7df8c2 of volume 882c049d-c8cf-4e3b-8b48-ca60830b3749 {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 12:43:57 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-06619bb1-683d-4ee6-861c-81ba918787da tempest-GroupSnapshotsTest-799393923 None] snapshot_file for this snap is: volume-882c049d-c8cf-4e3b-8b48-ca60830b3749.0ff87123-78e5-4157-b65d-aec9fa7df8c2 {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 12:43:57 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[13fe1cc0-e81a-488e-9b01-556a186bcc16]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:43:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-06619bb1-683d-4ee6-861c-81ba918787da tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-882c049d-c8cf-4e3b-8b48-ca60830b3749.0ff87123-78e5-4157-b65d-aec9fa7df8c2 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:57 devstack sudo[84810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-882c049d-c8cf-4e3b-8b48-ca60830b3749.0ff87123-78e5-4157-b65d-aec9fa7df8c2
Apr 09 12:43:57 devstack sudo[84810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:58 devstack sudo[84788]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ddc7bea9-c6f2-4cc1-adf1-8f90a58ad3ca tempest-DeleteServersTestJSON-830079198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-99fe9163-133e-4b81-b639-097d7329718d 1073741824" returned: 0 in 1.359s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ddc7bea9-c6f2-4cc1-adf1-8f90a58ad3ca tempest-DeleteServersTestJSON-830079198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-99fe9163-133e-4b81-b639-097d7329718d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:58 devstack sudo[84819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-99fe9163-133e-4b81-b639-097d7329718d
Apr 09 12:43:58 devstack sudo[84819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:58 devstack sudo[84810]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-06619bb1-683d-4ee6-861c-81ba918787da tempest-GroupSnapshotsTest-799393923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-882c049d-c8cf-4e3b-8b48-ca60830b3749.0ff87123-78e5-4157-b65d-aec9fa7df8c2" returned: 0 in 0.857s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:58 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-06619bb1-683d-4ee6-861c-81ba918787da tempest-GroupSnapshotsTest-799393923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-882c049d-c8cf-4e3b-8b48-ca60830b3749(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:43:58 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b17bc2-3497-431c-9e2b-d4a1bde82a96]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:43:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-06619bb1-683d-4ee6-861c-81ba918787da tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-882c049d-c8cf-4e3b-8b48-ca60830b3749 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:58 devstack sudo[84824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-882c049d-c8cf-4e3b-8b48-ca60830b3749
Apr 09 12:43:58 devstack sudo[84824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:43:58 devstack sudo[84819]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ddc7bea9-c6f2-4cc1-adf1-8f90a58ad3ca tempest-DeleteServersTestJSON-830079198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-99fe9163-133e-4b81-b639-097d7329718d" returned: 0 in 0.885s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:58 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-ddc7bea9-c6f2-4cc1-adf1-8f90a58ad3ca tempest-DeleteServersTestJSON-830079198 None] <== create_volume: return (2278ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:43:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ddc7bea9-c6f2-4cc1-adf1-8f90a58ad3ca tempest-DeleteServersTestJSON-830079198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.282s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:43:58 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ddc7bea9-c6f2-4cc1-adf1-8f90a58ad3ca tempest-DeleteServersTestJSON-830079198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62085b6b-8bcb-489f-af98-83ca487d2e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99fe9163-133e-4b81-b639-097d7329718d', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:43:58 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ddc7bea9-c6f2-4cc1-adf1-8f90a58ad3ca tempest-DeleteServersTestJSON-830079198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (794672e8-4179-44ce-a3da-5e4066a06c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:43:59 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-ddc7bea9-c6f2-4cc1-adf1-8f90a58ad3ca tempest-DeleteServersTestJSON-830079198 None] Volume volume-99fe9163-133e-4b81-b639-097d7329718d (99fe9163-133e-4b81-b639-097d7329718d): created successfully
Apr 09 12:43:59 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ddc7bea9-c6f2-4cc1-adf1-8f90a58ad3ca tempest-DeleteServersTestJSON-830079198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (794672e8-4179-44ce-a3da-5e4066a06c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:43:59 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ddc7bea9-c6f2-4cc1-adf1-8f90a58ad3ca tempest-DeleteServersTestJSON-830079198 None] Flow 'volume_create_manager' (9bffdfdb-1312-4b7f-a219-c42110d0f1c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:43:59 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-ddc7bea9-c6f2-4cc1-adf1-8f90a58ad3ca tempest-DeleteServersTestJSON-830079198 None] Created volume successfully.
Apr 09 12:43:59 devstack sudo[84824]: pam_unix(sudo:session): session closed for user root
Apr 09 12:43:59 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-06619bb1-683d-4ee6-861c-81ba918787da tempest-GroupSnapshotsTest-799393923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-882c049d-c8cf-4e3b-8b48-ca60830b3749" returned: 0 in 1.178s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:43:59 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-06619bb1-683d-4ee6-861c-81ba918787da tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-882c049d-c8cf-4e3b-8b48-ca60830b3749.0ff87123-78e5-4157-b65d-aec9fa7df8c2 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:43:59 devstack sudo[84830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-882c049d-c8cf-4e3b-8b48-ca60830b3749.0ff87123-78e5-4157-b65d-aec9fa7df8c2
Apr 09 12:43:59 devstack sudo[84830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:00 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e8eb9cc-fc33-4cc6-8594-5c7d74474929 tempest-VolumeQuotasNegativeTestJSON-792394752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:44:00 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-6e8eb9cc-fc33-4cc6-8594-5c7d74474929 tempest-VolumeQuotasNegativeTestJSON-792394752 None] Flow 'volume_create_manager' (9dd0bbe6-34df-47ff-95a7-fb0aeb958671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:44:00 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-6e8eb9cc-fc33-4cc6-8594-5c7d74474929 tempest-VolumeQuotasNegativeTestJSON-792394752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30192902-85d9-4e8e-bfd8-cee76383e28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:44:00 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-6e8eb9cc-fc33-4cc6-8594-5c7d74474929 tempest-VolumeQuotasNegativeTestJSON-792394752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30192902-85d9-4e8e-bfd8-cee76383e28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:44:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-873015267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74700894-2c69-493d-877e-ae66b3875efb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fef79c1fe95461ca630e58db5fc8ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:44:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:44:00Z,use_quota=True,user_id='91ce8a99573a4a3e85ed0adc3ee0675a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:44:00 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-6e8eb9cc-fc33-4cc6-8594-5c7d74474929 tempest-VolumeQuotasNegativeTestJSON-792394752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (748855c7-14f1-41e9-9bbb-1fa99154f111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:44:00 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-6e8eb9cc-fc33-4cc6-8594-5c7d74474929 tempest-VolumeQuotasNegativeTestJSON-792394752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (748855c7-14f1-41e9-9bbb-1fa99154f111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:44:00 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-6e8eb9cc-fc33-4cc6-8594-5c7d74474929 tempest-VolumeQuotasNegativeTestJSON-792394752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7378d82a-40ab-4dff-9e09-ff1065e9f477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:44:00 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-6e8eb9cc-fc33-4cc6-8594-5c7d74474929 tempest-VolumeQuotasNegativeTestJSON-792394752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7378d82a-40ab-4dff-9e09-ff1065e9f477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74700894-2c69-493d-877e-ae66b3875efb', 'volume_name': 'volume-74700894-2c69-493d-877e-ae66b3875efb', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:44:00 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-6e8eb9cc-fc33-4cc6-8594-5c7d74474929 tempest-VolumeQuotasNegativeTestJSON-792394752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1155ecf7-1870-40fc-893b-c7701afc6a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:44:00 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-6e8eb9cc-fc33-4cc6-8594-5c7d74474929 tempest-VolumeQuotasNegativeTestJSON-792394752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1155ecf7-1870-40fc-893b-c7701afc6a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:44:00 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-6e8eb9cc-fc33-4cc6-8594-5c7d74474929 tempest-VolumeQuotasNegativeTestJSON-792394752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9e9ea89-cba9-4956-930b-0e3684a77280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:44:00 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-6e8eb9cc-fc33-4cc6-8594-5c7d74474929 tempest-VolumeQuotasNegativeTestJSON-792394752 None] Volume 74700894-2c69-493d-877e-ae66b3875efb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74700894-2c69-493d-877e-ae66b3875efb', 'volume_size': 1}
Apr 09 12:44:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-6e8eb9cc-fc33-4cc6-8594-5c7d74474929 tempest-VolumeQuotasNegativeTestJSON-792394752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:44:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-6e8eb9cc-fc33-4cc6-8594-5c7d74474929 tempest-VolumeQuotasNegativeTestJSON-792394752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:44:00 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-6e8eb9cc-fc33-4cc6-8594-5c7d74474929 tempest-VolumeQuotasNegativeTestJSON-792394752 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:44:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-873015267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74700894-2c69-493d-877e-ae66b3875efb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fef79c1fe95461ca630e58db5fc8ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:44:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:44:00Z,use_quota=True,user_id='91ce8a99573a4a3e85ed0adc3ee0675a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:44:00 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-6e8eb9cc-fc33-4cc6-8594-5c7d74474929 tempest-VolumeQuotasNegativeTestJSON-792394752 None] Creating volume 74700894-2c69-493d-877e-ae66b3875efb {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:44:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-6e8eb9cc-fc33-4cc6-8594-5c7d74474929 tempest-VolumeQuotasNegativeTestJSON-792394752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:44:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-6e8eb9cc-fc33-4cc6-8594-5c7d74474929 tempest-VolumeQuotasNegativeTestJSON-792394752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:44:00 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-6e8eb9cc-fc33-4cc6-8594-5c7d74474929 tempest-VolumeQuotasNegativeTestJSON-792394752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:44:00 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-6e8eb9cc-fc33-4cc6-8594-5c7d74474929 tempest-VolumeQuotasNegativeTestJSON-792394752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:44:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-6e8eb9cc-fc33-4cc6-8594-5c7d74474929 tempest-VolumeQuotasNegativeTestJSON-792394752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:44:00 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-6e8eb9cc-fc33-4cc6-8594-5c7d74474929 tempest-VolumeQuotasNegativeTestJSON-792394752 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:44:00 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-6e8eb9cc-fc33-4cc6-8594-5c7d74474929 tempest-VolumeQuotasNegativeTestJSON-792394752 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:44:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6e8eb9cc-fc33-4cc6-8594-5c7d74474929 tempest-VolumeQuotasNegativeTestJSON-792394752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-74700894-2c69-493d-877e-ae66b3875efb 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:00 devstack sudo[84838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-74700894-2c69-493d-877e-ae66b3875efb 1073741824
Apr 09 12:44:00 devstack sudo[84838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:01 devstack sudo[84830]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-06619bb1-683d-4ee6-861c-81ba918787da tempest-GroupSnapshotsTest-799393923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-882c049d-c8cf-4e3b-8b48-ca60830b3749.0ff87123-78e5-4157-b65d-aec9fa7df8c2" returned: 0 in 1.294s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-06619bb1-683d-4ee6-861c-81ba918787da tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-882c049d-c8cf-4e3b-8b48-ca60830b3749.0ff87123-78e5-4157-b65d-aec9fa7df8c2 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:01 devstack sudo[84846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-882c049d-c8cf-4e3b-8b48-ca60830b3749.0ff87123-78e5-4157-b65d-aec9fa7df8c2
Apr 09 12:44:01 devstack sudo[84846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:01 devstack sudo[84838]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6e8eb9cc-fc33-4cc6-8594-5c7d74474929 tempest-VolumeQuotasNegativeTestJSON-792394752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-74700894-2c69-493d-877e-ae66b3875efb 1073741824" returned: 0 in 0.990s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6e8eb9cc-fc33-4cc6-8594-5c7d74474929 tempest-VolumeQuotasNegativeTestJSON-792394752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-74700894-2c69-493d-877e-ae66b3875efb {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:01 devstack sudo[84848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-74700894-2c69-493d-877e-ae66b3875efb
Apr 09 12:44:01 devstack sudo[84848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:01 devstack sudo[84846]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-06619bb1-683d-4ee6-861c-81ba918787da tempest-GroupSnapshotsTest-799393923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-882c049d-c8cf-4e3b-8b48-ca60830b3749.0ff87123-78e5-4157-b65d-aec9fa7df8c2" returned: 0 in 0.828s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:01 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-06619bb1-683d-4ee6-861c-81ba918787da tempest-GroupSnapshotsTest-799393923 None] Lock "cinder-quobyte-0ff87123-78e5-4157-b65d-aec9fa7df8c2" released by "_delete_snapshot" :: held 4.350s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:44:01 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-06619bb1-683d-4ee6-861c-81ba918787da tempest-GroupSnapshotsTest-799393923 None] Lock "cinder-quobyte-882c049d-c8cf-4e3b-8b48-ca60830b3749" released by "delete_snapshot" :: held 4.390s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:44:01 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-06619bb1-683d-4ee6-861c-81ba918787da tempest-GroupSnapshotsTest-799393923 None] Acquiring lock "cinder-quobyte-6927acc7-7704-4548-baa5-9486612aa40e" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:44:01 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-06619bb1-683d-4ee6-861c-81ba918787da tempest-GroupSnapshotsTest-799393923 None] Lock "cinder-quobyte-6927acc7-7704-4548-baa5-9486612aa40e" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:44:01 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-06619bb1-683d-4ee6-861c-81ba918787da tempest-GroupSnapshotsTest-799393923 None] Acquiring lock "cinder-quobyte-e1d59f62-cdf2-41b2-a9f2-ec67a081401e" by "_delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:44:01 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-06619bb1-683d-4ee6-861c-81ba918787da tempest-GroupSnapshotsTest-799393923 None] Lock "cinder-quobyte-e1d59f62-cdf2-41b2-a9f2-ec67a081401e" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:44:01 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-06619bb1-683d-4ee6-861c-81ba918787da tempest-GroupSnapshotsTest-799393923 None] Deleting offline snapshot e1d59f62-cdf2-41b2-a9f2-ec67a081401e of volume 6927acc7-7704-4548-baa5-9486612aa40e {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 12:44:02 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-06619bb1-683d-4ee6-861c-81ba918787da tempest-GroupSnapshotsTest-799393923 None] snapshot_file for this snap is: volume-6927acc7-7704-4548-baa5-9486612aa40e.e1d59f62-cdf2-41b2-a9f2-ec67a081401e {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 12:44:02 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[52fa7cc3-70ba-4aca-a58e-6ad207747ead]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:44:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-06619bb1-683d-4ee6-861c-81ba918787da tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6927acc7-7704-4548-baa5-9486612aa40e.e1d59f62-cdf2-41b2-a9f2-ec67a081401e {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:02 devstack sudo[84854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6927acc7-7704-4548-baa5-9486612aa40e.e1d59f62-cdf2-41b2-a9f2-ec67a081401e
Apr 09 12:44:02 devstack sudo[84854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:02 devstack sudo[84848]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6e8eb9cc-fc33-4cc6-8594-5c7d74474929 tempest-VolumeQuotasNegativeTestJSON-792394752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-74700894-2c69-493d-877e-ae66b3875efb" returned: 0 in 0.934s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:02 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-6e8eb9cc-fc33-4cc6-8594-5c7d74474929 tempest-VolumeQuotasNegativeTestJSON-792394752 None] <== create_volume: return (1962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:44:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-6e8eb9cc-fc33-4cc6-8594-5c7d74474929 tempest-VolumeQuotasNegativeTestJSON-792394752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.965s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:44:02 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-6e8eb9cc-fc33-4cc6-8594-5c7d74474929 tempest-VolumeQuotasNegativeTestJSON-792394752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9e9ea89-cba9-4956-930b-0e3684a77280) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74700894-2c69-493d-877e-ae66b3875efb', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:44:02 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-6e8eb9cc-fc33-4cc6-8594-5c7d74474929 tempest-VolumeQuotasNegativeTestJSON-792394752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7061205-b44e-4b66-ae23-9a43adefa410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:44:02 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-6e8eb9cc-fc33-4cc6-8594-5c7d74474929 tempest-VolumeQuotasNegativeTestJSON-792394752 None] Volume volume-74700894-2c69-493d-877e-ae66b3875efb (74700894-2c69-493d-877e-ae66b3875efb): created successfully
Apr 09 12:44:02 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-6e8eb9cc-fc33-4cc6-8594-5c7d74474929 tempest-VolumeQuotasNegativeTestJSON-792394752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7061205-b44e-4b66-ae23-9a43adefa410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:44:02 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-6e8eb9cc-fc33-4cc6-8594-5c7d74474929 tempest-VolumeQuotasNegativeTestJSON-792394752 None] Flow 'volume_create_manager' (9dd0bbe6-34df-47ff-95a7-fb0aeb958671) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:44:02 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-6e8eb9cc-fc33-4cc6-8594-5c7d74474929 tempest-VolumeQuotasNegativeTestJSON-792394752 None] Created volume successfully.
Apr 09 12:44:02 devstack sudo[84854]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-06619bb1-683d-4ee6-861c-81ba918787da tempest-GroupSnapshotsTest-799393923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6927acc7-7704-4548-baa5-9486612aa40e.e1d59f62-cdf2-41b2-a9f2-ec67a081401e" returned: 0 in 0.847s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:02 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-06619bb1-683d-4ee6-861c-81ba918787da tempest-GroupSnapshotsTest-799393923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6927acc7-7704-4548-baa5-9486612aa40e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:44:02 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde2ef2c-e532-4880-a301-8f60e6fa86c9]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:44:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-06619bb1-683d-4ee6-861c-81ba918787da tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6927acc7-7704-4548-baa5-9486612aa40e {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:02 devstack sudo[84865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6927acc7-7704-4548-baa5-9486612aa40e
Apr 09 12:44:02 devstack sudo[84865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [req-c01bad0b-9ea0-46f0-9ad0-1a3047bc601f req-a60ae0de-034e-4c65-8b82-f12cd0304a0f tempest-DeleteServersTestJSON-830079198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:44:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [req-c01bad0b-9ea0-46f0-9ad0-1a3047bc601f req-a60ae0de-034e-4c65-8b82-f12cd0304a0f tempest-DeleteServersTestJSON-830079198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:44:03 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ca9cfe-12a5-4284-8305-eaf3c4eb08b9]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:44:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-c01bad0b-9ea0-46f0-9ad0-1a3047bc601f req-a60ae0de-034e-4c65-8b82-f12cd0304a0f tempest-DeleteServersTestJSON-830079198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-99fe9163-133e-4b81-b639-097d7329718d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:03 devstack sudo[84865]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-06619bb1-683d-4ee6-861c-81ba918787da tempest-GroupSnapshotsTest-799393923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6927acc7-7704-4548-baa5-9486612aa40e" returned: 0 in 0.710s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-06619bb1-683d-4ee6-861c-81ba918787da tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6927acc7-7704-4548-baa5-9486612aa40e.e1d59f62-cdf2-41b2-a9f2-ec67a081401e {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:03 devstack sudo[84878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-99fe9163-133e-4b81-b639-097d7329718d
Apr 09 12:44:03 devstack sudo[84878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:03 devstack sudo[84879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6927acc7-7704-4548-baa5-9486612aa40e.e1d59f62-cdf2-41b2-a9f2-ec67a081401e
Apr 09 12:44:03 devstack sudo[84879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:04 devstack sudo[84878]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-c01bad0b-9ea0-46f0-9ad0-1a3047bc601f req-a60ae0de-034e-4c65-8b82-f12cd0304a0f tempest-DeleteServersTestJSON-830079198 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-99fe9163-133e-4b81-b639-097d7329718d" returned: 0 in 0.807s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [req-c01bad0b-9ea0-46f0-9ad0-1a3047bc601f req-a60ae0de-034e-4c65-8b82-f12cd0304a0f tempest-DeleteServersTestJSON-830079198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.835s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:44:04 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-c01bad0b-9ea0-46f0-9ad0-1a3047bc601f req-a60ae0de-034e-4c65-8b82-f12cd0304a0f tempest-DeleteServersTestJSON-830079198 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5', 'name': 'volume-99fe9163-133e-4b81-b639-097d7329718d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '917a587d-90c6-4db6-9a52-b9c0bd2d943a', 'enforce_multipath': True} {{(pid=82760) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 09 12:44:04 devstack sudo[84879]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-06619bb1-683d-4ee6-861c-81ba918787da tempest-GroupSnapshotsTest-799393923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6927acc7-7704-4548-baa5-9486612aa40e.e1d59f62-cdf2-41b2-a9f2-ec67a081401e" returned: 0 in 0.805s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-06619bb1-683d-4ee6-861c-81ba918787da tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6927acc7-7704-4548-baa5-9486612aa40e.e1d59f62-cdf2-41b2-a9f2-ec67a081401e {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:04 devstack sudo[84888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6927acc7-7704-4548-baa5-9486612aa40e.e1d59f62-cdf2-41b2-a9f2-ec67a081401e
Apr 09 12:44:04 devstack sudo[84888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:04 devstack cinder-volume[82760]: INFO cinder.volume.manager [req-c01bad0b-9ea0-46f0-9ad0-1a3047bc601f req-a60ae0de-034e-4c65-8b82-f12cd0304a0f tempest-DeleteServersTestJSON-830079198 None] attachment_update completed successfully.
Apr 09 12:44:04 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-6a74d087-caae-4b2b-bc3a-c154d9ed1645 tempest-VolumeQuotasNegativeTestJSON-792394752 None] Acquiring lock "cinder-74700894-2c69-493d-877e-ae66b3875efb-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:44:04 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-6a74d087-caae-4b2b-bc3a-c154d9ed1645 tempest-VolumeQuotasNegativeTestJSON-792394752 None] Lock "cinder-74700894-2c69-493d-877e-ae66b3875efb-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:44:04 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-6a74d087-caae-4b2b-bc3a-c154d9ed1645 tempest-VolumeQuotasNegativeTestJSON-792394752 None] Acquiring lock "cinder-quobyte-74700894-2c69-493d-877e-ae66b3875efb" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:44:04 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-6a74d087-caae-4b2b-bc3a-c154d9ed1645 tempest-VolumeQuotasNegativeTestJSON-792394752 None] Lock "cinder-quobyte-74700894-2c69-493d-877e-ae66b3875efb" acquired by "delete_volume" :: waited 0.016s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:44:04 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[2800a68f-2000-4a02-b2ae-2d09cc358d66]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:44:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6a74d087-caae-4b2b-bc3a-c154d9ed1645 tempest-VolumeQuotasNegativeTestJSON-792394752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-74700894-2c69-493d-877e-ae66b3875efb {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:04 devstack sudo[84890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-74700894-2c69-493d-877e-ae66b3875efb
Apr 09 12:44:04 devstack sudo[84890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:04 devstack sudo[84888]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-06619bb1-683d-4ee6-861c-81ba918787da tempest-GroupSnapshotsTest-799393923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6927acc7-7704-4548-baa5-9486612aa40e.e1d59f62-cdf2-41b2-a9f2-ec67a081401e" returned: 0 in 0.590s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:05 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-06619bb1-683d-4ee6-861c-81ba918787da tempest-GroupSnapshotsTest-799393923 None] Lock "cinder-quobyte-e1d59f62-cdf2-41b2-a9f2-ec67a081401e" released by "_delete_snapshot" :: held 3.042s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:44:05 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-06619bb1-683d-4ee6-861c-81ba918787da tempest-GroupSnapshotsTest-799393923 None] Lock "cinder-quobyte-6927acc7-7704-4548-baa5-9486612aa40e" released by "delete_snapshot" :: held 3.080s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:44:05 devstack cinder-volume[82760]: WARNING cinder.quota [None req-06619bb1-683d-4ee6-861c-81ba918787da tempest-GroupSnapshotsTest-799393923 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1919430448 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1919430448, it is now deprecated. Please use the default quota class for default quota.
Apr 09 12:44:05 devstack cinder-volume[82760]: WARNING cinder.quota [None req-06619bb1-683d-4ee6-861c-81ba918787da tempest-GroupSnapshotsTest-799393923 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1919430448 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1919430448, it is now deprecated. Please use the default quota class for default quota.
Apr 09 12:44:05 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-06619bb1-683d-4ee6-861c-81ba918787da tempest-GroupSnapshotsTest-799393923 None] Created reservations ['ed84ccb3-7e6b-47a6-8d60-867b927a6cbb', '7be025e5-2daf-4302-8899-dce5f57181ad', '398bb8cf-0b2c-4bc8-9532-9f6977cd694f', '4a93ef90-d936-43fb-9819-c4a6c08dc464'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:44:05 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-06619bb1-683d-4ee6-861c-81ba918787da tempest-GroupSnapshotsTest-799393923 None] Created reservations ['f7976753-cd73-42b4-b542-c9bc963a55fd', '5fc5aae6-d11c-4feb-8ea2-ee1319d2480c', 'ccb6d99c-3c59-46fc-99b6-5911bc559537', 'cedcc0ff-18aa-4ed5-9904-fc86b7342f83'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:44:05 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-06619bb1-683d-4ee6-861c-81ba918787da tempest-GroupSnapshotsTest-799393923 None] group_snapshot 4103d4d1-c669-41f5-9016-8d8950f2e6ec: deleted successfully
Apr 09 12:44:05 devstack sudo[84890]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6a74d087-caae-4b2b-bc3a-c154d9ed1645 tempest-VolumeQuotasNegativeTestJSON-792394752 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-74700894-2c69-493d-877e-ae66b3875efb" returned: 0 in 0.615s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6a74d087-caae-4b2b-bc3a-c154d9ed1645 tempest-VolumeQuotasNegativeTestJSON-792394752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-74700894-2c69-493d-877e-ae66b3875efb {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:05 devstack sudo[84896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-74700894-2c69-493d-877e-ae66b3875efb
Apr 09 12:44:05 devstack sudo[84896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:05 devstack sudo[84896]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6a74d087-caae-4b2b-bc3a-c154d9ed1645 tempest-VolumeQuotasNegativeTestJSON-792394752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-74700894-2c69-493d-877e-ae66b3875efb" returned: 0 in 0.504s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:05 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-6a74d087-caae-4b2b-bc3a-c154d9ed1645 tempest-VolumeQuotasNegativeTestJSON-792394752 None] Lock "cinder-quobyte-74700894-2c69-493d-877e-ae66b3875efb" released by "delete_volume" :: held 1.152s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:44:05 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-6a74d087-caae-4b2b-bc3a-c154d9ed1645 tempest-VolumeQuotasNegativeTestJSON-792394752 None] Created reservations ['7958f7b4-3a30-4775-b624-c2b1fa9355b4', '214f9a9d-313d-4158-8765-1a532344a393', '19773272-f816-4735-b30d-ebba8ca97f06', '86e99722-7e9e-415e-ad2e-a87828cb704b'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:44:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-6a74d087-caae-4b2b-bc3a-c154d9ed1645 tempest-VolumeQuotasNegativeTestJSON-792394752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:44:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-6a74d087-caae-4b2b-bc3a-c154d9ed1645 tempest-VolumeQuotasNegativeTestJSON-792394752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:44:05 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-6a74d087-caae-4b2b-bc3a-c154d9ed1645 tempest-VolumeQuotasNegativeTestJSON-792394752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:44:05 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-6a74d087-caae-4b2b-bc3a-c154d9ed1645 tempest-VolumeQuotasNegativeTestJSON-792394752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:44:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-6a74d087-caae-4b2b-bc3a-c154d9ed1645 tempest-VolumeQuotasNegativeTestJSON-792394752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:44:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6a74d087-caae-4b2b-bc3a-c154d9ed1645 tempest-VolumeQuotasNegativeTestJSON-792394752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:05 devstack sudo[84903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:44:05 devstack sudo[84903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:06 devstack sudo[84903]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:06 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6a74d087-caae-4b2b-bc3a-c154d9ed1645 tempest-VolumeQuotasNegativeTestJSON-792394752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.492s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:06 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-6a74d087-caae-4b2b-bc3a-c154d9ed1645 tempest-VolumeQuotasNegativeTestJSON-792394752 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:44:06 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-6a74d087-caae-4b2b-bc3a-c154d9ed1645 tempest-VolumeQuotasNegativeTestJSON-792394752 None] Deleted volume successfully.
Apr 09 12:44:06 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-6a74d087-caae-4b2b-bc3a-c154d9ed1645 tempest-VolumeQuotasNegativeTestJSON-792394752 None] Lock "cinder-74700894-2c69-493d-877e-ae66b3875efb-delete_volume" released by "delete_volume" :: held 1.831s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:44:06 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-67cfdb82-3847-4326-9ea3-dbb342bd5083 tempest-GroupSnapshotsTest-799393923 None] Acquiring lock "cinder-quobyte-6927acc7-7704-4548-baa5-9486612aa40e" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:44:06 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-67cfdb82-3847-4326-9ea3-dbb342bd5083 tempest-GroupSnapshotsTest-799393923 None] Lock "cinder-quobyte-6927acc7-7704-4548-baa5-9486612aa40e" acquired by "delete_volume" :: waited 0.013s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:44:06 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfaad0f3-7702-4ec7-8b0c-6e59140cadc0]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:44:06 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-67cfdb82-3847-4326-9ea3-dbb342bd5083 tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6927acc7-7704-4548-baa5-9486612aa40e {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:06 devstack sudo[84907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6927acc7-7704-4548-baa5-9486612aa40e
Apr 09 12:44:06 devstack sudo[84907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:07 devstack sudo[84907]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:07 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-67cfdb82-3847-4326-9ea3-dbb342bd5083 tempest-GroupSnapshotsTest-799393923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6927acc7-7704-4548-baa5-9486612aa40e" returned: 0 in 0.895s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:07 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-67cfdb82-3847-4326-9ea3-dbb342bd5083 tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6927acc7-7704-4548-baa5-9486612aa40e {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:07 devstack sudo[84913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6927acc7-7704-4548-baa5-9486612aa40e
Apr 09 12:44:07 devstack sudo[84913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:08 devstack sudo[84913]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-67cfdb82-3847-4326-9ea3-dbb342bd5083 tempest-GroupSnapshotsTest-799393923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6927acc7-7704-4548-baa5-9486612aa40e" returned: 0 in 1.366s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:08 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-67cfdb82-3847-4326-9ea3-dbb342bd5083 tempest-GroupSnapshotsTest-799393923 None] Lock "cinder-quobyte-6927acc7-7704-4548-baa5-9486612aa40e" released by "delete_volume" :: held 2.303s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:44:08 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-67cfdb82-3847-4326-9ea3-dbb342bd5083 tempest-GroupSnapshotsTest-799393923 None] Acquiring lock "cinder-quobyte-882c049d-c8cf-4e3b-8b48-ca60830b3749" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:44:08 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-67cfdb82-3847-4326-9ea3-dbb342bd5083 tempest-GroupSnapshotsTest-799393923 None] Lock "cinder-quobyte-882c049d-c8cf-4e3b-8b48-ca60830b3749" acquired by "delete_volume" :: waited 0.031s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:44:08 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23e41c0-86a5-46c0-bcd1-26f4ae1f645f]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:44:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-67cfdb82-3847-4326-9ea3-dbb342bd5083 tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-882c049d-c8cf-4e3b-8b48-ca60830b3749 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:09 devstack sudo[84918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-882c049d-c8cf-4e3b-8b48-ca60830b3749
Apr 09 12:44:09 devstack sudo[84918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:09 devstack cinder-volume[82760]: DEBUG oslo_service.periodic_task [None req-f8337202-8290-4658-916e-19cfa929172e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82760) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 09 12:44:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f8337202-8290-4658-916e-19cfa929172e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:44:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f8337202-8290-4658-916e-19cfa929172e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:44:09 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f8337202-8290-4658-916e-19cfa929172e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:44:09 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f8337202-8290-4658-916e-19cfa929172e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:44:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f8337202-8290-4658-916e-19cfa929172e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:44:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f8337202-8290-4658-916e-19cfa929172e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:09 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:44:09 devstack sudo[84921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:44:09 devstack sudo[84921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:09 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Flow 'volume_create_manager' (aa6a4e50-893e-4350-bb03-fac43ac6f5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:44:09 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7db55328-6184-4302-b83d-347dfa63a601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:44:09 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7db55328-6184-4302-b83d-347dfa63a601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:44:09Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31ef3ffc-4c27-44fd-b99b-b78f93aef1c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e15791107f854be98ddb925641896e75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:44:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:44:09Z,use_quota=True,user_id='9222dcc8f09740c8a8505ce9bf7d5888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:44:09 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff5fa32c-f095-4b22-8741-011ecb6bac33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:44:09 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff5fa32c-f095-4b22-8741-011ecb6bac33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:44:09 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fff01398-7d04-4bb1-9043-daf73321fb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:44:09 devstack cinder-volume[82760]: DEBUG cinder.image.glance [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Creating Keystone auth plugin from conf {{(pid=82760) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 09 12:44:10 devstack sudo[84918]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-67cfdb82-3847-4326-9ea3-dbb342bd5083 tempest-GroupSnapshotsTest-799393923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-882c049d-c8cf-4e3b-8b48-ca60830b3749" returned: 0 in 1.235s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-67cfdb82-3847-4326-9ea3-dbb342bd5083 tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-882c049d-c8cf-4e3b-8b48-ca60830b3749 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:10 devstack sudo[84932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-882c049d-c8cf-4e3b-8b48-ca60830b3749
Apr 09 12:44:10 devstack sudo[84932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:10 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fff01398-7d04-4bb1-9043-daf73321fb25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '31ef3ffc-4c27-44fd-b99b-b78f93aef1c7', 'volume_name': 'volume-31ef3ffc-4c27-44fd-b99b-b78f93aef1c7', 'volume_size': 1, 'image_id': '11bf303b-adca-49d8-8d80-d4a3c72e719a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11bf303b-adca-49d8-8d80-d4a3c72e719a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c43b4928ecdf4421ad23e5f918ea33fe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '11bf303b-adca-49d8-8d80-d4a3c72e719a', 'created_at': datetime.datetime(2026, 4, 9, 10, 38, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 10, 38, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11bf303b-adca-49d8-8d80-d4a3c72e719a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f378dfb6fb0>}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:44:10 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2e2c0d8-8a2a-4b78-8479-19d2b3b3fcf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:44:10 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2e2c0d8-8a2a-4b78-8479-19d2b3b3fcf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:44:10 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56739fc4-fd5e-4a85-85db-7891fb9027f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:44:10 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Volume 31ef3ffc-4c27-44fd-b99b-b78f93aef1c7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-31ef3ffc-4c27-44fd-b99b-b78f93aef1c7', 'volume_size': 1, 'image_id': '11bf303b-adca-49d8-8d80-d4a3c72e719a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11bf303b-adca-49d8-8d80-d4a3c72e719a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c43b4928ecdf4421ad23e5f918ea33fe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '11bf303b-adca-49d8-8d80-d4a3c72e719a', 'created_at': datetime.datetime(2026, 4, 9, 10, 38, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 10, 38, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11bf303b-adca-49d8-8d80-d4a3c72e719a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f378dfb6fb0>}
Apr 09 12:44:10 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Trying to clone 31ef3ffc-4c27-44fd-b99b-b78f93aef1c7 from image 11bf303b-adca-49d8-8d80-d4a3c72e719a at location (None, [{'url': 'file:///opt/stack/data/glance/images/11bf303b-adca-49d8-8d80-d4a3c72e719a', 'metadata': {}}]). {{(pid=82760) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 09 12:44:10 devstack cinder-volume[82760]: DEBUG cinder.image.image_utils [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_11bf303b-adca-49d8-8d80-d4a3c72e719a_tzehpxiidevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82760) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 09 12:44:10 devstack sudo[84921]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:10 devstack cinder-volume[82760]: INFO cinder.image.image_utils [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Image download 20.69 MB at 20.69 MB/s
Apr 09 12:44:10 devstack sudo[84932]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f8337202-8290-4658-916e-19cfa929172e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 1.425s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:10 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-f8337202-8290-4658-916e-19cfa929172e None None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:44:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-67cfdb82-3847-4326-9ea3-dbb342bd5083 tempest-GroupSnapshotsTest-799393923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-882c049d-c8cf-4e3b-8b48-ca60830b3749" returned: 0 in 0.756s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:10 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-67cfdb82-3847-4326-9ea3-dbb342bd5083 tempest-GroupSnapshotsTest-799393923 None] Lock "cinder-quobyte-882c049d-c8cf-4e3b-8b48-ca60830b3749" released by "delete_volume" :: held 2.033s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:44:10 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[76236433-6cd8-4f98-9a76-dc2480ce1f14]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:44:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11bf303b-adca-49d8-8d80-d4a3c72e719a_tzehpxiidevstack@QuobyteHD {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:10 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-67cfdb82-3847-4326-9ea3-dbb342bd5083 tempest-GroupSnapshotsTest-799393923 None] Created reservations ['0bffdae5-76a0-43e6-9a76-44cd00bb45d4'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:44:10 devstack cinder-volume[82760]: WARNING cinder.quota [None req-67cfdb82-3847-4326-9ea3-dbb342bd5083 tempest-GroupSnapshotsTest-799393923 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1919430448 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1919430448, it is now deprecated. Please use the default quota class for default quota.
Apr 09 12:44:10 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-67cfdb82-3847-4326-9ea3-dbb342bd5083 tempest-GroupSnapshotsTest-799393923 None] Created reservations ['826de46d-e3a2-4747-9612-e008e423e502', '07c9e225-ac7c-43aa-933d-5a4e3d236ffc', '91828ee9-4587-42ac-bb7d-51a4707bbfaa', '5663c873-56bf-4cc5-b1e2-d080852ba528'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:44:11 devstack sudo[84977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11bf303b-adca-49d8-8d80-d4a3c72e719a_tzehpxiidevstack@QuobyteHD
Apr 09 12:44:11 devstack sudo[84977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:11 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-67cfdb82-3847-4326-9ea3-dbb342bd5083 tempest-GroupSnapshotsTest-799393923 None] Created reservations ['61effc30-2866-4052-a383-d332147bec5b', '798bd9e8-c695-48fb-bb17-20ee4b3ad871', '188b4765-f346-40a1-824f-9ba8a50825ea', '3c64cf93-d50e-4c40-8108-081990d4be6a'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:44:11 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-67cfdb82-3847-4326-9ea3-dbb342bd5083 tempest-GroupSnapshotsTest-799393923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:44:11 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-67cfdb82-3847-4326-9ea3-dbb342bd5083 tempest-GroupSnapshotsTest-799393923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:44:11 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-67cfdb82-3847-4326-9ea3-dbb342bd5083 tempest-GroupSnapshotsTest-799393923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:44:11 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-67cfdb82-3847-4326-9ea3-dbb342bd5083 tempest-GroupSnapshotsTest-799393923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:44:11 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-67cfdb82-3847-4326-9ea3-dbb342bd5083 tempest-GroupSnapshotsTest-799393923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:44:11 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-67cfdb82-3847-4326-9ea3-dbb342bd5083 tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:11 devstack sudo[84980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:44:11 devstack sudo[84980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:11 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-16b2a79d-534a-4772-946c-cade4c64ed41 tempest-GroupSnapshotsTest-799393923 None] Group tempest-GroupSnapshotsTest-Group-767217826: creating
Apr 09 12:44:12 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-16b2a79d-534a-4772-946c-cade4c64ed41 tempest-GroupSnapshotsTest-799393923 None] Group tempest-GroupSnapshotsTest-Group-767217826: created successfully
Apr 09 12:44:12 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-16b2a79d-534a-4772-946c-cade4c64ed41 tempest-GroupSnapshotsTest-799393923 None] Create group completed successfully.
Apr 09 12:44:12 devstack sudo[84977]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:12 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11bf303b-adca-49d8-8d80-d4a3c72e719a_tzehpxiidevstack@QuobyteHD" returned: 0 in 1.304s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:12 devstack cinder-volume[82760]: DEBUG cinder.image.image_utils [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Temporary image 11bf303b-adca-49d8-8d80-d4a3c72e719a is fetched for user 9222dcc8f09740c8a8505ce9bf7d5888. {{(pid=82760) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 09 12:44:12 devstack sudo[84980]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:12 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-67cfdb82-3847-4326-9ea3-dbb342bd5083 tempest-GroupSnapshotsTest-799393923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.873s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:12 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-67cfdb82-3847-4326-9ea3-dbb342bd5083 tempest-GroupSnapshotsTest-799393923 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:44:12 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-67cfdb82-3847-4326-9ea3-dbb342bd5083 tempest-GroupSnapshotsTest-799393923 None] Delete group completed successfully.
Apr 09 12:44:12 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[78494ff7-b72b-4075-9082-3a328cd8873c]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:44:12 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11bf303b-adca-49d8-8d80-d4a3c72e719a_tzehpxiidevstack@QuobyteHD {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:12 devstack sudo[84988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11bf303b-adca-49d8-8d80-d4a3c72e719a_tzehpxiidevstack@QuobyteHD
Apr 09 12:44:12 devstack sudo[84988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:12 devstack sudo[84988]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:12 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11bf303b-adca-49d8-8d80-d4a3c72e719a_tzehpxiidevstack@QuobyteHD" returned: 0 in 0.687s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:12 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:44:12 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:44:12 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:44:09Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31ef3ffc-4c27-44fd-b99b-b78f93aef1c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e15791107f854be98ddb925641896e75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:44:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:44:09Z,use_quota=True,user_id='9222dcc8f09740c8a8505ce9bf7d5888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:44:12 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Creating volume 31ef3ffc-4c27-44fd-b99b-b78f93aef1c7 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:44:12 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:44:12 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:44:12 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:44:13 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:44:13 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:44:13 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:44:13 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:44:13 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-31ef3ffc-4c27-44fd-b99b-b78f93aef1c7 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:13 devstack sudo[84998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-31ef3ffc-4c27-44fd-b99b-b78f93aef1c7 1073741824
Apr 09 12:44:13 devstack sudo[84998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:13 devstack cinder-volume[82760]: INFO cinder.volume.manager [req-371aa698-5f65-44d9-ac5b-cfc304f86aee req-319213d5-06f3-4a55-beac-3aa06b3a09d4 tempest-DeleteServersTestJSON-830079198 None] Terminate volume connection completed successfully.
Apr 09 12:44:13 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-371aa698-5f65-44d9-ac5b-cfc304f86aee req-319213d5-06f3-4a55-beac-3aa06b3a09d4 tempest-DeleteServersTestJSON-830079198 None] Deleting attachment 917a587d-90c6-4db6-9a52-b9c0bd2d943a. {{(pid=82760) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 09 12:44:13 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-68ee9522-bf3b-42e9-b870-03964972998a tempest-GroupSnapshotsTest-799393923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:44:13 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-68ee9522-bf3b-42e9-b870-03964972998a tempest-GroupSnapshotsTest-799393923 None] Flow 'volume_create_manager' (2b0a9809-db27-4c7d-9b60-d48051b57c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:44:13 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-68ee9522-bf3b-42e9-b870-03964972998a tempest-GroupSnapshotsTest-799393923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40440d8b-90b3-48a1-81d4-00a71444ccb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:44:13 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-68ee9522-bf3b-42e9-b870-03964972998a tempest-GroupSnapshotsTest-799393923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40440d8b-90b3-48a1-81d4-00a71444ccb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:44:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1509226681',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=232afa62-107e-4a53-bec7-b9b0a2a065ba,host='devstack@QuobyteHD#QuobyteHD',id=546f45ef-5886-4583-be42-893c03816e1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83e45adb00064a50a6989c331c3a5d5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:44:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:44:13Z,use_quota=True,user_id='1b822ed89860427ab9cc8837876445e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(047656fe-a8d2-48dd-beec-74ca29c32437),volume_type_id=047656fe-a8d2-48dd-beec-74ca29c32437)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:44:13 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-68ee9522-bf3b-42e9-b870-03964972998a tempest-GroupSnapshotsTest-799393923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1267bec1-e7a1-4b38-b848-1da361509627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:44:13 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-68ee9522-bf3b-42e9-b870-03964972998a tempest-GroupSnapshotsTest-799393923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1267bec1-e7a1-4b38-b848-1da361509627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:44:13 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-68ee9522-bf3b-42e9-b870-03964972998a tempest-GroupSnapshotsTest-799393923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4437a7f-bb39-4539-b0b1-91accc396ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:44:13 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-68ee9522-bf3b-42e9-b870-03964972998a tempest-GroupSnapshotsTest-799393923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4437a7f-bb39-4539-b0b1-91accc396ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '546f45ef-5886-4583-be42-893c03816e1d', 'volume_name': 'volume-546f45ef-5886-4583-be42-893c03816e1d', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:44:13 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-68ee9522-bf3b-42e9-b870-03964972998a tempest-GroupSnapshotsTest-799393923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26623a38-a172-4b0f-a01d-8b0bfefcf01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:44:13 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-68ee9522-bf3b-42e9-b870-03964972998a tempest-GroupSnapshotsTest-799393923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26623a38-a172-4b0f-a01d-8b0bfefcf01b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:44:13 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-68ee9522-bf3b-42e9-b870-03964972998a tempest-GroupSnapshotsTest-799393923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fac268e-8181-4576-95c3-131ff84531d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:44:13 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-68ee9522-bf3b-42e9-b870-03964972998a tempest-GroupSnapshotsTest-799393923 None] Volume 546f45ef-5886-4583-be42-893c03816e1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-546f45ef-5886-4583-be42-893c03816e1d', 'volume_size': 1}
Apr 09 12:44:13 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-68ee9522-bf3b-42e9-b870-03964972998a tempest-GroupSnapshotsTest-799393923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:44:13 devstack sudo[84998]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:13 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-31ef3ffc-4c27-44fd-b99b-b78f93aef1c7 1073741824" returned: 0 in 0.660s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:13 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-31ef3ffc-4c27-44fd-b99b-b78f93aef1c7 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:13 devstack sudo[85003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-31ef3ffc-4c27-44fd-b99b-b78f93aef1c7
Apr 09 12:44:13 devstack sudo[85003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:13 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-32c23c33-b39e-4f79-92cc-3668b5d1dc8f tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:44:13 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-32c23c33-b39e-4f79-92cc-3668b5d1dc8f tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] Flow 'volume_create_manager' (a79019f4-346a-4d6a-8546-124a4749941b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:44:13 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-32c23c33-b39e-4f79-92cc-3668b5d1dc8f tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16c5be2e-bdfb-4880-a325-b80effcb52ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:44:13 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-32c23c33-b39e-4f79-92cc-3668b5d1dc8f tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16c5be2e-bdfb-4880-a325-b80effcb52ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:44:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1241543591',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=400271fb-6c61-48bc-a63e-bbe8a00e466d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d132eee224b40a1ab5400932421d4a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:44:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:44:14Z,use_quota=True,user_id='9aa8a760a5134daca6d2b801f1d8c762',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aac4359c-e90a-48f7-86db-91af8f79ef6d),volume_type_id=aac4359c-e90a-48f7-86db-91af8f79ef6d)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:44:13 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-32c23c33-b39e-4f79-92cc-3668b5d1dc8f tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceccc773-b1a9-4af1-b910-7c4519c0eee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:44:13 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-32c23c33-b39e-4f79-92cc-3668b5d1dc8f tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceccc773-b1a9-4af1-b910-7c4519c0eee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:44:13 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-32c23c33-b39e-4f79-92cc-3668b5d1dc8f tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0544d9f-7dd3-4f5c-a55e-11a8c3b0e515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:44:13 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-32c23c33-b39e-4f79-92cc-3668b5d1dc8f tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0544d9f-7dd3-4f5c-a55e-11a8c3b0e515) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '400271fb-6c61-48bc-a63e-bbe8a00e466d', 'volume_name': 'volume-400271fb-6c61-48bc-a63e-bbe8a00e466d', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:44:13 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-32c23c33-b39e-4f79-92cc-3668b5d1dc8f tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dee8461-f8b3-4d40-a412-9e044c11967a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:44:13 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-32c23c33-b39e-4f79-92cc-3668b5d1dc8f tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dee8461-f8b3-4d40-a412-9e044c11967a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:44:13 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-32c23c33-b39e-4f79-92cc-3668b5d1dc8f tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01ece21a-61ff-4b7b-9acc-7a2ab3465ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:44:13 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-32c23c33-b39e-4f79-92cc-3668b5d1dc8f tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] Volume 400271fb-6c61-48bc-a63e-bbe8a00e466d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-400271fb-6c61-48bc-a63e-bbe8a00e466d', 'volume_size': 1}
Apr 09 12:44:13 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-32c23c33-b39e-4f79-92cc-3668b5d1dc8f tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:44:14 devstack sudo[85003]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-31ef3ffc-4c27-44fd-b99b-b78f93aef1c7" returned: 0 in 0.519s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:14 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] <== create_volume: return (1219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:44:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:44:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-68ee9522-bf3b-42e9-b870-03964972998a tempest-GroupSnapshotsTest-799393923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.745s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:44:14 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-68ee9522-bf3b-42e9-b870-03964972998a tempest-GroupSnapshotsTest-799393923 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=232afa62-107e-4a53-bec7-b9b0a2a065ba,created_at=2026-04-09T10:44:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1509226681',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=232afa62-107e-4a53-bec7-b9b0a2a065ba,host='devstack@QuobyteHD#QuobyteHD',id=546f45ef-5886-4583-be42-893c03816e1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83e45adb00064a50a6989c331c3a5d5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:44:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:44:13Z,use_quota=True,user_id='1b822ed89860427ab9cc8837876445e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(047656fe-a8d2-48dd-beec-74ca29c32437),volume_type_id=047656fe-a8d2-48dd-beec-74ca29c32437)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:44:14 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-68ee9522-bf3b-42e9-b870-03964972998a tempest-GroupSnapshotsTest-799393923 None] Creating volume 546f45ef-5886-4583-be42-893c03816e1d {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:44:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-68ee9522-bf3b-42e9-b870-03964972998a tempest-GroupSnapshotsTest-799393923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:44:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-68ee9522-bf3b-42e9-b870-03964972998a tempest-GroupSnapshotsTest-799393923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:44:14 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-68ee9522-bf3b-42e9-b870-03964972998a tempest-GroupSnapshotsTest-799393923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:44:14 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-68ee9522-bf3b-42e9-b870-03964972998a tempest-GroupSnapshotsTest-799393923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:44:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-68ee9522-bf3b-42e9-b870-03964972998a tempest-GroupSnapshotsTest-799393923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:44:14 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-68ee9522-bf3b-42e9-b870-03964972998a tempest-GroupSnapshotsTest-799393923 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:44:14 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-68ee9522-bf3b-42e9-b870-03964972998a tempest-GroupSnapshotsTest-799393923 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:44:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-68ee9522-bf3b-42e9-b870-03964972998a tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-546f45ef-5886-4583-be42-893c03816e1d 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:14 devstack sudo[85006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-546f45ef-5886-4583-be42-893c03816e1d 1073741824
Apr 09 12:44:14 devstack sudo[85006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:14 devstack cinder-volume[82760]: DEBUG cinder.volume.volume_utils [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Attempting download of 11bf303b-adca-49d8-8d80-d4a3c72e719a ((None, [{'url': 'file:///opt/stack/data/glance/images/11bf303b-adca-49d8-8d80-d4a3c72e719a', 'metadata': {}}])) to volume 31ef3ffc-4c27-44fd-b99b-b78f93aef1c7. {{(pid=82760) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 09 12:44:14 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[45fe785a-553b-4753-8c5c-8441b76ba94a]: (4, 'raw') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:44:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11bf303b-adca-49d8-8d80-d4a3c72e719a_09923goo {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:14 devstack sudo[85008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11bf303b-adca-49d8-8d80-d4a3c72e719a_09923goo
Apr 09 12:44:14 devstack sudo[85008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:14 devstack sudo[85006]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-68ee9522-bf3b-42e9-b870-03964972998a tempest-GroupSnapshotsTest-799393923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-546f45ef-5886-4583-be42-893c03816e1d 1073741824" returned: 0 in 0.568s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-68ee9522-bf3b-42e9-b870-03964972998a tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-546f45ef-5886-4583-be42-893c03816e1d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:14 devstack sudo[85015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-546f45ef-5886-4583-be42-893c03816e1d
Apr 09 12:44:14 devstack sudo[85015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:14 devstack sudo[85008]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11bf303b-adca-49d8-8d80-d4a3c72e719a_09923goo" returned: 0 in 0.572s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11bf303b-adca-49d8-8d80-d4a3c72e719a_09923goo {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:14 devstack sudo[85017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11bf303b-adca-49d8-8d80-d4a3c72e719a_09923goo
Apr 09 12:44:14 devstack sudo[85017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:15 devstack sudo[85015]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:15 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-68ee9522-bf3b-42e9-b870-03964972998a tempest-GroupSnapshotsTest-799393923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-546f45ef-5886-4583-be42-893c03816e1d" returned: 0 in 0.483s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:15 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-68ee9522-bf3b-42e9-b870-03964972998a tempest-GroupSnapshotsTest-799393923 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:44:15 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-68ee9522-bf3b-42e9-b870-03964972998a tempest-GroupSnapshotsTest-799393923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:44:15 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-32c23c33-b39e-4f79-92cc-3668b5d1dc8f tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.439s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:44:15 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-32c23c33-b39e-4f79-92cc-3668b5d1dc8f tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:44:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1241543591',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=400271fb-6c61-48bc-a63e-bbe8a00e466d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d132eee224b40a1ab5400932421d4a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:44:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:44:14Z,use_quota=True,user_id='9aa8a760a5134daca6d2b801f1d8c762',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aac4359c-e90a-48f7-86db-91af8f79ef6d),volume_type_id=aac4359c-e90a-48f7-86db-91af8f79ef6d)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:44:15 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-32c23c33-b39e-4f79-92cc-3668b5d1dc8f tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] Creating volume 400271fb-6c61-48bc-a63e-bbe8a00e466d {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:44:15 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-32c23c33-b39e-4f79-92cc-3668b5d1dc8f tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:44:15 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-32c23c33-b39e-4f79-92cc-3668b5d1dc8f tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:44:15 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-32c23c33-b39e-4f79-92cc-3668b5d1dc8f tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:44:15 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-32c23c33-b39e-4f79-92cc-3668b5d1dc8f tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:44:15 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-32c23c33-b39e-4f79-92cc-3668b5d1dc8f tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:44:15 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-32c23c33-b39e-4f79-92cc-3668b5d1dc8f tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:44:15 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-32c23c33-b39e-4f79-92cc-3668b5d1dc8f tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:44:15 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-32c23c33-b39e-4f79-92cc-3668b5d1dc8f tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-400271fb-6c61-48bc-a63e-bbe8a00e466d 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:15 devstack sudo[85023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-400271fb-6c61-48bc-a63e-bbe8a00e466d 1073741824
Apr 09 12:44:15 devstack sudo[85023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-68ee9522-bf3b-42e9-b870-03964972998a tempest-GroupSnapshotsTest-799393923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fac268e-8181-4576-95c3-131ff84531d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-546f45ef-5886-4583-be42-893c03816e1d', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:44:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-68ee9522-bf3b-42e9-b870-03964972998a tempest-GroupSnapshotsTest-799393923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2788dc8-0f7d-4cbf-8515-aa33f9b873c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:44:15 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-68ee9522-bf3b-42e9-b870-03964972998a tempest-GroupSnapshotsTest-799393923 None] Volume volume-546f45ef-5886-4583-be42-893c03816e1d (546f45ef-5886-4583-be42-893c03816e1d): created successfully
Apr 09 12:44:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-68ee9522-bf3b-42e9-b870-03964972998a tempest-GroupSnapshotsTest-799393923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2788dc8-0f7d-4cbf-8515-aa33f9b873c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:44:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-68ee9522-bf3b-42e9-b870-03964972998a tempest-GroupSnapshotsTest-799393923 None] Flow 'volume_create_manager' (2b0a9809-db27-4c7d-9b60-d48051b57c77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:44:15 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-68ee9522-bf3b-42e9-b870-03964972998a tempest-GroupSnapshotsTest-799393923 None] Created volume successfully.
Apr 09 12:44:15 devstack sudo[85017]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:15 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11bf303b-adca-49d8-8d80-d4a3c72e719a_09923goo" returned: 1 in 0.585s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:15 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11bf303b-adca-49d8-8d80-d4a3c72e719a_09923goo' failed. Not Retrying. {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 09 12:44:15 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[972073e9-351f-4a92-9365-b017ce9e1e91]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:44:15 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11bf303b-adca-49d8-8d80-d4a3c72e719a_tzehpxiidevstack@QuobyteHD {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:15 devstack sudo[85025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11bf303b-adca-49d8-8d80-d4a3c72e719a_tzehpxiidevstack@QuobyteHD
Apr 09 12:44:15 devstack sudo[85025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:15 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-601c963f-8141-476a-95d5-e5f3f219ef52 tempest-GroupSnapshotsTest-799393923 None] GroupSnapshot d17c42c2-efdb-4a58-bff4-3601fded38f4: creating.
Apr 09 12:44:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-601c963f-8141-476a-95d5-e5f3f219ef52 tempest-GroupSnapshotsTest-799393923 None] Group snapshot d17c42c2-efdb-4a58-bff4-3601fded38f4: creating. {{(pid=82760) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 09 12:44:15 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-601c963f-8141-476a-95d5-e5f3f219ef52 tempest-GroupSnapshotsTest-799393923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:44:16 devstack sudo[85023]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:16 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-32c23c33-b39e-4f79-92cc-3668b5d1dc8f tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-400271fb-6c61-48bc-a63e-bbe8a00e466d 1073741824" returned: 0 in 0.690s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:16 devstack sudo[85025]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:16 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11bf303b-adca-49d8-8d80-d4a3c72e719a_tzehpxiidevstack@QuobyteHD" returned: 0 in 0.577s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:16 devstack cinder-volume[82760]: DEBUG cinder.image.image_utils [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] 11bf303b-adca-49d8-8d80-d4a3c72e719a was qcow2, converting to raw {{(pid=82760) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 09 12:44:16 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_11bf303b-adca-49d8-8d80-d4a3c72e719a_tzehpxiidevstack@QuobyteHD /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-31ef3ffc-4c27-44fd-b99b-b78f93aef1c7 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:16 devstack sudo[85035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_11bf303b-adca-49d8-8d80-d4a3c72e719a_tzehpxiidevstack@QuobyteHD /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-31ef3ffc-4c27-44fd-b99b-b78f93aef1c7
Apr 09 12:44:16 devstack sudo[85035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:16 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-32c23c33-b39e-4f79-92cc-3668b5d1dc8f tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-400271fb-6c61-48bc-a63e-bbe8a00e466d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:16 devstack sudo[85037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-400271fb-6c61-48bc-a63e-bbe8a00e466d
Apr 09 12:44:16 devstack sudo[85037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:16 devstack sudo[85037]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:16 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-32c23c33-b39e-4f79-92cc-3668b5d1dc8f tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-400271fb-6c61-48bc-a63e-bbe8a00e466d" returned: 0 in 0.550s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:16 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-32c23c33-b39e-4f79-92cc-3668b5d1dc8f tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] <== create_volume: return (1298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:44:16 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-32c23c33-b39e-4f79-92cc-3668b5d1dc8f tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.302s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:44:16 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-601c963f-8141-476a-95d5-e5f3f219ef52 tempest-GroupSnapshotsTest-799393923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.941s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:44:16 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-601c963f-8141-476a-95d5-e5f3f219ef52 tempest-GroupSnapshotsTest-799393923 None] Creating offline snapshot 0b4fe0e1-e1a9-448c-8beb-bfc5a8dfe64d of volume 546f45ef-5886-4583-be42-893c03816e1d {{(pid=82760) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 12:44:16 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-32c23c33-b39e-4f79-92cc-3668b5d1dc8f tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01ece21a-61ff-4b7b-9acc-7a2ab3465ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-400271fb-6c61-48bc-a63e-bbe8a00e466d', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:44:16 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-32c23c33-b39e-4f79-92cc-3668b5d1dc8f tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27f595d1-5656-4975-87a5-8d959cfc7b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:44:16 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd494ac8-9dfa-4b12-838a-ea7d062b5796]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:44:16 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-601c963f-8141-476a-95d5-e5f3f219ef52 tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-546f45ef-5886-4583-be42-893c03816e1d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:16 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-32c23c33-b39e-4f79-92cc-3668b5d1dc8f tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] Volume volume-400271fb-6c61-48bc-a63e-bbe8a00e466d (400271fb-6c61-48bc-a63e-bbe8a00e466d): created successfully
Apr 09 12:44:16 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-32c23c33-b39e-4f79-92cc-3668b5d1dc8f tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27f595d1-5656-4975-87a5-8d959cfc7b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:44:16 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-32c23c33-b39e-4f79-92cc-3668b5d1dc8f tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] Flow 'volume_create_manager' (a79019f4-346a-4d6a-8546-124a4749941b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:44:16 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-32c23c33-b39e-4f79-92cc-3668b5d1dc8f tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] Created volume successfully.
Apr 09 12:44:16 devstack sudo[85065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-546f45ef-5886-4583-be42-893c03816e1d
Apr 09 12:44:16 devstack sudo[85065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:17 devstack sudo[85035]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:17 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_11bf303b-adca-49d8-8d80-d4a3c72e719a_tzehpxiidevstack@QuobyteHD /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-31ef3ffc-4c27-44fd-b99b-b78f93aef1c7" returned: 0 in 1.289s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:17 devstack cinder-volume[82760]: DEBUG cinder.image.image_utils [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_11bf303b-adca-49d8-8d80-d4a3c72e719a_tzehpxiidevstack@QuobyteHD, size 112.00 MB, duration 1.29 sec, destination /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-31ef3ffc-4c27-44fd-b99b-b78f93aef1c7 {{(pid=82760) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 12:44:17 devstack cinder-volume[82760]: INFO cinder.image.image_utils [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Converted 112.00 MB image at 86.51 MB/s
Apr 09 12:44:17 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-31ef3ffc-4c27-44fd-b99b-b78f93aef1c7 1G {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:17 devstack sudo[85070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-31ef3ffc-4c27-44fd-b99b-b78f93aef1c7 1G
Apr 09 12:44:17 devstack sudo[85070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:17 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-7f38d14f-fb5c-459b-a2e1-4d7b411492e4 tempest-DeleteServersTestJSON-830079198 None] Acquiring lock "cinder-99fe9163-133e-4b81-b639-097d7329718d-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:44:17 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-7f38d14f-fb5c-459b-a2e1-4d7b411492e4 tempest-DeleteServersTestJSON-830079198 None] Lock "cinder-99fe9163-133e-4b81-b639-097d7329718d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:44:17 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-7f38d14f-fb5c-459b-a2e1-4d7b411492e4 tempest-DeleteServersTestJSON-830079198 None] Acquiring lock "cinder-quobyte-99fe9163-133e-4b81-b639-097d7329718d" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:44:17 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-a4b4b094-faaf-494f-a01c-8906a6caa1e7 tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:44:17 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-a4b4b094-faaf-494f-a01c-8906a6caa1e7 tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:44:17 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-a4b4b094-faaf-494f-a01c-8906a6caa1e7 tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:44:17 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-a4b4b094-faaf-494f-a01c-8906a6caa1e7 tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:44:17 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-a4b4b094-faaf-494f-a01c-8906a6caa1e7 tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:44:17 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-a4b4b094-faaf-494f-a01c-8906a6caa1e7 tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:17 devstack sudo[85065]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:17 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-601c963f-8141-476a-95d5-e5f3f219ef52 tempest-GroupSnapshotsTest-799393923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-546f45ef-5886-4583-be42-893c03816e1d" returned: 0 in 0.805s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:17 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-601c963f-8141-476a-95d5-e5f3f219ef52 tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-546f45ef-5886-4583-be42-893c03816e1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-546f45ef-5886-4583-be42-893c03816e1d.0b4fe0e1-e1a9-448c-8beb-bfc5a8dfe64d 1G {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:17 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-7f38d14f-fb5c-459b-a2e1-4d7b411492e4 tempest-DeleteServersTestJSON-830079198 None] Lock "cinder-quobyte-99fe9163-133e-4b81-b639-097d7329718d" acquired by "delete_volume" :: waited 0.050s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:44:17 devstack sudo[85072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:44:17 devstack sudo[85072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:17 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[40940d34-8542-4a18-a1a0-bb382ff9b37f]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:44:17 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-7f38d14f-fb5c-459b-a2e1-4d7b411492e4 tempest-DeleteServersTestJSON-830079198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-99fe9163-133e-4b81-b639-097d7329718d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:17 devstack sudo[85073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-546f45ef-5886-4583-be42-893c03816e1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-546f45ef-5886-4583-be42-893c03816e1d.0b4fe0e1-e1a9-448c-8beb-bfc5a8dfe64d 1G
Apr 09 12:44:17 devstack sudo[85073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:17 devstack sudo[85075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-99fe9163-133e-4b81-b639-097d7329718d
Apr 09 12:44:17 devstack sudo[85075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:17 devstack sudo[85070]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:17 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-31ef3ffc-4c27-44fd-b99b-b78f93aef1c7 1G" returned: 0 in 0.603s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:17 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bfe0291-4ef1-4299-9080-a5345327bf16]: (4, 'raw') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:44:17 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-31ef3ffc-4c27-44fd-b99b-b78f93aef1c7 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:18 devstack sudo[85072]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-a4b4b094-faaf-494f-a01c-8906a6caa1e7 tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.639s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:18 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-a4b4b094-faaf-494f-a01c-8906a6caa1e7 tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:44:18 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-a4b4b094-faaf-494f-a01c-8906a6caa1e7 tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] Retype volume completed successfully.
Apr 09 12:44:18 devstack sudo[85081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-31ef3ffc-4c27-44fd-b99b-b78f93aef1c7
Apr 09 12:44:18 devstack sudo[85081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:18 devstack sudo[85075]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-7f38d14f-fb5c-459b-a2e1-4d7b411492e4 tempest-DeleteServersTestJSON-830079198 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-99fe9163-133e-4b81-b639-097d7329718d" returned: 0 in 0.687s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-7f38d14f-fb5c-459b-a2e1-4d7b411492e4 tempest-DeleteServersTestJSON-830079198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-99fe9163-133e-4b81-b639-097d7329718d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:18 devstack sudo[85090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-99fe9163-133e-4b81-b639-097d7329718d
Apr 09 12:44:18 devstack sudo[85090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:18 devstack sudo[85073]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-601c963f-8141-476a-95d5-e5f3f219ef52 tempest-GroupSnapshotsTest-799393923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-546f45ef-5886-4583-be42-893c03816e1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-546f45ef-5886-4583-be42-893c03816e1d.0b4fe0e1-e1a9-448c-8beb-bfc5a8dfe64d 1G" returned: 0 in 0.797s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-601c963f-8141-476a-95d5-e5f3f219ef52 tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-546f45ef-5886-4583-be42-893c03816e1d -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-546f45ef-5886-4583-be42-893c03816e1d.0b4fe0e1-e1a9-448c-8beb-bfc5a8dfe64d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:18 devstack sudo[85092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-546f45ef-5886-4583-be42-893c03816e1d -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-546f45ef-5886-4583-be42-893c03816e1d.0b4fe0e1-e1a9-448c-8beb-bfc5a8dfe64d
Apr 09 12:44:18 devstack sudo[85092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:18 devstack sudo[85090]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-7f38d14f-fb5c-459b-a2e1-4d7b411492e4 tempest-DeleteServersTestJSON-830079198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-99fe9163-133e-4b81-b639-097d7329718d" returned: 0 in 0.472s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:18 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-7f38d14f-fb5c-459b-a2e1-4d7b411492e4 tempest-DeleteServersTestJSON-830079198 None] Lock "cinder-quobyte-99fe9163-133e-4b81-b639-097d7329718d" released by "delete_volume" :: held 1.181s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:44:18 devstack sudo[85081]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-31ef3ffc-4c27-44fd-b99b-b78f93aef1c7" returned: 0 in 0.726s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-31ef3ffc-4c27-44fd-b99b-b78f93aef1c7 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:18 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-7f38d14f-fb5c-459b-a2e1-4d7b411492e4 tempest-DeleteServersTestJSON-830079198 None] Created reservations ['9ee6a367-656c-45ec-a255-f5aa703b07eb', '7d5a1023-d78f-4045-b15a-f787ba7987eb', 'ca71c41c-b2a1-43e6-ae26-d309658138f2', 'c1fbf2d5-5b57-43cb-a57a-75efd0f5370b'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:44:18 devstack sudo[85097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-31ef3ffc-4c27-44fd-b99b-b78f93aef1c7
Apr 09 12:44:18 devstack sudo[85097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:18 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-bfa167c6-f481-4717-ac83-a2392a55e574 tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] Acquiring lock "cinder-400271fb-6c61-48bc-a63e-bbe8a00e466d-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:44:18 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-bfa167c6-f481-4717-ac83-a2392a55e574 tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] Lock "cinder-400271fb-6c61-48bc-a63e-bbe8a00e466d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:44:18 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-bfa167c6-f481-4717-ac83-a2392a55e574 tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] Acquiring lock "cinder-quobyte-400271fb-6c61-48bc-a63e-bbe8a00e466d" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:44:18 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-bfa167c6-f481-4717-ac83-a2392a55e574 tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] Lock "cinder-quobyte-400271fb-6c61-48bc-a63e-bbe8a00e466d" acquired by "delete_volume" :: waited 0.009s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:44:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-7f38d14f-fb5c-459b-a2e1-4d7b411492e4 tempest-DeleteServersTestJSON-830079198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:44:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-7f38d14f-fb5c-459b-a2e1-4d7b411492e4 tempest-DeleteServersTestJSON-830079198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:44:18 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-7f38d14f-fb5c-459b-a2e1-4d7b411492e4 tempest-DeleteServersTestJSON-830079198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:44:18 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-7f38d14f-fb5c-459b-a2e1-4d7b411492e4 tempest-DeleteServersTestJSON-830079198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:44:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-7f38d14f-fb5c-459b-a2e1-4d7b411492e4 tempest-DeleteServersTestJSON-830079198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:44:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-7f38d14f-fb5c-459b-a2e1-4d7b411492e4 tempest-DeleteServersTestJSON-830079198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:18 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e7fa99-eb41-4ee9-8421-bf1b0655570b]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:44:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-bfa167c6-f481-4717-ac83-a2392a55e574 tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-400271fb-6c61-48bc-a63e-bbe8a00e466d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:18 devstack sudo[85099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:44:18 devstack sudo[85099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:19 devstack sudo[85101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-400271fb-6c61-48bc-a63e-bbe8a00e466d
Apr 09 12:44:19 devstack sudo[85101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:19 devstack sudo[85092]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-601c963f-8141-476a-95d5-e5f3f219ef52 tempest-GroupSnapshotsTest-799393923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-546f45ef-5886-4583-be42-893c03816e1d -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-546f45ef-5886-4583-be42-893c03816e1d.0b4fe0e1-e1a9-448c-8beb-bfc5a8dfe64d" returned: 0 in 0.825s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:19 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-601c963f-8141-476a-95d5-e5f3f219ef52 tempest-GroupSnapshotsTest-799393923 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-546f45ef-5886-4583-be42-893c03816e1d.0b4fe0e1-e1a9-448c-8beb-bfc5a8dfe64d is being set with open permissions: ugo+rw: NotImplementedError
Apr 09 12:44:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-601c963f-8141-476a-95d5-e5f3f219ef52 tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-546f45ef-5886-4583-be42-893c03816e1d.0b4fe0e1-e1a9-448c-8beb-bfc5a8dfe64d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:19 devstack sudo[85106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-546f45ef-5886-4583-be42-893c03816e1d.0b4fe0e1-e1a9-448c-8beb-bfc5a8dfe64d
Apr 09 12:44:19 devstack sudo[85106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:19 devstack sudo[85099]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-7f38d14f-fb5c-459b-a2e1-4d7b411492e4 tempest-DeleteServersTestJSON-830079198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.529s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:19 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-7f38d14f-fb5c-459b-a2e1-4d7b411492e4 tempest-DeleteServersTestJSON-830079198 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:44:19 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-7f38d14f-fb5c-459b-a2e1-4d7b411492e4 tempest-DeleteServersTestJSON-830079198 None] Deleted volume successfully.
Apr 09 12:44:19 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-7f38d14f-fb5c-459b-a2e1-4d7b411492e4 tempest-DeleteServersTestJSON-830079198 None] Lock "cinder-99fe9163-133e-4b81-b639-097d7329718d-delete_volume" released by "delete_volume" :: held 1.981s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:44:19 devstack sudo[85097]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-31ef3ffc-4c27-44fd-b99b-b78f93aef1c7" returned: 1 in 0.711s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-31ef3ffc-4c27-44fd-b99b-b78f93aef1c7' failed. Not Retrying. {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 09 12:44:19 devstack cinder-volume[82760]: DEBUG cinder.volume.volume_utils [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Downloaded image 11bf303b-adca-49d8-8d80-d4a3c72e719a ((None, [{'url': 'file:///opt/stack/data/glance/images/11bf303b-adca-49d8-8d80-d4a3c72e719a', 'metadata': {}}])) to volume 31ef3ffc-4c27-44fd-b99b-b78f93aef1c7 successfully. {{(pid=82760) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 09 12:44:19 devstack cinder-volume[82760]: DEBUG cinder.image.image_utils [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Temporary image 11bf303b-adca-49d8-8d80-d4a3c72e719a for user 9222dcc8f09740c8a8505ce9bf7d5888 is deleted. {{(pid=82760) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 09 12:44:19 devstack cinder-volume[82760]: DEBUG cinder.volume.volume_utils [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Marking volume 31ef3ffc-4c27-44fd-b99b-b78f93aef1c7 as bootable. {{(pid=82760) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 09 12:44:19 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Copying metadata from image 11bf303b-adca-49d8-8d80-d4a3c72e719a to 31ef3ffc-4c27-44fd-b99b-b78f93aef1c7. {{(pid=82760) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 09 12:44:19 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Creating volume glance metadata for volume 31ef3ffc-4c27-44fd-b99b-b78f93aef1c7 backed by image 11bf303b-adca-49d8-8d80-d4a3c72e719a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '11bf303b-adca-49d8-8d80-d4a3c72e719a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82760) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 09 12:44:19 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56739fc4-fd5e-4a85-85db-7891fb9027f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31ef3ffc-4c27-44fd-b99b-b78f93aef1c7', 'volume_size': 1, 'image_id': '11bf303b-adca-49d8-8d80-d4a3c72e719a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11bf303b-adca-49d8-8d80-d4a3c72e719a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c43b4928ecdf4421ad23e5f918ea33fe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '11bf303b-adca-49d8-8d80-d4a3c72e719a', 'created_at': datetime.datetime(2026, 4, 9, 10, 38, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 10, 38, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11bf303b-adca-49d8-8d80-d4a3c72e719a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f378dfb6fb0>}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:44:19 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3afb0346-f631-4b2c-984d-1cef12e57140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:44:19 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Volume volume-31ef3ffc-4c27-44fd-b99b-b78f93aef1c7 (31ef3ffc-4c27-44fd-b99b-b78f93aef1c7): created successfully
Apr 09 12:44:19 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3afb0346-f631-4b2c-984d-1cef12e57140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:44:19 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Flow 'volume_create_manager' (aa6a4e50-893e-4350-bb03-fac43ac6f5ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:44:19 devstack cinder-volume[82760]: INFO cinder.volume.manager [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-37de1729-7efd-4516-a51e-0e2cb2295deb tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Created volume successfully.
Apr 09 12:44:19 devstack sudo[85106]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-601c963f-8141-476a-95d5-e5f3f219ef52 tempest-GroupSnapshotsTest-799393923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-546f45ef-5886-4583-be42-893c03816e1d.0b4fe0e1-e1a9-448c-8beb-bfc5a8dfe64d" returned: 0 in 0.453s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-601c963f-8141-476a-95d5-e5f3f219ef52 tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-546f45ef-5886-4583-be42-893c03816e1d.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:19 devstack sudo[85113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-546f45ef-5886-4583-be42-893c03816e1d.info
Apr 09 12:44:19 devstack sudo[85113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:19 devstack sudo[85101]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-bfa167c6-f481-4717-ac83-a2392a55e574 tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-400271fb-6c61-48bc-a63e-bbe8a00e466d" returned: 0 in 0.846s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-bfa167c6-f481-4717-ac83-a2392a55e574 tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-400271fb-6c61-48bc-a63e-bbe8a00e466d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:19 devstack sudo[85118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-400271fb-6c61-48bc-a63e-bbe8a00e466d
Apr 09 12:44:19 devstack sudo[85118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:20 devstack sudo[85113]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:20 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-601c963f-8141-476a-95d5-e5f3f219ef52 tempest-GroupSnapshotsTest-799393923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-546f45ef-5886-4583-be42-893c03816e1d.info" returned: 0 in 0.473s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:20 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-601c963f-8141-476a-95d5-e5f3f219ef52 tempest-GroupSnapshotsTest-799393923 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-546f45ef-5886-4583-be42-893c03816e1d.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 09 12:44:20 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-601c963f-8141-476a-95d5-e5f3f219ef52 tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-546f45ef-5886-4583-be42-893c03816e1d.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:20 devstack sudo[85122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-546f45ef-5886-4583-be42-893c03816e1d.info
Apr 09 12:44:20 devstack sudo[85122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:20 devstack sudo[85118]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:20 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-bfa167c6-f481-4717-ac83-a2392a55e574 tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-400271fb-6c61-48bc-a63e-bbe8a00e466d" returned: 0 in 0.478s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:20 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-bfa167c6-f481-4717-ac83-a2392a55e574 tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] Lock "cinder-quobyte-400271fb-6c61-48bc-a63e-bbe8a00e466d" released by "delete_volume" :: held 1.368s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:44:20 devstack cinder-volume[82760]: WARNING cinder.quota [None req-bfa167c6-f481-4717-ac83-a2392a55e574 tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 09 12:44:20 devstack cinder-volume[82760]: WARNING cinder.quota [None req-bfa167c6-f481-4717-ac83-a2392a55e574 tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 09 12:44:20 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-bfa167c6-f481-4717-ac83-a2392a55e574 tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] Created reservations ['ec40d6e7-3989-440f-9aa9-b4b34309d245', '61a96a05-1f33-40f8-93a9-d0f0973d5a1f', '7cebbf93-5147-4f2f-9213-4e561c68e6f7', 'c798058d-2c63-4939-8d53-16e0134d312f'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:44:20 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-bfa167c6-f481-4717-ac83-a2392a55e574 tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:44:20 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-bfa167c6-f481-4717-ac83-a2392a55e574 tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:44:20 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-bfa167c6-f481-4717-ac83-a2392a55e574 tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:44:20 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-bfa167c6-f481-4717-ac83-a2392a55e574 tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:44:20 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-bfa167c6-f481-4717-ac83-a2392a55e574 tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:44:20 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-bfa167c6-f481-4717-ac83-a2392a55e574 tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:20 devstack sudo[85125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:44:20 devstack sudo[85125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:20 devstack sudo[85122]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:20 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-601c963f-8141-476a-95d5-e5f3f219ef52 tempest-GroupSnapshotsTest-799393923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-546f45ef-5886-4583-be42-893c03816e1d.info" returned: 0 in 0.638s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:20 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-601c963f-8141-476a-95d5-e5f3f219ef52 tempest-GroupSnapshotsTest-799393923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.091s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:44:20 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-601c963f-8141-476a-95d5-e5f3f219ef52 tempest-GroupSnapshotsTest-799393923 None] group_snapshot d17c42c2-efdb-4a58-bff4-3601fded38f4: created successfully
Apr 09 12:44:20 devstack sudo[85125]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:20 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-bfa167c6-f481-4717-ac83-a2392a55e574 tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.489s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:20 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-bfa167c6-f481-4717-ac83-a2392a55e574 tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:44:20 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-bfa167c6-f481-4717-ac83-a2392a55e574 tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] Deleted volume successfully.
Apr 09 12:44:20 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-bfa167c6-f481-4717-ac83-a2392a55e574 tempest-VolumeRetypeWithoutMigrationTest-1564299212 None] Lock "cinder-400271fb-6c61-48bc-a63e-bbe8a00e466d-delete_volume" released by "delete_volume" :: held 2.074s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:44:21 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-90808cc0-cf5a-4e1c-9d7b-21e2cc0ea3f1 tempest-GroupSnapshotsTest-799393923 None] group_snapshot d17c42c2-efdb-4a58-bff4-3601fded38f4: deleting
Apr 09 12:44:21 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-90808cc0-cf5a-4e1c-9d7b-21e2cc0ea3f1 tempest-GroupSnapshotsTest-799393923 None] group_snapshot d17c42c2-efdb-4a58-bff4-3601fded38f4: deleting {{(pid=82760) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 09 12:44:21 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-90808cc0-cf5a-4e1c-9d7b-21e2cc0ea3f1 tempest-GroupSnapshotsTest-799393923 None] Acquiring lock "cinder-quobyte-546f45ef-5886-4583-be42-893c03816e1d" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:44:21 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-90808cc0-cf5a-4e1c-9d7b-21e2cc0ea3f1 tempest-GroupSnapshotsTest-799393923 None] Lock "cinder-quobyte-546f45ef-5886-4583-be42-893c03816e1d" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:44:21 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-90808cc0-cf5a-4e1c-9d7b-21e2cc0ea3f1 tempest-GroupSnapshotsTest-799393923 None] Acquiring lock "cinder-quobyte-0b4fe0e1-e1a9-448c-8beb-bfc5a8dfe64d" by "_delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:44:21 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-90808cc0-cf5a-4e1c-9d7b-21e2cc0ea3f1 tempest-GroupSnapshotsTest-799393923 None] Lock "cinder-quobyte-0b4fe0e1-e1a9-448c-8beb-bfc5a8dfe64d" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:44:21 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-90808cc0-cf5a-4e1c-9d7b-21e2cc0ea3f1 tempest-GroupSnapshotsTest-799393923 None] Deleting offline snapshot 0b4fe0e1-e1a9-448c-8beb-bfc5a8dfe64d of volume 546f45ef-5886-4583-be42-893c03816e1d {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 12:44:21 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-90808cc0-cf5a-4e1c-9d7b-21e2cc0ea3f1 tempest-GroupSnapshotsTest-799393923 None] snapshot_file for this snap is: volume-546f45ef-5886-4583-be42-893c03816e1d.0b4fe0e1-e1a9-448c-8beb-bfc5a8dfe64d {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 12:44:21 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c12a370-053c-433c-9966-3e2121d600be]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:44:21 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-90808cc0-cf5a-4e1c-9d7b-21e2cc0ea3f1 tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-546f45ef-5886-4583-be42-893c03816e1d.0b4fe0e1-e1a9-448c-8beb-bfc5a8dfe64d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:21 devstack sudo[85132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-546f45ef-5886-4583-be42-893c03816e1d.0b4fe0e1-e1a9-448c-8beb-bfc5a8dfe64d
Apr 09 12:44:21 devstack sudo[85132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:21 devstack sudo[85132]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:21 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-90808cc0-cf5a-4e1c-9d7b-21e2cc0ea3f1 tempest-GroupSnapshotsTest-799393923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-546f45ef-5886-4583-be42-893c03816e1d.0b4fe0e1-e1a9-448c-8beb-bfc5a8dfe64d" returned: 0 in 0.667s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:21 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-90808cc0-cf5a-4e1c-9d7b-21e2cc0ea3f1 tempest-GroupSnapshotsTest-799393923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-546f45ef-5886-4583-be42-893c03816e1d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:44:21 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[84da2bdc-11b1-4ba0-aa4f-9da9258d7944]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:44:21 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-90808cc0-cf5a-4e1c-9d7b-21e2cc0ea3f1 tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-546f45ef-5886-4583-be42-893c03816e1d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:21 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-bb89d1fa-bd9c-407d-b46b-96b6b803943f tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:44:21 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-bb89d1fa-bd9c-407d-b46b-96b6b803943f tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:44:21 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7cac4cd-d264-4e57-927e-8cb969ed7ef9]: (4, 'raw') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:44:21 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-bb89d1fa-bd9c-407d-b46b-96b6b803943f tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-31ef3ffc-4c27-44fd-b99b-b78f93aef1c7 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:21 devstack sudo[85145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-546f45ef-5886-4583-be42-893c03816e1d
Apr 09 12:44:21 devstack sudo[85145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:22 devstack sudo[85146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-31ef3ffc-4c27-44fd-b99b-b78f93aef1c7
Apr 09 12:44:22 devstack sudo[85146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:22 devstack sudo[85145]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:22 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-90808cc0-cf5a-4e1c-9d7b-21e2cc0ea3f1 tempest-GroupSnapshotsTest-799393923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-546f45ef-5886-4583-be42-893c03816e1d" returned: 0 in 0.825s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:22 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-90808cc0-cf5a-4e1c-9d7b-21e2cc0ea3f1 tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-546f45ef-5886-4583-be42-893c03816e1d.0b4fe0e1-e1a9-448c-8beb-bfc5a8dfe64d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:22 devstack sudo[85153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-546f45ef-5886-4583-be42-893c03816e1d.0b4fe0e1-e1a9-448c-8beb-bfc5a8dfe64d
Apr 09 12:44:22 devstack sudo[85153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:22 devstack sudo[85146]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:22 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-bb89d1fa-bd9c-407d-b46b-96b6b803943f tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-31ef3ffc-4c27-44fd-b99b-b78f93aef1c7" returned: 0 in 0.910s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:22 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-bb89d1fa-bd9c-407d-b46b-96b6b803943f tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-31ef3ffc-4c27-44fd-b99b-b78f93aef1c7 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:22 devstack sudo[85163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-31ef3ffc-4c27-44fd-b99b-b78f93aef1c7
Apr 09 12:44:22 devstack sudo[85163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:23 devstack sudo[85163]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-bb89d1fa-bd9c-407d-b46b-96b6b803943f tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-31ef3ffc-4c27-44fd-b99b-b78f93aef1c7" returned: 1 in 0.666s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-bb89d1fa-bd9c-407d-b46b-96b6b803943f tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-31ef3ffc-4c27-44fd-b99b-b78f93aef1c7' failed. Not Retrying. {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 09 12:44:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-bb89d1fa-bd9c-407d-b46b-96b6b803943f tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.625s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:44:23 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-bb89d1fa-bd9c-407d-b46b-96b6b803943f tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5', 'name': 'volume-31ef3ffc-4c27-44fd-b99b-b78f93aef1c7', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f3e0483d-2717-479d-bb8a-c64b84d18388', 'enforce_multipath': True} {{(pid=82760) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 09 12:44:23 devstack cinder-volume[82760]: INFO cinder.volume.manager [req-f67d48b0-cac3-4277-af1d-4469f44980cc req-bb89d1fa-bd9c-407d-b46b-96b6b803943f tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] attachment_update completed successfully.
Apr 09 12:44:23 devstack sudo[85153]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-90808cc0-cf5a-4e1c-9d7b-21e2cc0ea3f1 tempest-GroupSnapshotsTest-799393923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-546f45ef-5886-4583-be42-893c03816e1d.0b4fe0e1-e1a9-448c-8beb-bfc5a8dfe64d" returned: 0 in 1.016s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-90808cc0-cf5a-4e1c-9d7b-21e2cc0ea3f1 tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-546f45ef-5886-4583-be42-893c03816e1d.0b4fe0e1-e1a9-448c-8beb-bfc5a8dfe64d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:23 devstack sudo[85172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-546f45ef-5886-4583-be42-893c03816e1d.0b4fe0e1-e1a9-448c-8beb-bfc5a8dfe64d
Apr 09 12:44:23 devstack sudo[85172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:24 devstack sudo[85172]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-90808cc0-cf5a-4e1c-9d7b-21e2cc0ea3f1 tempest-GroupSnapshotsTest-799393923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-546f45ef-5886-4583-be42-893c03816e1d.0b4fe0e1-e1a9-448c-8beb-bfc5a8dfe64d" returned: 0 in 0.628s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:24 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-90808cc0-cf5a-4e1c-9d7b-21e2cc0ea3f1 tempest-GroupSnapshotsTest-799393923 None] Lock "cinder-quobyte-0b4fe0e1-e1a9-448c-8beb-bfc5a8dfe64d" released by "_delete_snapshot" :: held 3.206s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:44:24 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-90808cc0-cf5a-4e1c-9d7b-21e2cc0ea3f1 tempest-GroupSnapshotsTest-799393923 None] Lock "cinder-quobyte-546f45ef-5886-4583-be42-893c03816e1d" released by "delete_snapshot" :: held 3.223s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:44:24 devstack cinder-volume[82760]: WARNING cinder.quota [None req-90808cc0-cf5a-4e1c-9d7b-21e2cc0ea3f1 tempest-GroupSnapshotsTest-799393923 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-182955661 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-182955661, it is now deprecated. Please use the default quota class for default quota.
Apr 09 12:44:24 devstack cinder-volume[82760]: WARNING cinder.quota [None req-90808cc0-cf5a-4e1c-9d7b-21e2cc0ea3f1 tempest-GroupSnapshotsTest-799393923 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-182955661 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-182955661, it is now deprecated. Please use the default quota class for default quota.
Apr 09 12:44:24 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-90808cc0-cf5a-4e1c-9d7b-21e2cc0ea3f1 tempest-GroupSnapshotsTest-799393923 None] Created reservations ['7036e8d7-76f5-4671-8730-eb3b17e1b6fc', 'd7f43133-4fd8-49d2-abd5-f6cbac12cb85', 'bbc70ab2-c59b-4a05-81f6-edf4f321f7ab', '37d56498-8a3a-414a-9efc-733e08d628c7'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:44:24 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-90808cc0-cf5a-4e1c-9d7b-21e2cc0ea3f1 tempest-GroupSnapshotsTest-799393923 None] group_snapshot d17c42c2-efdb-4a58-bff4-3601fded38f4: deleted successfully
Apr 09 12:44:25 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-92260e0a-ea5a-4733-8eff-84cf0b871103 tempest-GroupSnapshotsTest-799393923 None] Acquiring lock "cinder-quobyte-546f45ef-5886-4583-be42-893c03816e1d" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:44:25 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-92260e0a-ea5a-4733-8eff-84cf0b871103 tempest-GroupSnapshotsTest-799393923 None] Lock "cinder-quobyte-546f45ef-5886-4583-be42-893c03816e1d" acquired by "delete_volume" :: waited 0.013s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:44:25 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[037cf65a-a199-45a6-aae7-fc0a96c1df74]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:44:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-92260e0a-ea5a-4733-8eff-84cf0b871103 tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-546f45ef-5886-4583-be42-893c03816e1d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:25 devstack sudo[85176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-546f45ef-5886-4583-be42-893c03816e1d
Apr 09 12:44:25 devstack sudo[85176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:26 devstack sudo[85176]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-92260e0a-ea5a-4733-8eff-84cf0b871103 tempest-GroupSnapshotsTest-799393923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-546f45ef-5886-4583-be42-893c03816e1d" returned: 0 in 0.863s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-92260e0a-ea5a-4733-8eff-84cf0b871103 tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-546f45ef-5886-4583-be42-893c03816e1d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:26 devstack sudo[85181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-546f45ef-5886-4583-be42-893c03816e1d
Apr 09 12:44:26 devstack sudo[85181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:27 devstack sudo[85181]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-92260e0a-ea5a-4733-8eff-84cf0b871103 tempest-GroupSnapshotsTest-799393923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-546f45ef-5886-4583-be42-893c03816e1d" returned: 0 in 0.602s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:27 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-92260e0a-ea5a-4733-8eff-84cf0b871103 tempest-GroupSnapshotsTest-799393923 None] Lock "cinder-quobyte-546f45ef-5886-4583-be42-893c03816e1d" released by "delete_volume" :: held 1.510s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:44:27 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-92260e0a-ea5a-4733-8eff-84cf0b871103 tempest-GroupSnapshotsTest-799393923 None] Created reservations ['65e1a77a-09d8-4738-b0e9-81207a1a34e9'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:44:27 devstack cinder-volume[82760]: WARNING cinder.quota [None req-92260e0a-ea5a-4733-8eff-84cf0b871103 tempest-GroupSnapshotsTest-799393923 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-182955661 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-182955661, it is now deprecated. Please use the default quota class for default quota.
Apr 09 12:44:27 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-92260e0a-ea5a-4733-8eff-84cf0b871103 tempest-GroupSnapshotsTest-799393923 None] Created reservations ['974d3a3a-48e3-4089-a3cd-24303dc48700', '78d54de9-1014-4516-9917-9d111fb6a4d9', 'e47c3240-9cd9-4227-ad2b-f9ef9eac9d0a', '81b5a88a-0c8d-4706-aecc-7d95c21d9a44'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:44:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-92260e0a-ea5a-4733-8eff-84cf0b871103 tempest-GroupSnapshotsTest-799393923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:44:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-92260e0a-ea5a-4733-8eff-84cf0b871103 tempest-GroupSnapshotsTest-799393923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:44:27 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-92260e0a-ea5a-4733-8eff-84cf0b871103 tempest-GroupSnapshotsTest-799393923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:44:27 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-92260e0a-ea5a-4733-8eff-84cf0b871103 tempest-GroupSnapshotsTest-799393923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:44:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-92260e0a-ea5a-4733-8eff-84cf0b871103 tempest-GroupSnapshotsTest-799393923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:44:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-92260e0a-ea5a-4733-8eff-84cf0b871103 tempest-GroupSnapshotsTest-799393923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:27 devstack sudo[85187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:44:27 devstack sudo[85187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:28 devstack sudo[85187]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:28 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-92260e0a-ea5a-4733-8eff-84cf0b871103 tempest-GroupSnapshotsTest-799393923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.570s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:28 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-92260e0a-ea5a-4733-8eff-84cf0b871103 tempest-GroupSnapshotsTest-799393923 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:44:28 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-92260e0a-ea5a-4733-8eff-84cf0b871103 tempest-GroupSnapshotsTest-799393923 None] Delete group completed successfully.
Apr 09 12:44:37 devstack cinder-volume[82760]: DEBUG dbcounter [-] [82760] Writing DB stats cinder:UPDATE=134,cinder:DELETE=6,cinder:SELECT=122,cinder:INSERT=37 {{(pid=82760) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 12:44:37 devstack cinder-volume[82760]: DEBUG dbcounter [-] [82760] Writing DB stats cinder:SELECT=134,cinder:UPDATE=118,cinder:INSERT=31,cinder:DELETE=6 {{(pid=82760) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 12:44:37 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-07c03e9e-2e95-4472-8f31-d73b44f73180 tempest-GroupSnapshotsV319Test-1371371457 None] Group tempest-GroupSnapshotsV319Test-Group-1968751270: creating
Apr 09 12:44:37 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-07c03e9e-2e95-4472-8f31-d73b44f73180 tempest-GroupSnapshotsV319Test-1371371457 None] Group tempest-GroupSnapshotsV319Test-Group-1968751270: created successfully
Apr 09 12:44:37 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-07c03e9e-2e95-4472-8f31-d73b44f73180 tempest-GroupSnapshotsV319Test-1371371457 None] Create group completed successfully.
Apr 09 12:44:39 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-36793163-b873-4a7c-96c1-f5e6b2a2a902 tempest-GroupSnapshotsV319Test-1371371457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:44:39 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-36793163-b873-4a7c-96c1-f5e6b2a2a902 tempest-GroupSnapshotsV319Test-1371371457 None] Flow 'volume_create_manager' (8838596f-005f-4233-827e-31b6653080ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:44:39 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-36793163-b873-4a7c-96c1-f5e6b2a2a902 tempest-GroupSnapshotsV319Test-1371371457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28a9ca8f-9576-4269-a6e3-81ca5c3b8313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:44:39 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-36793163-b873-4a7c-96c1-f5e6b2a2a902 tempest-GroupSnapshotsV319Test-1371371457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28a9ca8f-9576-4269-a6e3-81ca5c3b8313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-624204218',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=781a04f6-156e-4f15-a170-02e3edbd43bb,host='devstack@QuobyteHD#QuobyteHD',id=62a486b1-4ab0-4dc8-a501-71be220942ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abbae4f9364349f5948d439b19242871',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:44:39Z,use_quota=True,user_id='b1b1f9ee9b0544b795eedbbf27fcfa91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9eca5f1e-526d-4903-9bc4-5c9f1f93ed26),volume_type_id=9eca5f1e-526d-4903-9bc4-5c9f1f93ed26)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:44:39 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-36793163-b873-4a7c-96c1-f5e6b2a2a902 tempest-GroupSnapshotsV319Test-1371371457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d196a0f-8ad3-4ba3-89b7-064bba62e484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:44:39 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-36793163-b873-4a7c-96c1-f5e6b2a2a902 tempest-GroupSnapshotsV319Test-1371371457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d196a0f-8ad3-4ba3-89b7-064bba62e484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:44:39 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-36793163-b873-4a7c-96c1-f5e6b2a2a902 tempest-GroupSnapshotsV319Test-1371371457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d366a4f-dd3d-4ff9-9b90-1b462081f754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:44:39 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-36793163-b873-4a7c-96c1-f5e6b2a2a902 tempest-GroupSnapshotsV319Test-1371371457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d366a4f-dd3d-4ff9-9b90-1b462081f754) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62a486b1-4ab0-4dc8-a501-71be220942ae', 'volume_name': 'volume-62a486b1-4ab0-4dc8-a501-71be220942ae', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:44:39 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-36793163-b873-4a7c-96c1-f5e6b2a2a902 tempest-GroupSnapshotsV319Test-1371371457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1704414d-4fdb-4d30-843a-a240fcf1ded0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:44:39 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-36793163-b873-4a7c-96c1-f5e6b2a2a902 tempest-GroupSnapshotsV319Test-1371371457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1704414d-4fdb-4d30-843a-a240fcf1ded0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:44:39 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-36793163-b873-4a7c-96c1-f5e6b2a2a902 tempest-GroupSnapshotsV319Test-1371371457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a4d8970-043c-44f1-901e-4fa63dd310e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:44:39 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-36793163-b873-4a7c-96c1-f5e6b2a2a902 tempest-GroupSnapshotsV319Test-1371371457 None] Volume 62a486b1-4ab0-4dc8-a501-71be220942ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62a486b1-4ab0-4dc8-a501-71be220942ae', 'volume_size': 1}
Apr 09 12:44:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-36793163-b873-4a7c-96c1-f5e6b2a2a902 tempest-GroupSnapshotsV319Test-1371371457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:44:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-36793163-b873-4a7c-96c1-f5e6b2a2a902 tempest-GroupSnapshotsV319Test-1371371457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:44:39 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-36793163-b873-4a7c-96c1-f5e6b2a2a902 tempest-GroupSnapshotsV319Test-1371371457 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=781a04f6-156e-4f15-a170-02e3edbd43bb,created_at=2026-04-09T10:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-624204218',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=781a04f6-156e-4f15-a170-02e3edbd43bb,host='devstack@QuobyteHD#QuobyteHD',id=62a486b1-4ab0-4dc8-a501-71be220942ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abbae4f9364349f5948d439b19242871',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:44:39Z,use_quota=True,user_id='b1b1f9ee9b0544b795eedbbf27fcfa91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9eca5f1e-526d-4903-9bc4-5c9f1f93ed26),volume_type_id=9eca5f1e-526d-4903-9bc4-5c9f1f93ed26)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:44:39 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-36793163-b873-4a7c-96c1-f5e6b2a2a902 tempest-GroupSnapshotsV319Test-1371371457 None] Creating volume 62a486b1-4ab0-4dc8-a501-71be220942ae {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:44:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-36793163-b873-4a7c-96c1-f5e6b2a2a902 tempest-GroupSnapshotsV319Test-1371371457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:44:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-36793163-b873-4a7c-96c1-f5e6b2a2a902 tempest-GroupSnapshotsV319Test-1371371457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:44:39 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-36793163-b873-4a7c-96c1-f5e6b2a2a902 tempest-GroupSnapshotsV319Test-1371371457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:44:39 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-36793163-b873-4a7c-96c1-f5e6b2a2a902 tempest-GroupSnapshotsV319Test-1371371457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:44:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-36793163-b873-4a7c-96c1-f5e6b2a2a902 tempest-GroupSnapshotsV319Test-1371371457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:44:39 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-36793163-b873-4a7c-96c1-f5e6b2a2a902 tempest-GroupSnapshotsV319Test-1371371457 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:44:39 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-36793163-b873-4a7c-96c1-f5e6b2a2a902 tempest-GroupSnapshotsV319Test-1371371457 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:44:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-36793163-b873-4a7c-96c1-f5e6b2a2a902 tempest-GroupSnapshotsV319Test-1371371457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-62a486b1-4ab0-4dc8-a501-71be220942ae 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:39 devstack sudo[85255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-62a486b1-4ab0-4dc8-a501-71be220942ae 1073741824
Apr 09 12:44:39 devstack sudo[85255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:40 devstack sudo[85255]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:40 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-36793163-b873-4a7c-96c1-f5e6b2a2a902 tempest-GroupSnapshotsV319Test-1371371457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-62a486b1-4ab0-4dc8-a501-71be220942ae 1073741824" returned: 0 in 1.250s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:40 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-36793163-b873-4a7c-96c1-f5e6b2a2a902 tempest-GroupSnapshotsV319Test-1371371457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-62a486b1-4ab0-4dc8-a501-71be220942ae {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:40 devstack sudo[85260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-62a486b1-4ab0-4dc8-a501-71be220942ae
Apr 09 12:44:40 devstack sudo[85260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:41 devstack sudo[85260]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:41 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-36793163-b873-4a7c-96c1-f5e6b2a2a902 tempest-GroupSnapshotsV319Test-1371371457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-62a486b1-4ab0-4dc8-a501-71be220942ae" returned: 0 in 0.712s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:41 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-36793163-b873-4a7c-96c1-f5e6b2a2a902 tempest-GroupSnapshotsV319Test-1371371457 None] <== create_volume: return (2011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:44:41 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-36793163-b873-4a7c-96c1-f5e6b2a2a902 tempest-GroupSnapshotsV319Test-1371371457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.014s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:44:41 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-36793163-b873-4a7c-96c1-f5e6b2a2a902 tempest-GroupSnapshotsV319Test-1371371457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a4d8970-043c-44f1-901e-4fa63dd310e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62a486b1-4ab0-4dc8-a501-71be220942ae', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:44:41 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-36793163-b873-4a7c-96c1-f5e6b2a2a902 tempest-GroupSnapshotsV319Test-1371371457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0abde36c-350a-46e1-857c-5c6fa25dd4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:44:41 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-36793163-b873-4a7c-96c1-f5e6b2a2a902 tempest-GroupSnapshotsV319Test-1371371457 None] Volume volume-62a486b1-4ab0-4dc8-a501-71be220942ae (62a486b1-4ab0-4dc8-a501-71be220942ae): created successfully
Apr 09 12:44:41 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-36793163-b873-4a7c-96c1-f5e6b2a2a902 tempest-GroupSnapshotsV319Test-1371371457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0abde36c-350a-46e1-857c-5c6fa25dd4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:44:41 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-36793163-b873-4a7c-96c1-f5e6b2a2a902 tempest-GroupSnapshotsV319Test-1371371457 None] Flow 'volume_create_manager' (8838596f-005f-4233-827e-31b6653080ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:44:41 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-36793163-b873-4a7c-96c1-f5e6b2a2a902 tempest-GroupSnapshotsV319Test-1371371457 None] Created volume successfully.
Apr 09 12:44:41 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-4585acaa-f476-4317-9795-631960d26629 tempest-GroupSnapshotsV319Test-1371371457 None] GroupSnapshot 908d5f76-6a50-40b5-b910-fc36f34d642a: creating.
Apr 09 12:44:41 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4585acaa-f476-4317-9795-631960d26629 tempest-GroupSnapshotsV319Test-1371371457 None] Group snapshot 908d5f76-6a50-40b5-b910-fc36f34d642a: creating. {{(pid=82760) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 09 12:44:41 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-4585acaa-f476-4317-9795-631960d26629 tempest-GroupSnapshotsV319Test-1371371457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:44:41 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-4585acaa-f476-4317-9795-631960d26629 tempest-GroupSnapshotsV319Test-1371371457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:44:42 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-4585acaa-f476-4317-9795-631960d26629 tempest-GroupSnapshotsV319Test-1371371457 None] Creating offline snapshot 82affa00-c02f-4df9-941f-7a229de1b1e3 of volume 62a486b1-4ab0-4dc8-a501-71be220942ae {{(pid=82760) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 12:44:42 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0af574-c34e-43c7-b654-59f5d760bed8]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:44:42 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-4585acaa-f476-4317-9795-631960d26629 tempest-GroupSnapshotsV319Test-1371371457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-62a486b1-4ab0-4dc8-a501-71be220942ae {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:42 devstack sudo[85267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-62a486b1-4ab0-4dc8-a501-71be220942ae
Apr 09 12:44:42 devstack sudo[85267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:43 devstack sudo[85267]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:43 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-4585acaa-f476-4317-9795-631960d26629 tempest-GroupSnapshotsV319Test-1371371457 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-62a486b1-4ab0-4dc8-a501-71be220942ae" returned: 0 in 1.029s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:43 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-4585acaa-f476-4317-9795-631960d26629 tempest-GroupSnapshotsV319Test-1371371457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-62a486b1-4ab0-4dc8-a501-71be220942ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-62a486b1-4ab0-4dc8-a501-71be220942ae.82affa00-c02f-4df9-941f-7a229de1b1e3 1G {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:43 devstack sudo[85285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-62a486b1-4ab0-4dc8-a501-71be220942ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-62a486b1-4ab0-4dc8-a501-71be220942ae.82affa00-c02f-4df9-941f-7a229de1b1e3 1G
Apr 09 12:44:43 devstack sudo[85285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:43 devstack sudo[85285]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:43 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-4585acaa-f476-4317-9795-631960d26629 tempest-GroupSnapshotsV319Test-1371371457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-62a486b1-4ab0-4dc8-a501-71be220942ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-62a486b1-4ab0-4dc8-a501-71be220942ae.82affa00-c02f-4df9-941f-7a229de1b1e3 1G" returned: 0 in 0.643s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:43 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-4585acaa-f476-4317-9795-631960d26629 tempest-GroupSnapshotsV319Test-1371371457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62a486b1-4ab0-4dc8-a501-71be220942ae -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-62a486b1-4ab0-4dc8-a501-71be220942ae.82affa00-c02f-4df9-941f-7a229de1b1e3 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:43 devstack sudo[85307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62a486b1-4ab0-4dc8-a501-71be220942ae -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-62a486b1-4ab0-4dc8-a501-71be220942ae.82affa00-c02f-4df9-941f-7a229de1b1e3
Apr 09 12:44:43 devstack sudo[85307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:44 devstack sudo[85307]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:44 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-4585acaa-f476-4317-9795-631960d26629 tempest-GroupSnapshotsV319Test-1371371457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62a486b1-4ab0-4dc8-a501-71be220942ae -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-62a486b1-4ab0-4dc8-a501-71be220942ae.82affa00-c02f-4df9-941f-7a229de1b1e3" returned: 0 in 0.532s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:44 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-4585acaa-f476-4317-9795-631960d26629 tempest-GroupSnapshotsV319Test-1371371457 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-62a486b1-4ab0-4dc8-a501-71be220942ae.82affa00-c02f-4df9-941f-7a229de1b1e3 is being set with open permissions: ugo+rw: NotImplementedError
Apr 09 12:44:44 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-4585acaa-f476-4317-9795-631960d26629 tempest-GroupSnapshotsV319Test-1371371457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-62a486b1-4ab0-4dc8-a501-71be220942ae.82affa00-c02f-4df9-941f-7a229de1b1e3 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:44 devstack sudo[85312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-62a486b1-4ab0-4dc8-a501-71be220942ae.82affa00-c02f-4df9-941f-7a229de1b1e3
Apr 09 12:44:44 devstack sudo[85312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:44 devstack sudo[85312]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:44 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-4585acaa-f476-4317-9795-631960d26629 tempest-GroupSnapshotsV319Test-1371371457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-62a486b1-4ab0-4dc8-a501-71be220942ae.82affa00-c02f-4df9-941f-7a229de1b1e3" returned: 0 in 0.485s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:44 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-4585acaa-f476-4317-9795-631960d26629 tempest-GroupSnapshotsV319Test-1371371457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-62a486b1-4ab0-4dc8-a501-71be220942ae.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:44 devstack sudo[85316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-62a486b1-4ab0-4dc8-a501-71be220942ae.info
Apr 09 12:44:44 devstack sudo[85316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:45 devstack sudo[85316]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:45 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-4585acaa-f476-4317-9795-631960d26629 tempest-GroupSnapshotsV319Test-1371371457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-62a486b1-4ab0-4dc8-a501-71be220942ae.info" returned: 0 in 0.623s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:45 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-4585acaa-f476-4317-9795-631960d26629 tempest-GroupSnapshotsV319Test-1371371457 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-62a486b1-4ab0-4dc8-a501-71be220942ae.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 09 12:44:45 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-4585acaa-f476-4317-9795-631960d26629 tempest-GroupSnapshotsV319Test-1371371457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-62a486b1-4ab0-4dc8-a501-71be220942ae.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:45 devstack sudo[85337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-62a486b1-4ab0-4dc8-a501-71be220942ae.info
Apr 09 12:44:45 devstack sudo[85337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:45 devstack sudo[85337]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:45 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-4585acaa-f476-4317-9795-631960d26629 tempest-GroupSnapshotsV319Test-1371371457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-62a486b1-4ab0-4dc8-a501-71be220942ae.info" returned: 0 in 0.486s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:45 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-4585acaa-f476-4317-9795-631960d26629 tempest-GroupSnapshotsV319Test-1371371457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.896s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:44:45 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-4585acaa-f476-4317-9795-631960d26629 tempest-GroupSnapshotsV319Test-1371371457 None] group_snapshot 908d5f76-6a50-40b5-b910-fc36f34d642a: created successfully
Apr 09 12:44:46 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-e6c4069f-b166-4289-9404-a6d01710606e tempest-GroupSnapshotsV319Test-1371371457 None] group_snapshot 908d5f76-6a50-40b5-b910-fc36f34d642a: deleting
Apr 09 12:44:46 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-e6c4069f-b166-4289-9404-a6d01710606e tempest-GroupSnapshotsV319Test-1371371457 None] group_snapshot 908d5f76-6a50-40b5-b910-fc36f34d642a: deleting {{(pid=82760) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 09 12:44:46 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-e6c4069f-b166-4289-9404-a6d01710606e tempest-GroupSnapshotsV319Test-1371371457 None] Acquiring lock "cinder-quobyte-62a486b1-4ab0-4dc8-a501-71be220942ae" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:44:46 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-e6c4069f-b166-4289-9404-a6d01710606e tempest-GroupSnapshotsV319Test-1371371457 None] Lock "cinder-quobyte-62a486b1-4ab0-4dc8-a501-71be220942ae" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:44:46 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-e6c4069f-b166-4289-9404-a6d01710606e tempest-GroupSnapshotsV319Test-1371371457 None] Acquiring lock "cinder-quobyte-82affa00-c02f-4df9-941f-7a229de1b1e3" by "_delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:44:46 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-e6c4069f-b166-4289-9404-a6d01710606e tempest-GroupSnapshotsV319Test-1371371457 None] Lock "cinder-quobyte-82affa00-c02f-4df9-941f-7a229de1b1e3" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:44:46 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-e6c4069f-b166-4289-9404-a6d01710606e tempest-GroupSnapshotsV319Test-1371371457 None] Deleting offline snapshot 82affa00-c02f-4df9-941f-7a229de1b1e3 of volume 62a486b1-4ab0-4dc8-a501-71be220942ae {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 12:44:46 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-e6c4069f-b166-4289-9404-a6d01710606e tempest-GroupSnapshotsV319Test-1371371457 None] snapshot_file for this snap is: volume-62a486b1-4ab0-4dc8-a501-71be220942ae.82affa00-c02f-4df9-941f-7a229de1b1e3 {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 12:44:46 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd9cdd2-efea-42b3-84b4-4d7717645ed8]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:44:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e6c4069f-b166-4289-9404-a6d01710606e tempest-GroupSnapshotsV319Test-1371371457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-62a486b1-4ab0-4dc8-a501-71be220942ae.82affa00-c02f-4df9-941f-7a229de1b1e3 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:46 devstack sudo[85346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-62a486b1-4ab0-4dc8-a501-71be220942ae.82affa00-c02f-4df9-941f-7a229de1b1e3
Apr 09 12:44:46 devstack sudo[85346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:47 devstack sudo[85346]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:47 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e6c4069f-b166-4289-9404-a6d01710606e tempest-GroupSnapshotsV319Test-1371371457 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-62a486b1-4ab0-4dc8-a501-71be220942ae.82affa00-c02f-4df9-941f-7a229de1b1e3" returned: 0 in 0.693s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:47 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-e6c4069f-b166-4289-9404-a6d01710606e tempest-GroupSnapshotsV319Test-1371371457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62a486b1-4ab0-4dc8-a501-71be220942ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:44:47 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[95847321-d332-4295-a1f8-c11a546fb9e1]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:44:47 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e6c4069f-b166-4289-9404-a6d01710606e tempest-GroupSnapshotsV319Test-1371371457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-62a486b1-4ab0-4dc8-a501-71be220942ae {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:47 devstack sudo[85351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-62a486b1-4ab0-4dc8-a501-71be220942ae
Apr 09 12:44:47 devstack sudo[85351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:47 devstack sudo[85351]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:47 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e6c4069f-b166-4289-9404-a6d01710606e tempest-GroupSnapshotsV319Test-1371371457 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-62a486b1-4ab0-4dc8-a501-71be220942ae" returned: 0 in 0.661s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:47 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e6c4069f-b166-4289-9404-a6d01710606e tempest-GroupSnapshotsV319Test-1371371457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-62a486b1-4ab0-4dc8-a501-71be220942ae.82affa00-c02f-4df9-941f-7a229de1b1e3 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:47 devstack sudo[85357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-62a486b1-4ab0-4dc8-a501-71be220942ae.82affa00-c02f-4df9-941f-7a229de1b1e3
Apr 09 12:44:47 devstack sudo[85357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:48 devstack sudo[85357]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:48 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e6c4069f-b166-4289-9404-a6d01710606e tempest-GroupSnapshotsV319Test-1371371457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-62a486b1-4ab0-4dc8-a501-71be220942ae.82affa00-c02f-4df9-941f-7a229de1b1e3" returned: 0 in 0.612s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:48 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e6c4069f-b166-4289-9404-a6d01710606e tempest-GroupSnapshotsV319Test-1371371457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-62a486b1-4ab0-4dc8-a501-71be220942ae.82affa00-c02f-4df9-941f-7a229de1b1e3 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:48 devstack sudo[85374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-62a486b1-4ab0-4dc8-a501-71be220942ae.82affa00-c02f-4df9-941f-7a229de1b1e3
Apr 09 12:44:48 devstack sudo[85374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:49 devstack sudo[85374]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:49 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e6c4069f-b166-4289-9404-a6d01710606e tempest-GroupSnapshotsV319Test-1371371457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-62a486b1-4ab0-4dc8-a501-71be220942ae.82affa00-c02f-4df9-941f-7a229de1b1e3" returned: 0 in 0.577s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:49 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-e6c4069f-b166-4289-9404-a6d01710606e tempest-GroupSnapshotsV319Test-1371371457 None] Lock "cinder-quobyte-82affa00-c02f-4df9-941f-7a229de1b1e3" released by "_delete_snapshot" :: held 2.634s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:44:49 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-e6c4069f-b166-4289-9404-a6d01710606e tempest-GroupSnapshotsV319Test-1371371457 None] Lock "cinder-quobyte-62a486b1-4ab0-4dc8-a501-71be220942ae" released by "delete_snapshot" :: held 2.649s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:44:49 devstack cinder-volume[82760]: WARNING cinder.quota [None req-e6c4069f-b166-4289-9404-a6d01710606e tempest-GroupSnapshotsV319Test-1371371457 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-359825780 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-359825780, it is now deprecated. Please use the default quota class for default quota.
Apr 09 12:44:49 devstack cinder-volume[82760]: WARNING cinder.quota [None req-e6c4069f-b166-4289-9404-a6d01710606e tempest-GroupSnapshotsV319Test-1371371457 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-359825780 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-359825780, it is now deprecated. Please use the default quota class for default quota.
Apr 09 12:44:49 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-e6c4069f-b166-4289-9404-a6d01710606e tempest-GroupSnapshotsV319Test-1371371457 None] Created reservations ['326aeaa0-2e5e-46a8-be0d-c6b96a9d6e11', '0e709546-d4bb-4320-8c96-81bb0a49ec4a', '443510d6-505d-4d66-a9a6-d989d2d6e110', 'c3ef5c11-4e6a-4b28-8942-67ba6bea14de'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:44:49 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-e6c4069f-b166-4289-9404-a6d01710606e tempest-GroupSnapshotsV319Test-1371371457 None] group_snapshot 908d5f76-6a50-40b5-b910-fc36f34d642a: deleted successfully
Apr 09 12:44:49 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-1d6d989f-c3cb-4349-a8ca-c690900ec765 tempest-GroupSnapshotsV319Test-1371371457 None] Acquiring lock "cinder-quobyte-62a486b1-4ab0-4dc8-a501-71be220942ae" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:44:50 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-1d6d989f-c3cb-4349-a8ca-c690900ec765 tempest-GroupSnapshotsV319Test-1371371457 None] Lock "cinder-quobyte-62a486b1-4ab0-4dc8-a501-71be220942ae" acquired by "delete_volume" :: waited 0.020s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:44:50 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c74fad8-c6ee-4310-913e-5f30dd5be848]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:44:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-1d6d989f-c3cb-4349-a8ca-c690900ec765 tempest-GroupSnapshotsV319Test-1371371457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-62a486b1-4ab0-4dc8-a501-71be220942ae {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:50 devstack sudo[85409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-62a486b1-4ab0-4dc8-a501-71be220942ae
Apr 09 12:44:50 devstack sudo[85409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:50 devstack sudo[85409]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-1d6d989f-c3cb-4349-a8ca-c690900ec765 tempest-GroupSnapshotsV319Test-1371371457 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-62a486b1-4ab0-4dc8-a501-71be220942ae" returned: 0 in 0.834s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-1d6d989f-c3cb-4349-a8ca-c690900ec765 tempest-GroupSnapshotsV319Test-1371371457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-62a486b1-4ab0-4dc8-a501-71be220942ae {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:50 devstack sudo[85427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-62a486b1-4ab0-4dc8-a501-71be220942ae
Apr 09 12:44:50 devstack sudo[85427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:51 devstack sudo[85427]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-1d6d989f-c3cb-4349-a8ca-c690900ec765 tempest-GroupSnapshotsV319Test-1371371457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-62a486b1-4ab0-4dc8-a501-71be220942ae" returned: 0 in 0.573s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:51 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-1d6d989f-c3cb-4349-a8ca-c690900ec765 tempest-GroupSnapshotsV319Test-1371371457 None] Lock "cinder-quobyte-62a486b1-4ab0-4dc8-a501-71be220942ae" released by "delete_volume" :: held 1.513s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:44:51 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-1d6d989f-c3cb-4349-a8ca-c690900ec765 tempest-GroupSnapshotsV319Test-1371371457 None] Created reservations ['d0b518d7-15e1-4fec-9275-84d4dd082a1a'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:44:51 devstack cinder-volume[82760]: WARNING cinder.quota [None req-1d6d989f-c3cb-4349-a8ca-c690900ec765 tempest-GroupSnapshotsV319Test-1371371457 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-359825780 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-359825780, it is now deprecated. Please use the default quota class for default quota.
Apr 09 12:44:51 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-1d6d989f-c3cb-4349-a8ca-c690900ec765 tempest-GroupSnapshotsV319Test-1371371457 None] Created reservations ['c2865653-57f0-45b3-a3ca-5642403813d5', 'e3d40469-1bfa-437f-b2a3-93e5391091c9', 'fb39aa59-c65f-473f-8cd0-f149c89d7a7e', '5a28d35b-3d06-4e5c-8541-c131ab812b7a'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:44:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-1d6d989f-c3cb-4349-a8ca-c690900ec765 tempest-GroupSnapshotsV319Test-1371371457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:44:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-1d6d989f-c3cb-4349-a8ca-c690900ec765 tempest-GroupSnapshotsV319Test-1371371457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:44:51 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-1d6d989f-c3cb-4349-a8ca-c690900ec765 tempest-GroupSnapshotsV319Test-1371371457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:44:51 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-1d6d989f-c3cb-4349-a8ca-c690900ec765 tempest-GroupSnapshotsV319Test-1371371457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:44:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-1d6d989f-c3cb-4349-a8ca-c690900ec765 tempest-GroupSnapshotsV319Test-1371371457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:44:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-1d6d989f-c3cb-4349-a8ca-c690900ec765 tempest-GroupSnapshotsV319Test-1371371457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:44:51 devstack sudo[85438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:44:51 devstack sudo[85438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:44:52 devstack sudo[85438]: pam_unix(sudo:session): session closed for user root
Apr 09 12:44:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-1d6d989f-c3cb-4349-a8ca-c690900ec765 tempest-GroupSnapshotsV319Test-1371371457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.608s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:44:52 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-1d6d989f-c3cb-4349-a8ca-c690900ec765 tempest-GroupSnapshotsV319Test-1371371457 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:44:52 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-1d6d989f-c3cb-4349-a8ca-c690900ec765 tempest-GroupSnapshotsV319Test-1371371457 None] Delete group completed successfully.
Apr 09 12:44:57 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-b98759fb-77ce-4589-8ff5-93f7f99a537e tempest-GroupsTest-1610602463 None] Group tempest-Group1-984898819: creating
Apr 09 12:44:57 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-b98759fb-77ce-4589-8ff5-93f7f99a537e tempest-GroupsTest-1610602463 None] Group tempest-Group1-984898819: created successfully
Apr 09 12:44:57 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-b98759fb-77ce-4589-8ff5-93f7f99a537e tempest-GroupsTest-1610602463 None] Create group completed successfully.
Apr 09 12:44:59 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-276ee42f-8478-488c-b3ed-b686b60e6f41 tempest-GroupsTest-1610602463 None] Group tempest-Group2-120357027: creating
Apr 09 12:44:59 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-276ee42f-8478-488c-b3ed-b686b60e6f41 tempest-GroupsTest-1610602463 None] Group tempest-Group2-120357027: created successfully
Apr 09 12:44:59 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-276ee42f-8478-488c-b3ed-b686b60e6f41 tempest-GroupsTest-1610602463 None] Create group completed successfully.
Apr 09 12:44:59 devstack cinder-volume[82760]: INFO cinder.volume.manager [req-de916335-b241-4371-ad3a-15055c6b922e req-548bd950-3c5a-4389-8620-74a3a2c58571 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Terminate volume connection completed successfully.
Apr 09 12:44:59 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-de916335-b241-4371-ad3a-15055c6b922e req-548bd950-3c5a-4389-8620-74a3a2c58571 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Deleting attachment f3e0483d-2717-479d-bb8a-c64b84d18388. {{(pid=82760) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 09 12:45:00 devstack cinder-volume[82760]: DEBUG cinder.coordination [req-de916335-b241-4371-ad3a-15055c6b922e req-d58112bf-77c1-4f18-b779-9dd9b28f9988 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Acquiring lock "cinder-31ef3ffc-4c27-44fd-b99b-b78f93aef1c7-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:45:00 devstack cinder-volume[82760]: DEBUG cinder.coordination [req-de916335-b241-4371-ad3a-15055c6b922e req-d58112bf-77c1-4f18-b779-9dd9b28f9988 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Lock "cinder-31ef3ffc-4c27-44fd-b99b-b78f93aef1c7-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:45:00 devstack cinder-volume[82760]: DEBUG cinder.coordination [req-de916335-b241-4371-ad3a-15055c6b922e req-d58112bf-77c1-4f18-b779-9dd9b28f9988 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Acquiring lock "cinder-quobyte-31ef3ffc-4c27-44fd-b99b-b78f93aef1c7" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:45:00 devstack cinder-volume[82760]: DEBUG cinder.coordination [req-de916335-b241-4371-ad3a-15055c6b922e req-d58112bf-77c1-4f18-b779-9dd9b28f9988 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Lock "cinder-quobyte-31ef3ffc-4c27-44fd-b99b-b78f93aef1c7" acquired by "delete_volume" :: waited 0.013s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:45:00 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4e22f1-9fa9-44fc-a436-577d0dbb6292]: (4, 'raw') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:45:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-de916335-b241-4371-ad3a-15055c6b922e req-d58112bf-77c1-4f18-b779-9dd9b28f9988 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-31ef3ffc-4c27-44fd-b99b-b78f93aef1c7 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:00 devstack sudo[85662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-31ef3ffc-4c27-44fd-b99b-b78f93aef1c7
Apr 09 12:45:00 devstack sudo[85662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:00 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-14fa9728-9edc-48bc-b7e2-0cfa7edcb38e tempest-GroupsTest-1610602463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:45:00 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-14fa9728-9edc-48bc-b7e2-0cfa7edcb38e tempest-GroupsTest-1610602463 None] Flow 'volume_create_manager' (95951880-bdcc-47dd-801c-54a726aa8b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:45:00 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-14fa9728-9edc-48bc-b7e2-0cfa7edcb38e tempest-GroupsTest-1610602463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60af6f07-6af6-4e7e-92e8-09d0b873a5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:00 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-14fa9728-9edc-48bc-b7e2-0cfa7edcb38e tempest-GroupsTest-1610602463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60af6f07-6af6-4e7e-92e8-09d0b873a5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:45:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1165595665',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=df9fb9ed-2e42-4054-b558-778ad9bf5d0e,host='devstack@QuobyteHD#QuobyteHD',id=6db180ec-dd36-47cd-b6e1-495b053dc41d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f179128262764329b61b337dca9612ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:45:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:45:00Z,use_quota=True,user_id='feede45eb37c4e348ab8c77bf2d5e0c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90395b59-de28-49d3-9d10-07ce132adc9d),volume_type_id=90395b59-de28-49d3-9d10-07ce132adc9d)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:00 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-14fa9728-9edc-48bc-b7e2-0cfa7edcb38e tempest-GroupsTest-1610602463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96deecff-3018-4a17-8564-4bd03c93bdaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:00 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-14fa9728-9edc-48bc-b7e2-0cfa7edcb38e tempest-GroupsTest-1610602463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96deecff-3018-4a17-8564-4bd03c93bdaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:00 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-14fa9728-9edc-48bc-b7e2-0cfa7edcb38e tempest-GroupsTest-1610602463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (619a6bee-bfa1-480e-927a-fe26ca3c350f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:00 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-14fa9728-9edc-48bc-b7e2-0cfa7edcb38e tempest-GroupsTest-1610602463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (619a6bee-bfa1-480e-927a-fe26ca3c350f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6db180ec-dd36-47cd-b6e1-495b053dc41d', 'volume_name': 'volume-6db180ec-dd36-47cd-b6e1-495b053dc41d', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:00 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-14fa9728-9edc-48bc-b7e2-0cfa7edcb38e tempest-GroupsTest-1610602463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (549e294e-3adc-481e-9432-fcd65ef818e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:00 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-14fa9728-9edc-48bc-b7e2-0cfa7edcb38e tempest-GroupsTest-1610602463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (549e294e-3adc-481e-9432-fcd65ef818e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:00 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-14fa9728-9edc-48bc-b7e2-0cfa7edcb38e tempest-GroupsTest-1610602463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceea42ca-22f9-47f5-8d10-a97403d98fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:00 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-14fa9728-9edc-48bc-b7e2-0cfa7edcb38e tempest-GroupsTest-1610602463 None] Volume 6db180ec-dd36-47cd-b6e1-495b053dc41d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6db180ec-dd36-47cd-b6e1-495b053dc41d', 'volume_size': 1}
Apr 09 12:45:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-14fa9728-9edc-48bc-b7e2-0cfa7edcb38e tempest-GroupsTest-1610602463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:45:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-14fa9728-9edc-48bc-b7e2-0cfa7edcb38e tempest-GroupsTest-1610602463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:45:00 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-14fa9728-9edc-48bc-b7e2-0cfa7edcb38e tempest-GroupsTest-1610602463 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=df9fb9ed-2e42-4054-b558-778ad9bf5d0e,created_at=2026-04-09T10:45:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1165595665',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=df9fb9ed-2e42-4054-b558-778ad9bf5d0e,host='devstack@QuobyteHD#QuobyteHD',id=6db180ec-dd36-47cd-b6e1-495b053dc41d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f179128262764329b61b337dca9612ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:45:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:45:00Z,use_quota=True,user_id='feede45eb37c4e348ab8c77bf2d5e0c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90395b59-de28-49d3-9d10-07ce132adc9d),volume_type_id=90395b59-de28-49d3-9d10-07ce132adc9d)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:45:00 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-14fa9728-9edc-48bc-b7e2-0cfa7edcb38e tempest-GroupsTest-1610602463 None] Creating volume 6db180ec-dd36-47cd-b6e1-495b053dc41d {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:45:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-14fa9728-9edc-48bc-b7e2-0cfa7edcb38e tempest-GroupsTest-1610602463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:45:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-14fa9728-9edc-48bc-b7e2-0cfa7edcb38e tempest-GroupsTest-1610602463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:45:00 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-14fa9728-9edc-48bc-b7e2-0cfa7edcb38e tempest-GroupsTest-1610602463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:45:00 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-14fa9728-9edc-48bc-b7e2-0cfa7edcb38e tempest-GroupsTest-1610602463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:45:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-14fa9728-9edc-48bc-b7e2-0cfa7edcb38e tempest-GroupsTest-1610602463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:45:00 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-14fa9728-9edc-48bc-b7e2-0cfa7edcb38e tempest-GroupsTest-1610602463 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:45:00 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-14fa9728-9edc-48bc-b7e2-0cfa7edcb38e tempest-GroupsTest-1610602463 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:45:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-14fa9728-9edc-48bc-b7e2-0cfa7edcb38e tempest-GroupsTest-1610602463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6db180ec-dd36-47cd-b6e1-495b053dc41d 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:00 devstack sudo[85664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6db180ec-dd36-47cd-b6e1-495b053dc41d 1073741824
Apr 09 12:45:00 devstack sudo[85664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:01 devstack sudo[85662]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-de916335-b241-4371-ad3a-15055c6b922e req-d58112bf-77c1-4f18-b779-9dd9b28f9988 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-31ef3ffc-4c27-44fd-b99b-b78f93aef1c7" returned: 0 in 0.615s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-de916335-b241-4371-ad3a-15055c6b922e req-d58112bf-77c1-4f18-b779-9dd9b28f9988 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-31ef3ffc-4c27-44fd-b99b-b78f93aef1c7 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:01 devstack sudo[85671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-31ef3ffc-4c27-44fd-b99b-b78f93aef1c7
Apr 09 12:45:01 devstack sudo[85671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:01 devstack sudo[85664]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-14fa9728-9edc-48bc-b7e2-0cfa7edcb38e tempest-GroupsTest-1610602463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6db180ec-dd36-47cd-b6e1-495b053dc41d 1073741824" returned: 0 in 0.603s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-14fa9728-9edc-48bc-b7e2-0cfa7edcb38e tempest-GroupsTest-1610602463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6db180ec-dd36-47cd-b6e1-495b053dc41d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:01 devstack sudo[85673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6db180ec-dd36-47cd-b6e1-495b053dc41d
Apr 09 12:45:01 devstack sudo[85673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:01 devstack sudo[85671]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-de916335-b241-4371-ad3a-15055c6b922e req-d58112bf-77c1-4f18-b779-9dd9b28f9988 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-31ef3ffc-4c27-44fd-b99b-b78f93aef1c7" returned: 1 in 0.599s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-de916335-b241-4371-ad3a-15055c6b922e req-d58112bf-77c1-4f18-b779-9dd9b28f9988 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-31ef3ffc-4c27-44fd-b99b-b78f93aef1c7' failed. Not Retrying. {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 09 12:45:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-de916335-b241-4371-ad3a-15055c6b922e req-d58112bf-77c1-4f18-b779-9dd9b28f9988 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-31ef3ffc-4c27-44fd-b99b-b78f93aef1c7 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:01 devstack sudo[85679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-31ef3ffc-4c27-44fd-b99b-b78f93aef1c7
Apr 09 12:45:01 devstack sudo[85679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:01 devstack sudo[85673]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-14fa9728-9edc-48bc-b7e2-0cfa7edcb38e tempest-GroupsTest-1610602463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6db180ec-dd36-47cd-b6e1-495b053dc41d" returned: 0 in 0.491s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:01 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-14fa9728-9edc-48bc-b7e2-0cfa7edcb38e tempest-GroupsTest-1610602463 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:45:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-14fa9728-9edc-48bc-b7e2-0cfa7edcb38e tempest-GroupsTest-1610602463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:45:01 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-14fa9728-9edc-48bc-b7e2-0cfa7edcb38e tempest-GroupsTest-1610602463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceea42ca-22f9-47f5-8d10-a97403d98fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6db180ec-dd36-47cd-b6e1-495b053dc41d', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:01 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-14fa9728-9edc-48bc-b7e2-0cfa7edcb38e tempest-GroupsTest-1610602463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f32a88b-1d39-465f-a1d3-b54f415a99a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:01 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-14fa9728-9edc-48bc-b7e2-0cfa7edcb38e tempest-GroupsTest-1610602463 None] Volume volume-6db180ec-dd36-47cd-b6e1-495b053dc41d (6db180ec-dd36-47cd-b6e1-495b053dc41d): created successfully
Apr 09 12:45:01 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-14fa9728-9edc-48bc-b7e2-0cfa7edcb38e tempest-GroupsTest-1610602463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f32a88b-1d39-465f-a1d3-b54f415a99a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:01 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-14fa9728-9edc-48bc-b7e2-0cfa7edcb38e tempest-GroupsTest-1610602463 None] Flow 'volume_create_manager' (95951880-bdcc-47dd-801c-54a726aa8b6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:45:01 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-14fa9728-9edc-48bc-b7e2-0cfa7edcb38e tempest-GroupsTest-1610602463 None] Created volume successfully.
Apr 09 12:45:02 devstack sudo[85679]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-de916335-b241-4371-ad3a-15055c6b922e req-d58112bf-77c1-4f18-b779-9dd9b28f9988 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-31ef3ffc-4c27-44fd-b99b-b78f93aef1c7" returned: 0 in 0.491s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:02 devstack cinder-volume[82760]: DEBUG cinder.coordination [req-de916335-b241-4371-ad3a-15055c6b922e req-d58112bf-77c1-4f18-b779-9dd9b28f9988 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Lock "cinder-quobyte-31ef3ffc-4c27-44fd-b99b-b78f93aef1c7" released by "delete_volume" :: held 1.752s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:45:02 devstack cinder-volume[82760]: DEBUG cinder.quota [req-de916335-b241-4371-ad3a-15055c6b922e req-d58112bf-77c1-4f18-b779-9dd9b28f9988 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Created reservations ['8727df1e-3220-4b0c-b825-bc67051b331a', 'd396a53a-6705-49f0-8fbd-892449c6eb97', '00f9c694-b071-4c92-805c-03c99c28ac1d', '14cb48a4-e9a1-4c0a-9d23-ddf5e2e2832d'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:45:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [req-de916335-b241-4371-ad3a-15055c6b922e req-d58112bf-77c1-4f18-b779-9dd9b28f9988 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:45:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [req-de916335-b241-4371-ad3a-15055c6b922e req-d58112bf-77c1-4f18-b779-9dd9b28f9988 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:45:02 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [req-de916335-b241-4371-ad3a-15055c6b922e req-d58112bf-77c1-4f18-b779-9dd9b28f9988 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:45:02 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [req-de916335-b241-4371-ad3a-15055c6b922e req-d58112bf-77c1-4f18-b779-9dd9b28f9988 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:45:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [req-de916335-b241-4371-ad3a-15055c6b922e req-d58112bf-77c1-4f18-b779-9dd9b28f9988 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:45:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-de916335-b241-4371-ad3a-15055c6b922e req-d58112bf-77c1-4f18-b779-9dd9b28f9988 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:02 devstack sudo[85682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:45:02 devstack sudo[85682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:02 devstack sudo[85682]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-de916335-b241-4371-ad3a-15055c6b922e req-d58112bf-77c1-4f18-b779-9dd9b28f9988 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.553s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:02 devstack cinder-volume[82760]: DEBUG cinder.manager [req-de916335-b241-4371-ad3a-15055c6b922e req-d58112bf-77c1-4f18-b779-9dd9b28f9988 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:45:02 devstack cinder-volume[82760]: INFO cinder.volume.manager [req-de916335-b241-4371-ad3a-15055c6b922e req-d58112bf-77c1-4f18-b779-9dd9b28f9988 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Deleted volume successfully.
Apr 09 12:45:02 devstack cinder-volume[82760]: DEBUG cinder.coordination [req-de916335-b241-4371-ad3a-15055c6b922e req-d58112bf-77c1-4f18-b779-9dd9b28f9988 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Lock "cinder-31ef3ffc-4c27-44fd-b99b-b78f93aef1c7-delete_volume" released by "delete_volume" :: held 2.459s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:45:03 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-6c138d43-4532-4503-b40c-2b4681745546 tempest-GroupsTest-1610602463 None] Acquiring lock "cinder-quobyte-6db180ec-dd36-47cd-b6e1-495b053dc41d" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:45:03 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-6c138d43-4532-4503-b40c-2b4681745546 tempest-GroupsTest-1610602463 None] Lock "cinder-quobyte-6db180ec-dd36-47cd-b6e1-495b053dc41d" acquired by "delete_volume" :: waited 0.012s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:45:03 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf25f16b-1f8e-4edb-a239-ab620611bf1d]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:45:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6c138d43-4532-4503-b40c-2b4681745546 tempest-GroupsTest-1610602463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6db180ec-dd36-47cd-b6e1-495b053dc41d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:03 devstack sudo[85686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6db180ec-dd36-47cd-b6e1-495b053dc41d
Apr 09 12:45:03 devstack sudo[85686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:03 devstack sudo[85686]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6c138d43-4532-4503-b40c-2b4681745546 tempest-GroupsTest-1610602463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6db180ec-dd36-47cd-b6e1-495b053dc41d" returned: 0 in 0.613s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6c138d43-4532-4503-b40c-2b4681745546 tempest-GroupsTest-1610602463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6db180ec-dd36-47cd-b6e1-495b053dc41d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:03 devstack sudo[85691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6db180ec-dd36-47cd-b6e1-495b053dc41d
Apr 09 12:45:03 devstack sudo[85691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:04 devstack sudo[85691]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6c138d43-4532-4503-b40c-2b4681745546 tempest-GroupsTest-1610602463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6db180ec-dd36-47cd-b6e1-495b053dc41d" returned: 0 in 0.537s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:04 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-6c138d43-4532-4503-b40c-2b4681745546 tempest-GroupsTest-1610602463 None] Lock "cinder-quobyte-6db180ec-dd36-47cd-b6e1-495b053dc41d" released by "delete_volume" :: held 1.185s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:45:04 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-6c138d43-4532-4503-b40c-2b4681745546 tempest-GroupsTest-1610602463 None] Created reservations ['d4e06c72-55f9-454d-8e25-e54ae9f57fab'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:45:04 devstack cinder-volume[82760]: WARNING cinder.quota [None req-6c138d43-4532-4503-b40c-2b4681745546 tempest-GroupsTest-1610602463 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-443518261 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-443518261, it is now deprecated. Please use the default quota class for default quota.
Apr 09 12:45:04 devstack cinder-volume[82760]: WARNING cinder.quota [None req-6c138d43-4532-4503-b40c-2b4681745546 tempest-GroupsTest-1610602463 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-443518261 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-443518261, it is now deprecated. Please use the default quota class for default quota.
Apr 09 12:45:04 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-6c138d43-4532-4503-b40c-2b4681745546 tempest-GroupsTest-1610602463 None] Created reservations ['5bc8ea61-0a69-44c7-8daf-ce02a285f741', '9bf99c5f-7ba0-4941-b7dc-36d3fe9e2ed3', 'ef0d8362-6b10-497c-be63-baf0c95182b7', '25f7ef66-fad1-4cac-a0f8-61d210f24e48'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:45:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-6c138d43-4532-4503-b40c-2b4681745546 tempest-GroupsTest-1610602463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:45:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-6c138d43-4532-4503-b40c-2b4681745546 tempest-GroupsTest-1610602463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:45:04 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-6c138d43-4532-4503-b40c-2b4681745546 tempest-GroupsTest-1610602463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:45:04 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-6c138d43-4532-4503-b40c-2b4681745546 tempest-GroupsTest-1610602463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:45:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-6c138d43-4532-4503-b40c-2b4681745546 tempest-GroupsTest-1610602463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:45:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6c138d43-4532-4503-b40c-2b4681745546 tempest-GroupsTest-1610602463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:04 devstack sudo[85699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:45:04 devstack sudo[85699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:05 devstack sudo[85699]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6c138d43-4532-4503-b40c-2b4681745546 tempest-GroupsTest-1610602463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.547s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:05 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-6c138d43-4532-4503-b40c-2b4681745546 tempest-GroupsTest-1610602463 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:45:05 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-6c138d43-4532-4503-b40c-2b4681745546 tempest-GroupsTest-1610602463 None] Delete group completed successfully.
Apr 09 12:45:05 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-339f925c-3d0a-4a84-8d2f-480e0d6541c2 tempest-GroupsTest-1610602463 None] Created reservations ['71e144f1-2c6f-4a5b-8d0e-461f0dadc0bb'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:45:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-339f925c-3d0a-4a84-8d2f-480e0d6541c2 tempest-GroupsTest-1610602463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:45:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-339f925c-3d0a-4a84-8d2f-480e0d6541c2 tempest-GroupsTest-1610602463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:45:05 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-339f925c-3d0a-4a84-8d2f-480e0d6541c2 tempest-GroupsTest-1610602463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:45:05 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-339f925c-3d0a-4a84-8d2f-480e0d6541c2 tempest-GroupsTest-1610602463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:45:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-339f925c-3d0a-4a84-8d2f-480e0d6541c2 tempest-GroupsTest-1610602463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:45:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-339f925c-3d0a-4a84-8d2f-480e0d6541c2 tempest-GroupsTest-1610602463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:05 devstack sudo[85706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:45:05 devstack sudo[85706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:05 devstack sudo[85706]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-339f925c-3d0a-4a84-8d2f-480e0d6541c2 tempest-GroupsTest-1610602463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.502s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:05 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-339f925c-3d0a-4a84-8d2f-480e0d6541c2 tempest-GroupsTest-1610602463 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:45:05 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-339f925c-3d0a-4a84-8d2f-480e0d6541c2 tempest-GroupsTest-1610602463 None] Delete group completed successfully.
Apr 09 12:45:07 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-9c89892d-5930-4543-b059-316bd05614e8 tempest-GroupsTest-1610602463 None] Group tempest-GroupsTest-Group-1259783810: creating
Apr 09 12:45:07 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-9c89892d-5930-4543-b059-316bd05614e8 tempest-GroupsTest-1610602463 None] Group tempest-GroupsTest-Group-1259783810: created successfully
Apr 09 12:45:07 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-9c89892d-5930-4543-b059-316bd05614e8 tempest-GroupsTest-1610602463 None] Create group completed successfully.
Apr 09 12:45:08 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-487024e3-4874-4793-81c9-0848d529af66 tempest-VolumesActionsTest-2128676864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:45:08 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-487024e3-4874-4793-81c9-0848d529af66 tempest-VolumesActionsTest-2128676864 None] Flow 'volume_create_manager' (6ada9a00-68af-4de2-abd7-a26ae5fee899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:45:08 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-487024e3-4874-4793-81c9-0848d529af66 tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (762b4d4a-aeac-427a-8243-d8b9ffe9c303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:08 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-487024e3-4874-4793-81c9-0848d529af66 tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (762b4d4a-aeac-427a-8243-d8b9ffe9c303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:45:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-451341559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d47a6bda-60b8-42df-bef5-18085386610b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5844d191f2346f6861837b2fdebd9c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:45:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:45:08Z,use_quota=True,user_id='4ea38a96fa5b4c7cae4a7b90acc9570f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:08 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-487024e3-4874-4793-81c9-0848d529af66 tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ef5b040-0e75-4235-94aa-bbf37729b7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:08 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-487024e3-4874-4793-81c9-0848d529af66 tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ef5b040-0e75-4235-94aa-bbf37729b7d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:08 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-487024e3-4874-4793-81c9-0848d529af66 tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7676bf18-1f47-4bbc-ad25-c0f87ddc6652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:08 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-487024e3-4874-4793-81c9-0848d529af66 tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7676bf18-1f47-4bbc-ad25-c0f87ddc6652) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd47a6bda-60b8-42df-bef5-18085386610b', 'volume_name': 'volume-d47a6bda-60b8-42df-bef5-18085386610b', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:08 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-487024e3-4874-4793-81c9-0848d529af66 tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f4e5ed6-9bdf-48ae-b423-9b563db86a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:08 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-487024e3-4874-4793-81c9-0848d529af66 tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f4e5ed6-9bdf-48ae-b423-9b563db86a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:08 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-487024e3-4874-4793-81c9-0848d529af66 tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ace281bc-34bf-427f-a92b-faa779de2d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:08 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-487024e3-4874-4793-81c9-0848d529af66 tempest-VolumesActionsTest-2128676864 None] Volume d47a6bda-60b8-42df-bef5-18085386610b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d47a6bda-60b8-42df-bef5-18085386610b', 'volume_size': 1}
Apr 09 12:45:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-487024e3-4874-4793-81c9-0848d529af66 tempest-VolumesActionsTest-2128676864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:45:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-487024e3-4874-4793-81c9-0848d529af66 tempest-VolumesActionsTest-2128676864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:45:08 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-487024e3-4874-4793-81c9-0848d529af66 tempest-VolumesActionsTest-2128676864 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:45:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-451341559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d47a6bda-60b8-42df-bef5-18085386610b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5844d191f2346f6861837b2fdebd9c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:45:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:45:08Z,use_quota=True,user_id='4ea38a96fa5b4c7cae4a7b90acc9570f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:45:08 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-487024e3-4874-4793-81c9-0848d529af66 tempest-VolumesActionsTest-2128676864 None] Creating volume d47a6bda-60b8-42df-bef5-18085386610b {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:45:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-487024e3-4874-4793-81c9-0848d529af66 tempest-VolumesActionsTest-2128676864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:45:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-487024e3-4874-4793-81c9-0848d529af66 tempest-VolumesActionsTest-2128676864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:45:08 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-487024e3-4874-4793-81c9-0848d529af66 tempest-VolumesActionsTest-2128676864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:45:08 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-487024e3-4874-4793-81c9-0848d529af66 tempest-VolumesActionsTest-2128676864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:45:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-487024e3-4874-4793-81c9-0848d529af66 tempest-VolumesActionsTest-2128676864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:45:08 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-487024e3-4874-4793-81c9-0848d529af66 tempest-VolumesActionsTest-2128676864 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:45:08 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-487024e3-4874-4793-81c9-0848d529af66 tempest-VolumesActionsTest-2128676864 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:45:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-487024e3-4874-4793-81c9-0848d529af66 tempest-VolumesActionsTest-2128676864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d47a6bda-60b8-42df-bef5-18085386610b 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:08 devstack sudo[85746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d47a6bda-60b8-42df-bef5-18085386610b 1073741824
Apr 09 12:45:08 devstack sudo[85746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:09 devstack cinder-volume[82760]: DEBUG oslo_service.periodic_task [None req-f8337202-8290-4658-916e-19cfa929172e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82760) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 09 12:45:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f8337202-8290-4658-916e-19cfa929172e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:45:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f8337202-8290-4658-916e-19cfa929172e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:45:09 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f8337202-8290-4658-916e-19cfa929172e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:45:09 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f8337202-8290-4658-916e-19cfa929172e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:45:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f8337202-8290-4658-916e-19cfa929172e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:45:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f8337202-8290-4658-916e-19cfa929172e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:09 devstack sudo[85753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:45:09 devstack sudo[85753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:09 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-a33a4642-79c8-48eb-8866-e4edde53ba55 tempest-GroupsTest-1610602463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:45:09 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-a33a4642-79c8-48eb-8866-e4edde53ba55 tempest-GroupsTest-1610602463 None] Flow 'volume_create_manager' (657c7101-8643-42d9-92c1-24271cbc9284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:45:09 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-a33a4642-79c8-48eb-8866-e4edde53ba55 tempest-GroupsTest-1610602463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f221233-eb0a-4502-8350-fcff23ed5243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:09 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-a33a4642-79c8-48eb-8866-e4edde53ba55 tempest-GroupsTest-1610602463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f221233-eb0a-4502-8350-fcff23ed5243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:45:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-759772723',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d1458dde-50db-4987-9c1d-b4949d4c18ed,host='devstack@QuobyteHD#QuobyteHD',id=a44ade9f-952c-4003-b222-0a82ed8026a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f179128262764329b61b337dca9612ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:45:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:45:09Z,use_quota=True,user_id='feede45eb37c4e348ab8c77bf2d5e0c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6772c4d0-f5ec-4b4d-b465-8fb9af1f5f18),volume_type_id=6772c4d0-f5ec-4b4d-b465-8fb9af1f5f18)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:09 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-a33a4642-79c8-48eb-8866-e4edde53ba55 tempest-GroupsTest-1610602463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92e6552f-2409-4adb-ad6e-05af9e0309c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:09 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-a33a4642-79c8-48eb-8866-e4edde53ba55 tempest-GroupsTest-1610602463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92e6552f-2409-4adb-ad6e-05af9e0309c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:09 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-a33a4642-79c8-48eb-8866-e4edde53ba55 tempest-GroupsTest-1610602463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3872859-d03e-4e53-9a5d-33d9922ae7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:09 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-a33a4642-79c8-48eb-8866-e4edde53ba55 tempest-GroupsTest-1610602463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3872859-d03e-4e53-9a5d-33d9922ae7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a44ade9f-952c-4003-b222-0a82ed8026a8', 'volume_name': 'volume-a44ade9f-952c-4003-b222-0a82ed8026a8', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:09 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-a33a4642-79c8-48eb-8866-e4edde53ba55 tempest-GroupsTest-1610602463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9367d4bc-d9d8-423b-aadf-02e6805db76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:09 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-a33a4642-79c8-48eb-8866-e4edde53ba55 tempest-GroupsTest-1610602463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9367d4bc-d9d8-423b-aadf-02e6805db76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:09 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-a33a4642-79c8-48eb-8866-e4edde53ba55 tempest-GroupsTest-1610602463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b0cbc86-3683-4342-9188-ae65195c9b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:09 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-a33a4642-79c8-48eb-8866-e4edde53ba55 tempest-GroupsTest-1610602463 None] Volume a44ade9f-952c-4003-b222-0a82ed8026a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a44ade9f-952c-4003-b222-0a82ed8026a8', 'volume_size': 1}
Apr 09 12:45:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-a33a4642-79c8-48eb-8866-e4edde53ba55 tempest-GroupsTest-1610602463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:45:09 devstack sudo[85746]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-487024e3-4874-4793-81c9-0848d529af66 tempest-VolumesActionsTest-2128676864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d47a6bda-60b8-42df-bef5-18085386610b 1073741824" returned: 0 in 1.239s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-487024e3-4874-4793-81c9-0848d529af66 tempest-VolumesActionsTest-2128676864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d47a6bda-60b8-42df-bef5-18085386610b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:09 devstack sudo[85755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d47a6bda-60b8-42df-bef5-18085386610b
Apr 09 12:45:09 devstack sudo[85755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:10 devstack sudo[85753]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f8337202-8290-4658-916e-19cfa929172e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.969s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:10 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-f8337202-8290-4658-916e-19cfa929172e None None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:45:10 devstack sudo[85755]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-487024e3-4874-4793-81c9-0848d529af66 tempest-VolumesActionsTest-2128676864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d47a6bda-60b8-42df-bef5-18085386610b" returned: 0 in 0.779s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:10 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-487024e3-4874-4793-81c9-0848d529af66 tempest-VolumesActionsTest-2128676864 None] <== create_volume: return (2091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:45:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-487024e3-4874-4793-81c9-0848d529af66 tempest-VolumesActionsTest-2128676864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.093s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:45:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-a33a4642-79c8-48eb-8866-e4edde53ba55 tempest-GroupsTest-1610602463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.866s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:45:10 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-a33a4642-79c8-48eb-8866-e4edde53ba55 tempest-GroupsTest-1610602463 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=d1458dde-50db-4987-9c1d-b4949d4c18ed,created_at=2026-04-09T10:45:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-759772723',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d1458dde-50db-4987-9c1d-b4949d4c18ed,host='devstack@QuobyteHD#QuobyteHD',id=a44ade9f-952c-4003-b222-0a82ed8026a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f179128262764329b61b337dca9612ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:45:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:45:09Z,use_quota=True,user_id='feede45eb37c4e348ab8c77bf2d5e0c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6772c4d0-f5ec-4b4d-b465-8fb9af1f5f18),volume_type_id=6772c4d0-f5ec-4b4d-b465-8fb9af1f5f18)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:45:10 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-a33a4642-79c8-48eb-8866-e4edde53ba55 tempest-GroupsTest-1610602463 None] Creating volume a44ade9f-952c-4003-b222-0a82ed8026a8 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:45:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-a33a4642-79c8-48eb-8866-e4edde53ba55 tempest-GroupsTest-1610602463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:45:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-a33a4642-79c8-48eb-8866-e4edde53ba55 tempest-GroupsTest-1610602463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:45:10 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-a33a4642-79c8-48eb-8866-e4edde53ba55 tempest-GroupsTest-1610602463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:45:10 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-a33a4642-79c8-48eb-8866-e4edde53ba55 tempest-GroupsTest-1610602463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:45:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-a33a4642-79c8-48eb-8866-e4edde53ba55 tempest-GroupsTest-1610602463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:45:10 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-a33a4642-79c8-48eb-8866-e4edde53ba55 tempest-GroupsTest-1610602463 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:45:10 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-a33a4642-79c8-48eb-8866-e4edde53ba55 tempest-GroupsTest-1610602463 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:45:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-a33a4642-79c8-48eb-8866-e4edde53ba55 tempest-GroupsTest-1610602463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a44ade9f-952c-4003-b222-0a82ed8026a8 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:10 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-487024e3-4874-4793-81c9-0848d529af66 tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ace281bc-34bf-427f-a92b-faa779de2d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d47a6bda-60b8-42df-bef5-18085386610b', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:10 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-487024e3-4874-4793-81c9-0848d529af66 tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f57744b7-953e-4c31-a87f-4cf949729ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:10 devstack sudo[85759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a44ade9f-952c-4003-b222-0a82ed8026a8 1073741824
Apr 09 12:45:10 devstack sudo[85759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:10 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-487024e3-4874-4793-81c9-0848d529af66 tempest-VolumesActionsTest-2128676864 None] Volume volume-d47a6bda-60b8-42df-bef5-18085386610b (d47a6bda-60b8-42df-bef5-18085386610b): created successfully
Apr 09 12:45:10 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-487024e3-4874-4793-81c9-0848d529af66 tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f57744b7-953e-4c31-a87f-4cf949729ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:10 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-487024e3-4874-4793-81c9-0848d529af66 tempest-VolumesActionsTest-2128676864 None] Flow 'volume_create_manager' (6ada9a00-68af-4de2-abd7-a26ae5fee899) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:45:10 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-487024e3-4874-4793-81c9-0848d529af66 tempest-VolumesActionsTest-2128676864 None] Created volume successfully.
Apr 09 12:45:11 devstack sudo[85759]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:11 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-a33a4642-79c8-48eb-8866-e4edde53ba55 tempest-GroupsTest-1610602463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a44ade9f-952c-4003-b222-0a82ed8026a8 1073741824" returned: 0 in 1.097s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:11 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-a33a4642-79c8-48eb-8866-e4edde53ba55 tempest-GroupsTest-1610602463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a44ade9f-952c-4003-b222-0a82ed8026a8 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:11 devstack sudo[85765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a44ade9f-952c-4003-b222-0a82ed8026a8
Apr 09 12:45:11 devstack sudo[85765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:11 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-1d2430ac-a471-4d2e-b70a-0a0c132389ac tempest-VolumesActionsTest-2128676864 None] Acquiring lock "cinder-d47a6bda-60b8-42df-bef5-18085386610b" by "attach_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:45:11 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-1d2430ac-a471-4d2e-b70a-0a0c132389ac tempest-VolumesActionsTest-2128676864 None] Lock "cinder-d47a6bda-60b8-42df-bef5-18085386610b" acquired by "attach_volume" :: waited 0.034s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:45:11 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-1d2430ac-a471-4d2e-b70a-0a0c132389ac tempest-VolumesActionsTest-2128676864 None] Attaching volume d47a6bda-60b8-42df-bef5-18085386610b to instance 56c81101-b44d-4a23-a8af-a02a530e2f6e at mountpoint /dev/vdb on host None.
Apr 09 12:45:11 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-1d2430ac-a471-4d2e-b70a-0a0c132389ac tempest-VolumesActionsTest-2128676864 None] Attach volume completed successfully.
Apr 09 12:45:11 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-1d2430ac-a471-4d2e-b70a-0a0c132389ac tempest-VolumesActionsTest-2128676864 None] Lock "cinder-d47a6bda-60b8-42df-bef5-18085386610b" released by "attach_volume" :: held 0.160s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:45:12 devstack sudo[85765]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:12 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-a33a4642-79c8-48eb-8866-e4edde53ba55 tempest-GroupsTest-1610602463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a44ade9f-952c-4003-b222-0a82ed8026a8" returned: 0 in 0.815s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:12 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-a33a4642-79c8-48eb-8866-e4edde53ba55 tempest-GroupsTest-1610602463 None] <== create_volume: return (2001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:45:12 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-a33a4642-79c8-48eb-8866-e4edde53ba55 tempest-GroupsTest-1610602463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.015s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:45:12 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-a33a4642-79c8-48eb-8866-e4edde53ba55 tempest-GroupsTest-1610602463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b0cbc86-3683-4342-9188-ae65195c9b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a44ade9f-952c-4003-b222-0a82ed8026a8', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:12 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-a33a4642-79c8-48eb-8866-e4edde53ba55 tempest-GroupsTest-1610602463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7945aab6-09fb-48bd-a84a-12b70b82e71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:12 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-a33a4642-79c8-48eb-8866-e4edde53ba55 tempest-GroupsTest-1610602463 None] Volume volume-a44ade9f-952c-4003-b222-0a82ed8026a8 (a44ade9f-952c-4003-b222-0a82ed8026a8): created successfully
Apr 09 12:45:12 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-a33a4642-79c8-48eb-8866-e4edde53ba55 tempest-GroupsTest-1610602463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7945aab6-09fb-48bd-a84a-12b70b82e71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:12 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-a33a4642-79c8-48eb-8866-e4edde53ba55 tempest-GroupsTest-1610602463 None] Flow 'volume_create_manager' (657c7101-8643-42d9-92c1-24271cbc9284) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:45:12 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-a33a4642-79c8-48eb-8866-e4edde53ba55 tempest-GroupsTest-1610602463 None] Created volume successfully.
Apr 09 12:45:13 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-086109e9-4eea-4bf1-9f15-130fc2176ac5 tempest-VolumesActionsTest-883262480 None] Terminate volume connection completed successfully.
Apr 09 12:45:13 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-086109e9-4eea-4bf1-9f15-130fc2176ac5 tempest-VolumesActionsTest-883262480 None] Acquiring lock "cinder-d47a6bda-60b8-42df-bef5-18085386610b-detach_volume" by "detach_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:45:13 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-058d4a01-fc16-4cd4-b478-86e479d1ec4d tempest-GroupsTest-1610602463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:45:13 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-058d4a01-fc16-4cd4-b478-86e479d1ec4d tempest-GroupsTest-1610602463 None] Flow 'volume_create_manager' (aa4c923f-8a05-43ba-a8d6-be35d7bf4c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:45:13 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-058d4a01-fc16-4cd4-b478-86e479d1ec4d tempest-GroupsTest-1610602463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe62f440-fcf2-4ef2-88a9-506314b334b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:13 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-058d4a01-fc16-4cd4-b478-86e479d1ec4d tempest-GroupsTest-1610602463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe62f440-fcf2-4ef2-88a9-506314b334b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:45:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-266974775',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d1458dde-50db-4987-9c1d-b4949d4c18ed,host='devstack@QuobyteHD#QuobyteHD',id=866eb45b-1231-4467-a91c-257ce463db08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f179128262764329b61b337dca9612ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:45:14Z,use_quota=True,user_id='feede45eb37c4e348ab8c77bf2d5e0c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6772c4d0-f5ec-4b4d-b465-8fb9af1f5f18),volume_type_id=6772c4d0-f5ec-4b4d-b465-8fb9af1f5f18)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:13 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-058d4a01-fc16-4cd4-b478-86e479d1ec4d tempest-GroupsTest-1610602463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09857dce-978f-4ef1-8e8f-67df5b011a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:13 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-058d4a01-fc16-4cd4-b478-86e479d1ec4d tempest-GroupsTest-1610602463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09857dce-978f-4ef1-8e8f-67df5b011a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:13 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-058d4a01-fc16-4cd4-b478-86e479d1ec4d tempest-GroupsTest-1610602463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72fccc20-7eba-4879-bdba-15ae289a0996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:13 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-058d4a01-fc16-4cd4-b478-86e479d1ec4d tempest-GroupsTest-1610602463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72fccc20-7eba-4879-bdba-15ae289a0996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '866eb45b-1231-4467-a91c-257ce463db08', 'volume_name': 'volume-866eb45b-1231-4467-a91c-257ce463db08', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:13 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-058d4a01-fc16-4cd4-b478-86e479d1ec4d tempest-GroupsTest-1610602463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12a61a2f-5f23-4042-a776-999d84885904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:13 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-058d4a01-fc16-4cd4-b478-86e479d1ec4d tempest-GroupsTest-1610602463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12a61a2f-5f23-4042-a776-999d84885904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:13 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-058d4a01-fc16-4cd4-b478-86e479d1ec4d tempest-GroupsTest-1610602463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73b03f7b-7e0d-4ef2-8dc9-6d316a5b37e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:13 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-058d4a01-fc16-4cd4-b478-86e479d1ec4d tempest-GroupsTest-1610602463 None] Volume 866eb45b-1231-4467-a91c-257ce463db08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-866eb45b-1231-4467-a91c-257ce463db08', 'volume_size': 1}
Apr 09 12:45:13 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-058d4a01-fc16-4cd4-b478-86e479d1ec4d tempest-GroupsTest-1610602463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:45:13 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-058d4a01-fc16-4cd4-b478-86e479d1ec4d tempest-GroupsTest-1610602463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:45:13 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-058d4a01-fc16-4cd4-b478-86e479d1ec4d tempest-GroupsTest-1610602463 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=d1458dde-50db-4987-9c1d-b4949d4c18ed,created_at=2026-04-09T10:45:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-266974775',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d1458dde-50db-4987-9c1d-b4949d4c18ed,host='devstack@QuobyteHD#QuobyteHD',id=866eb45b-1231-4467-a91c-257ce463db08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f179128262764329b61b337dca9612ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:45:14Z,use_quota=True,user_id='feede45eb37c4e348ab8c77bf2d5e0c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6772c4d0-f5ec-4b4d-b465-8fb9af1f5f18),volume_type_id=6772c4d0-f5ec-4b4d-b465-8fb9af1f5f18)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:45:13 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-058d4a01-fc16-4cd4-b478-86e479d1ec4d tempest-GroupsTest-1610602463 None] Creating volume 866eb45b-1231-4467-a91c-257ce463db08 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:45:13 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-058d4a01-fc16-4cd4-b478-86e479d1ec4d tempest-GroupsTest-1610602463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:45:13 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-058d4a01-fc16-4cd4-b478-86e479d1ec4d tempest-GroupsTest-1610602463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:45:13 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-058d4a01-fc16-4cd4-b478-86e479d1ec4d tempest-GroupsTest-1610602463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:45:13 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-058d4a01-fc16-4cd4-b478-86e479d1ec4d tempest-GroupsTest-1610602463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:45:13 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-058d4a01-fc16-4cd4-b478-86e479d1ec4d tempest-GroupsTest-1610602463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:45:13 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-058d4a01-fc16-4cd4-b478-86e479d1ec4d tempest-GroupsTest-1610602463 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:45:13 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-058d4a01-fc16-4cd4-b478-86e479d1ec4d tempest-GroupsTest-1610602463 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:45:13 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-058d4a01-fc16-4cd4-b478-86e479d1ec4d tempest-GroupsTest-1610602463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-866eb45b-1231-4467-a91c-257ce463db08 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:13 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-086109e9-4eea-4bf1-9f15-130fc2176ac5 tempest-VolumesActionsTest-883262480 None] Lock "cinder-d47a6bda-60b8-42df-bef5-18085386610b-detach_volume" acquired by "detach_volume" :: waited 0.223s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:45:13 devstack sudo[85820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-866eb45b-1231-4467-a91c-257ce463db08 1073741824
Apr 09 12:45:13 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-086109e9-4eea-4bf1-9f15-130fc2176ac5 tempest-VolumesActionsTest-883262480 None] Detaching volume d47a6bda-60b8-42df-bef5-18085386610b from instance 56c81101-b44d-4a23-a8af-a02a530e2f6e.
Apr 09 12:45:13 devstack sudo[85820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:14 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-086109e9-4eea-4bf1-9f15-130fc2176ac5 tempest-VolumesActionsTest-883262480 None] Detach volume completed successfully.
Apr 09 12:45:14 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-086109e9-4eea-4bf1-9f15-130fc2176ac5 tempest-VolumesActionsTest-883262480 None] Lock "cinder-d47a6bda-60b8-42df-bef5-18085386610b-detach_volume" released by "detach_volume" :: held 0.220s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:45:14 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-6aa4c04c-9ffc-4218-be3d-46f8d5f02277 tempest-VolumesActionsTest-2128676864 None] Acquiring lock "cinder-d47a6bda-60b8-42df-bef5-18085386610b-detach_volume" by "detach_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:45:14 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-6aa4c04c-9ffc-4218-be3d-46f8d5f02277 tempest-VolumesActionsTest-2128676864 None] Lock "cinder-d47a6bda-60b8-42df-bef5-18085386610b-detach_volume" acquired by "detach_volume" :: waited 0.013s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:45:14 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-6aa4c04c-9ffc-4218-be3d-46f8d5f02277 tempest-VolumesActionsTest-2128676864 None] Volume detach called, but volume not attached.
Apr 09 12:45:14 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-6aa4c04c-9ffc-4218-be3d-46f8d5f02277 tempest-VolumesActionsTest-2128676864 None] Lock "cinder-d47a6bda-60b8-42df-bef5-18085386610b-detach_volume" released by "detach_volume" :: held 0.019s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:45:15 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-2c97bb64-d7ca-4c3c-bcb5-39f5f89b4e7b tempest-VolumesActionsTest-2128676864 None] Acquiring lock "cinder-d47a6bda-60b8-42df-bef5-18085386610b-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:45:15 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-2c97bb64-d7ca-4c3c-bcb5-39f5f89b4e7b tempest-VolumesActionsTest-2128676864 None] Lock "cinder-d47a6bda-60b8-42df-bef5-18085386610b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:45:15 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-2c97bb64-d7ca-4c3c-bcb5-39f5f89b4e7b tempest-VolumesActionsTest-2128676864 None] Acquiring lock "cinder-quobyte-d47a6bda-60b8-42df-bef5-18085386610b" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:45:15 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-2c97bb64-d7ca-4c3c-bcb5-39f5f89b4e7b tempest-VolumesActionsTest-2128676864 None] Lock "cinder-quobyte-d47a6bda-60b8-42df-bef5-18085386610b" acquired by "delete_volume" :: waited 0.009s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:45:15 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[5730b855-003a-45d4-8053-44153dcc5b83]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:45:15 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2c97bb64-d7ca-4c3c-bcb5-39f5f89b4e7b tempest-VolumesActionsTest-2128676864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d47a6bda-60b8-42df-bef5-18085386610b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:15 devstack sudo[85840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d47a6bda-60b8-42df-bef5-18085386610b
Apr 09 12:45:15 devstack sudo[85840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:15 devstack sudo[85820]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:15 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-058d4a01-fc16-4cd4-b478-86e479d1ec4d tempest-GroupsTest-1610602463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-866eb45b-1231-4467-a91c-257ce463db08 1073741824" returned: 0 in 1.914s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:15 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-058d4a01-fc16-4cd4-b478-86e479d1ec4d tempest-GroupsTest-1610602463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-866eb45b-1231-4467-a91c-257ce463db08 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:15 devstack sudo[85843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-866eb45b-1231-4467-a91c-257ce463db08
Apr 09 12:45:15 devstack sudo[85843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:16 devstack sudo[85840]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:16 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2c97bb64-d7ca-4c3c-bcb5-39f5f89b4e7b tempest-VolumesActionsTest-2128676864 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d47a6bda-60b8-42df-bef5-18085386610b" returned: 0 in 1.220s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:16 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2c97bb64-d7ca-4c3c-bcb5-39f5f89b4e7b tempest-VolumesActionsTest-2128676864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d47a6bda-60b8-42df-bef5-18085386610b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:16 devstack sudo[85850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d47a6bda-60b8-42df-bef5-18085386610b
Apr 09 12:45:16 devstack sudo[85850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:16 devstack sudo[85843]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:16 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-058d4a01-fc16-4cd4-b478-86e479d1ec4d tempest-GroupsTest-1610602463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-866eb45b-1231-4467-a91c-257ce463db08" returned: 0 in 1.152s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:16 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-058d4a01-fc16-4cd4-b478-86e479d1ec4d tempest-GroupsTest-1610602463 None] <== create_volume: return (3160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:45:16 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-058d4a01-fc16-4cd4-b478-86e479d1ec4d tempest-GroupsTest-1610602463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.170s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:45:16 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-058d4a01-fc16-4cd4-b478-86e479d1ec4d tempest-GroupsTest-1610602463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73b03f7b-7e0d-4ef2-8dc9-6d316a5b37e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-866eb45b-1231-4467-a91c-257ce463db08', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:16 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-058d4a01-fc16-4cd4-b478-86e479d1ec4d tempest-GroupsTest-1610602463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f9ee1f0-a841-4242-ac5d-5c8ad3ca0af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:16 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-058d4a01-fc16-4cd4-b478-86e479d1ec4d tempest-GroupsTest-1610602463 None] Volume volume-866eb45b-1231-4467-a91c-257ce463db08 (866eb45b-1231-4467-a91c-257ce463db08): created successfully
Apr 09 12:45:16 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-058d4a01-fc16-4cd4-b478-86e479d1ec4d tempest-GroupsTest-1610602463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f9ee1f0-a841-4242-ac5d-5c8ad3ca0af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:16 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-058d4a01-fc16-4cd4-b478-86e479d1ec4d tempest-GroupsTest-1610602463 None] Flow 'volume_create_manager' (aa4c923f-8a05-43ba-a8d6-be35d7bf4c81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:45:16 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-058d4a01-fc16-4cd4-b478-86e479d1ec4d tempest-GroupsTest-1610602463 None] Created volume successfully.
Apr 09 12:45:17 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-f8ebda9a-e912-4629-b2f3-fb7973682746 tempest-GroupsTest-1610602463 None] Update group completed successfully.
Apr 09 12:45:17 devstack sudo[85850]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:17 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2c97bb64-d7ca-4c3c-bcb5-39f5f89b4e7b tempest-VolumesActionsTest-2128676864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d47a6bda-60b8-42df-bef5-18085386610b" returned: 0 in 0.920s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:17 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-2c97bb64-d7ca-4c3c-bcb5-39f5f89b4e7b tempest-VolumesActionsTest-2128676864 None] Lock "cinder-quobyte-d47a6bda-60b8-42df-bef5-18085386610b" released by "delete_volume" :: held 2.229s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:45:17 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-2c97bb64-d7ca-4c3c-bcb5-39f5f89b4e7b tempest-VolumesActionsTest-2128676864 None] Created reservations ['a91ba98f-ca73-4209-91e2-927e70bb4ada', 'e72ec0b4-aa02-43ce-905a-e45a687334d8', '61728393-0b34-46e1-877f-8d23b530e84d', '80a26390-ab32-4080-9d56-f206c1c4d2a2'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:45:17 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-2c97bb64-d7ca-4c3c-bcb5-39f5f89b4e7b tempest-VolumesActionsTest-2128676864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:45:17 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-2c97bb64-d7ca-4c3c-bcb5-39f5f89b4e7b tempest-VolumesActionsTest-2128676864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:45:17 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-2c97bb64-d7ca-4c3c-bcb5-39f5f89b4e7b tempest-VolumesActionsTest-2128676864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:45:17 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-2c97bb64-d7ca-4c3c-bcb5-39f5f89b4e7b tempest-VolumesActionsTest-2128676864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:45:17 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-2c97bb64-d7ca-4c3c-bcb5-39f5f89b4e7b tempest-VolumesActionsTest-2128676864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:45:17 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2c97bb64-d7ca-4c3c-bcb5-39f5f89b4e7b tempest-VolumesActionsTest-2128676864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:17 devstack sudo[85858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:45:17 devstack sudo[85858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:17 devstack cinder-volume[82760]: INFO cinder.volume.manager [req-4a119d26-bbbf-40f8-8a6f-94a5c0027a0e req-af76af66-a581-4721-9028-8536f856cc1c tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Terminate volume connection completed successfully.
Apr 09 12:45:17 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-4a119d26-bbbf-40f8-8a6f-94a5c0027a0e req-af76af66-a581-4721-9028-8536f856cc1c tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Deleting attachment 277b0064-2dc8-4f95-9cdd-75f5353a876d. {{(pid=82760) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 09 12:45:18 devstack sudo[85858]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2c97bb64-d7ca-4c3c-bcb5-39f5f89b4e7b tempest-VolumesActionsTest-2128676864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.488s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:18 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-2c97bb64-d7ca-4c3c-bcb5-39f5f89b4e7b tempest-VolumesActionsTest-2128676864 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:45:18 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-2c97bb64-d7ca-4c3c-bcb5-39f5f89b4e7b tempest-VolumesActionsTest-2128676864 None] Deleted volume successfully.
Apr 09 12:45:18 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-2c97bb64-d7ca-4c3c-bcb5-39f5f89b4e7b tempest-VolumesActionsTest-2128676864 None] Lock "cinder-d47a6bda-60b8-42df-bef5-18085386610b-delete_volume" released by "delete_volume" :: held 2.925s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:45:18 devstack cinder-volume[82760]: DEBUG cinder.coordination [req-4a119d26-bbbf-40f8-8a6f-94a5c0027a0e req-9fde13ce-da1c-4e35-be5b-ab38e84accc7 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Acquiring lock "cinder-1abe0eb1-6189-4ca3-a071-efbcb69e9053-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:45:18 devstack cinder-volume[82760]: DEBUG cinder.coordination [req-4a119d26-bbbf-40f8-8a6f-94a5c0027a0e req-9fde13ce-da1c-4e35-be5b-ab38e84accc7 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Lock "cinder-1abe0eb1-6189-4ca3-a071-efbcb69e9053-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:45:18 devstack cinder-volume[82760]: DEBUG cinder.coordination [req-4a119d26-bbbf-40f8-8a6f-94a5c0027a0e req-9fde13ce-da1c-4e35-be5b-ab38e84accc7 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Acquiring lock "cinder-quobyte-1abe0eb1-6189-4ca3-a071-efbcb69e9053" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:45:18 devstack cinder-volume[82760]: DEBUG cinder.coordination [req-4a119d26-bbbf-40f8-8a6f-94a5c0027a0e req-9fde13ce-da1c-4e35-be5b-ab38e84accc7 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Lock "cinder-quobyte-1abe0eb1-6189-4ca3-a071-efbcb69e9053" acquired by "delete_volume" :: waited 0.027s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:45:18 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9daee4-292a-49c9-9b9f-511c951aa6e8]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:45:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-4a119d26-bbbf-40f8-8a6f-94a5c0027a0e req-9fde13ce-da1c-4e35-be5b-ab38e84accc7 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1abe0eb1-6189-4ca3-a071-efbcb69e9053 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:18 devstack sudo[85888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1abe0eb1-6189-4ca3-a071-efbcb69e9053
Apr 09 12:45:19 devstack sudo[85888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:19 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-dc032f11-6b95-4f35-8f00-05d26d4c1760 tempest-GroupsTest-1610602463 None] Update group completed successfully.
Apr 09 12:45:19 devstack sudo[85888]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-4a119d26-bbbf-40f8-8a6f-94a5c0027a0e req-9fde13ce-da1c-4e35-be5b-ab38e84accc7 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1abe0eb1-6189-4ca3-a071-efbcb69e9053" returned: 0 in 1.289s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-4a119d26-bbbf-40f8-8a6f-94a5c0027a0e req-9fde13ce-da1c-4e35-be5b-ab38e84accc7 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1abe0eb1-6189-4ca3-a071-efbcb69e9053 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:20 devstack sudo[85901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1abe0eb1-6189-4ca3-a071-efbcb69e9053
Apr 09 12:45:20 devstack sudo[85901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:20 devstack sudo[85901]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:20 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-4a119d26-bbbf-40f8-8a6f-94a5c0027a0e req-9fde13ce-da1c-4e35-be5b-ab38e84accc7 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1abe0eb1-6189-4ca3-a071-efbcb69e9053" returned: 0 in 0.738s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:20 devstack cinder-volume[82760]: DEBUG cinder.coordination [req-4a119d26-bbbf-40f8-8a6f-94a5c0027a0e req-9fde13ce-da1c-4e35-be5b-ab38e84accc7 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Lock "cinder-quobyte-1abe0eb1-6189-4ca3-a071-efbcb69e9053" released by "delete_volume" :: held 2.261s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:45:20 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-0bb18e0f-348a-4fee-ad98-afafdb1f5657 tempest-GroupsTest-1610602463 None] Acquiring lock "cinder-quobyte-866eb45b-1231-4467-a91c-257ce463db08" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:45:20 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-0bb18e0f-348a-4fee-ad98-afafdb1f5657 tempest-GroupsTest-1610602463 None] Lock "cinder-quobyte-866eb45b-1231-4467-a91c-257ce463db08" acquired by "delete_volume" :: waited 0.050s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:45:20 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ba0c8a-3388-48c4-8616-be9078a2c918]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:45:20 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-0bb18e0f-348a-4fee-ad98-afafdb1f5657 tempest-GroupsTest-1610602463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-866eb45b-1231-4467-a91c-257ce463db08 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:20 devstack cinder-volume[82760]: DEBUG cinder.quota [req-4a119d26-bbbf-40f8-8a6f-94a5c0027a0e req-9fde13ce-da1c-4e35-be5b-ab38e84accc7 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Created reservations ['3735da6d-abb8-4530-915e-ac1267ffe482', '2bc9f878-de61-4ed8-a2c2-914fdd5a48a6', 'cc8e3242-072d-49f2-aa76-be27615e8605', 'd887b04a-ff27-4957-82d0-2210666f7464'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:45:21 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [req-4a119d26-bbbf-40f8-8a6f-94a5c0027a0e req-9fde13ce-da1c-4e35-be5b-ab38e84accc7 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:45:21 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [req-4a119d26-bbbf-40f8-8a6f-94a5c0027a0e req-9fde13ce-da1c-4e35-be5b-ab38e84accc7 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:45:21 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [req-4a119d26-bbbf-40f8-8a6f-94a5c0027a0e req-9fde13ce-da1c-4e35-be5b-ab38e84accc7 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:45:21 devstack sudo[85923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-866eb45b-1231-4467-a91c-257ce463db08
Apr 09 12:45:21 devstack sudo[85923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:21 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [req-4a119d26-bbbf-40f8-8a6f-94a5c0027a0e req-9fde13ce-da1c-4e35-be5b-ab38e84accc7 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:45:21 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [req-4a119d26-bbbf-40f8-8a6f-94a5c0027a0e req-9fde13ce-da1c-4e35-be5b-ab38e84accc7 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:45:21 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-4a119d26-bbbf-40f8-8a6f-94a5c0027a0e req-9fde13ce-da1c-4e35-be5b-ab38e84accc7 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:21 devstack sudo[85925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:45:21 devstack sudo[85925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:21 devstack sudo[85923]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:21 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-0bb18e0f-348a-4fee-ad98-afafdb1f5657 tempest-GroupsTest-1610602463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-866eb45b-1231-4467-a91c-257ce463db08" returned: 0 in 1.013s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:21 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-0bb18e0f-348a-4fee-ad98-afafdb1f5657 tempest-GroupsTest-1610602463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-866eb45b-1231-4467-a91c-257ce463db08 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:22 devstack sudo[85934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-866eb45b-1231-4467-a91c-257ce463db08
Apr 09 12:45:22 devstack sudo[85934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:22 devstack sudo[85925]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:22 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-4a119d26-bbbf-40f8-8a6f-94a5c0027a0e req-9fde13ce-da1c-4e35-be5b-ab38e84accc7 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 1.031s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:22 devstack cinder-volume[82760]: DEBUG cinder.manager [req-4a119d26-bbbf-40f8-8a6f-94a5c0027a0e req-9fde13ce-da1c-4e35-be5b-ab38e84accc7 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:45:22 devstack cinder-volume[82760]: INFO cinder.volume.manager [req-4a119d26-bbbf-40f8-8a6f-94a5c0027a0e req-9fde13ce-da1c-4e35-be5b-ab38e84accc7 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Deleted volume successfully.
Apr 09 12:45:22 devstack cinder-volume[82760]: DEBUG cinder.coordination [req-4a119d26-bbbf-40f8-8a6f-94a5c0027a0e req-9fde13ce-da1c-4e35-be5b-ab38e84accc7 tempest-ServerBootFromVolumeStableRescueTest-2124136809 None] Lock "cinder-1abe0eb1-6189-4ca3-a071-efbcb69e9053-delete_volume" released by "delete_volume" :: held 3.744s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:45:22 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-91682c3f-4ed7-448a-800e-fb3984b20c18 tempest-ServerRescueNegativeTestJSON-957534914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:45:22 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-91682c3f-4ed7-448a-800e-fb3984b20c18 tempest-ServerRescueNegativeTestJSON-957534914 None] Flow 'volume_create_manager' (56b69b4a-5941-4e73-b7a1-ea2b8be41ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:45:22 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-91682c3f-4ed7-448a-800e-fb3984b20c18 tempest-ServerRescueNegativeTestJSON-957534914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3fdba14-004a-4977-b128-c5e32aa1ff4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:22 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-91682c3f-4ed7-448a-800e-fb3984b20c18 tempest-ServerRescueNegativeTestJSON-957534914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3fdba14-004a-4977-b128-c5e32aa1ff4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:45:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1452848523',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab2d0c3e-da70-4bcf-bc7c-571f3e2d1be6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b5004c803ea481c84fe70385cb5d5c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:45:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:45:23Z,use_quota=True,user_id='084c905b62a347ad86a090d1cee61d08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:22 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-91682c3f-4ed7-448a-800e-fb3984b20c18 tempest-ServerRescueNegativeTestJSON-957534914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12e22caf-c75c-4b1b-b82b-7121f0201f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:22 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-91682c3f-4ed7-448a-800e-fb3984b20c18 tempest-ServerRescueNegativeTestJSON-957534914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12e22caf-c75c-4b1b-b82b-7121f0201f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:22 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-91682c3f-4ed7-448a-800e-fb3984b20c18 tempest-ServerRescueNegativeTestJSON-957534914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8b43795-9545-4559-97e2-f9c386f0a690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:22 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-91682c3f-4ed7-448a-800e-fb3984b20c18 tempest-ServerRescueNegativeTestJSON-957534914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8b43795-9545-4559-97e2-f9c386f0a690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab2d0c3e-da70-4bcf-bc7c-571f3e2d1be6', 'volume_name': 'volume-ab2d0c3e-da70-4bcf-bc7c-571f3e2d1be6', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:22 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-91682c3f-4ed7-448a-800e-fb3984b20c18 tempest-ServerRescueNegativeTestJSON-957534914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04ec60d0-d4e8-4b64-95c0-92b9f5faac1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:22 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-91682c3f-4ed7-448a-800e-fb3984b20c18 tempest-ServerRescueNegativeTestJSON-957534914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04ec60d0-d4e8-4b64-95c0-92b9f5faac1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:22 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-91682c3f-4ed7-448a-800e-fb3984b20c18 tempest-ServerRescueNegativeTestJSON-957534914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d72767c0-789b-4862-ada8-092f8d1319c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:22 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-91682c3f-4ed7-448a-800e-fb3984b20c18 tempest-ServerRescueNegativeTestJSON-957534914 None] Volume ab2d0c3e-da70-4bcf-bc7c-571f3e2d1be6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab2d0c3e-da70-4bcf-bc7c-571f3e2d1be6', 'volume_size': 1}
Apr 09 12:45:22 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-91682c3f-4ed7-448a-800e-fb3984b20c18 tempest-ServerRescueNegativeTestJSON-957534914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:45:22 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-91682c3f-4ed7-448a-800e-fb3984b20c18 tempest-ServerRescueNegativeTestJSON-957534914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:45:22 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-91682c3f-4ed7-448a-800e-fb3984b20c18 tempest-ServerRescueNegativeTestJSON-957534914 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:45:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1452848523',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab2d0c3e-da70-4bcf-bc7c-571f3e2d1be6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b5004c803ea481c84fe70385cb5d5c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:45:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:45:23Z,use_quota=True,user_id='084c905b62a347ad86a090d1cee61d08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:45:22 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-91682c3f-4ed7-448a-800e-fb3984b20c18 tempest-ServerRescueNegativeTestJSON-957534914 None] Creating volume ab2d0c3e-da70-4bcf-bc7c-571f3e2d1be6 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:45:22 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-91682c3f-4ed7-448a-800e-fb3984b20c18 tempest-ServerRescueNegativeTestJSON-957534914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:45:22 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-91682c3f-4ed7-448a-800e-fb3984b20c18 tempest-ServerRescueNegativeTestJSON-957534914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:45:22 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-91682c3f-4ed7-448a-800e-fb3984b20c18 tempest-ServerRescueNegativeTestJSON-957534914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:45:22 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-91682c3f-4ed7-448a-800e-fb3984b20c18 tempest-ServerRescueNegativeTestJSON-957534914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:45:22 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-91682c3f-4ed7-448a-800e-fb3984b20c18 tempest-ServerRescueNegativeTestJSON-957534914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:45:22 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-91682c3f-4ed7-448a-800e-fb3984b20c18 tempest-ServerRescueNegativeTestJSON-957534914 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:45:22 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-91682c3f-4ed7-448a-800e-fb3984b20c18 tempest-ServerRescueNegativeTestJSON-957534914 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:45:22 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-91682c3f-4ed7-448a-800e-fb3984b20c18 tempest-ServerRescueNegativeTestJSON-957534914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ab2d0c3e-da70-4bcf-bc7c-571f3e2d1be6 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:22 devstack sudo[85941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ab2d0c3e-da70-4bcf-bc7c-571f3e2d1be6 1073741824
Apr 09 12:45:22 devstack sudo[85941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:23 devstack sudo[85934]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-0bb18e0f-348a-4fee-ad98-afafdb1f5657 tempest-GroupsTest-1610602463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-866eb45b-1231-4467-a91c-257ce463db08" returned: 0 in 1.220s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:23 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-0bb18e0f-348a-4fee-ad98-afafdb1f5657 tempest-GroupsTest-1610602463 None] Lock "cinder-quobyte-866eb45b-1231-4467-a91c-257ce463db08" released by "delete_volume" :: held 2.289s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:45:23 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-0bb18e0f-348a-4fee-ad98-afafdb1f5657 tempest-GroupsTest-1610602463 None] Acquiring lock "cinder-quobyte-a44ade9f-952c-4003-b222-0a82ed8026a8" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:45:23 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-0bb18e0f-348a-4fee-ad98-afafdb1f5657 tempest-GroupsTest-1610602463 None] Lock "cinder-quobyte-a44ade9f-952c-4003-b222-0a82ed8026a8" acquired by "delete_volume" :: waited 0.013s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:45:23 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6903ea-f252-4658-a417-a18633d23932]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:45:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-0bb18e0f-348a-4fee-ad98-afafdb1f5657 tempest-GroupsTest-1610602463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a44ade9f-952c-4003-b222-0a82ed8026a8 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:23 devstack sudo[85958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a44ade9f-952c-4003-b222-0a82ed8026a8
Apr 09 12:45:23 devstack sudo[85958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:23 devstack sudo[85941]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-91682c3f-4ed7-448a-800e-fb3984b20c18 tempest-ServerRescueNegativeTestJSON-957534914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ab2d0c3e-da70-4bcf-bc7c-571f3e2d1be6 1073741824" returned: 0 in 0.927s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-91682c3f-4ed7-448a-800e-fb3984b20c18 tempest-ServerRescueNegativeTestJSON-957534914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ab2d0c3e-da70-4bcf-bc7c-571f3e2d1be6 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:23 devstack sudo[85977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ab2d0c3e-da70-4bcf-bc7c-571f3e2d1be6
Apr 09 12:45:23 devstack sudo[85977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:24 devstack sudo[85958]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-0bb18e0f-348a-4fee-ad98-afafdb1f5657 tempest-GroupsTest-1610602463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a44ade9f-952c-4003-b222-0a82ed8026a8" returned: 0 in 0.961s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-0bb18e0f-348a-4fee-ad98-afafdb1f5657 tempest-GroupsTest-1610602463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a44ade9f-952c-4003-b222-0a82ed8026a8 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:24 devstack sudo[85983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a44ade9f-952c-4003-b222-0a82ed8026a8
Apr 09 12:45:24 devstack sudo[85983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:24 devstack sudo[85977]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-91682c3f-4ed7-448a-800e-fb3984b20c18 tempest-ServerRescueNegativeTestJSON-957534914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ab2d0c3e-da70-4bcf-bc7c-571f3e2d1be6" returned: 0 in 0.999s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:24 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-91682c3f-4ed7-448a-800e-fb3984b20c18 tempest-ServerRescueNegativeTestJSON-957534914 None] <== create_volume: return (1978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:45:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-91682c3f-4ed7-448a-800e-fb3984b20c18 tempest-ServerRescueNegativeTestJSON-957534914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.981s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:45:24 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-91682c3f-4ed7-448a-800e-fb3984b20c18 tempest-ServerRescueNegativeTestJSON-957534914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d72767c0-789b-4862-ada8-092f8d1319c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab2d0c3e-da70-4bcf-bc7c-571f3e2d1be6', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:24 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-91682c3f-4ed7-448a-800e-fb3984b20c18 tempest-ServerRescueNegativeTestJSON-957534914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b9a06a4-b330-48b3-8140-1d95b86405d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:24 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-91682c3f-4ed7-448a-800e-fb3984b20c18 tempest-ServerRescueNegativeTestJSON-957534914 None] Volume volume-ab2d0c3e-da70-4bcf-bc7c-571f3e2d1be6 (ab2d0c3e-da70-4bcf-bc7c-571f3e2d1be6): created successfully
Apr 09 12:45:24 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-91682c3f-4ed7-448a-800e-fb3984b20c18 tempest-ServerRescueNegativeTestJSON-957534914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b9a06a4-b330-48b3-8140-1d95b86405d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:24 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-91682c3f-4ed7-448a-800e-fb3984b20c18 tempest-ServerRescueNegativeTestJSON-957534914 None] Flow 'volume_create_manager' (56b69b4a-5941-4e73-b7a1-ea2b8be41ea7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:45:24 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-91682c3f-4ed7-448a-800e-fb3984b20c18 tempest-ServerRescueNegativeTestJSON-957534914 None] Created volume successfully.
Apr 09 12:45:25 devstack sudo[85983]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-0bb18e0f-348a-4fee-ad98-afafdb1f5657 tempest-GroupsTest-1610602463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a44ade9f-952c-4003-b222-0a82ed8026a8" returned: 0 in 0.797s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:25 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-0bb18e0f-348a-4fee-ad98-afafdb1f5657 tempest-GroupsTest-1610602463 None] Lock "cinder-quobyte-a44ade9f-952c-4003-b222-0a82ed8026a8" released by "delete_volume" :: held 1.847s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:45:25 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-0bb18e0f-348a-4fee-ad98-afafdb1f5657 tempest-GroupsTest-1610602463 None] Created reservations ['8633a8c0-7737-406b-a2ba-354f80149c0d'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:45:25 devstack cinder-volume[82760]: WARNING cinder.quota [None req-0bb18e0f-348a-4fee-ad98-afafdb1f5657 tempest-GroupsTest-1610602463 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-678612087 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-678612087, it is now deprecated. Please use the default quota class for default quota.
Apr 09 12:45:25 devstack cinder-volume[82760]: WARNING cinder.quota [None req-0bb18e0f-348a-4fee-ad98-afafdb1f5657 tempest-GroupsTest-1610602463 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-678612087 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-678612087, it is now deprecated. Please use the default quota class for default quota.
Apr 09 12:45:25 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-0bb18e0f-348a-4fee-ad98-afafdb1f5657 tempest-GroupsTest-1610602463 None] Created reservations ['8624ed53-0658-419d-a40a-189fd52012f8', 'bf6fa579-c8c7-4d56-adfa-828f30ef4b64', '03616543-fc0c-4d5c-8c5c-94c9384275fb', 'cf7af7f2-3eed-429c-92c5-700ec44459e0'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:45:25 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-0bb18e0f-348a-4fee-ad98-afafdb1f5657 tempest-GroupsTest-1610602463 None] Created reservations ['fc26e61b-58fe-464c-988d-be0ae0e6b287', '5e961058-3dba-4a78-be6d-3a6785c09f64', 'cba1377a-c893-446a-8b7f-d7af8efcad67', 'ac701426-c9a4-4056-a9c5-d16e5f9666d2'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:45:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-0bb18e0f-348a-4fee-ad98-afafdb1f5657 tempest-GroupsTest-1610602463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:45:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-0bb18e0f-348a-4fee-ad98-afafdb1f5657 tempest-GroupsTest-1610602463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:45:25 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-0bb18e0f-348a-4fee-ad98-afafdb1f5657 tempest-GroupsTest-1610602463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:45:25 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-0bb18e0f-348a-4fee-ad98-afafdb1f5657 tempest-GroupsTest-1610602463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:45:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-0bb18e0f-348a-4fee-ad98-afafdb1f5657 tempest-GroupsTest-1610602463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:45:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-0bb18e0f-348a-4fee-ad98-afafdb1f5657 tempest-GroupsTest-1610602463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:25 devstack sudo[85990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:45:25 devstack sudo[85990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:25 devstack sudo[85990]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-0bb18e0f-348a-4fee-ad98-afafdb1f5657 tempest-GroupsTest-1610602463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.625s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:25 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-0bb18e0f-348a-4fee-ad98-afafdb1f5657 tempest-GroupsTest-1610602463 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:45:25 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-0bb18e0f-348a-4fee-ad98-afafdb1f5657 tempest-GroupsTest-1610602463 None] Delete group completed successfully.
Apr 09 12:45:26 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef5d2ea0-3ceb-47d5-9f62-118480221d9d tempest-VolumesActionsTest-2128676864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:45:26 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ef5d2ea0-3ceb-47d5-9f62-118480221d9d tempest-VolumesActionsTest-2128676864 None] Flow 'volume_create_manager' (150e71ef-462f-4372-a787-669d13cc42e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:45:26 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ef5d2ea0-3ceb-47d5-9f62-118480221d9d tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4912a2a-775a-4b80-a22e-2b24949c9fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:26 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ef5d2ea0-3ceb-47d5-9f62-118480221d9d tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4912a2a-775a-4b80-a22e-2b24949c9fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-625993800',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddabd91b-8ddb-44f4-892c-2245b58b6c25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5844d191f2346f6861837b2fdebd9c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:45:26Z,use_quota=True,user_id='4ea38a96fa5b4c7cae4a7b90acc9570f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:26 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ef5d2ea0-3ceb-47d5-9f62-118480221d9d tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1079842d-0827-451a-bb47-d78a6c2bf5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:26 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ef5d2ea0-3ceb-47d5-9f62-118480221d9d tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1079842d-0827-451a-bb47-d78a6c2bf5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:26 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ef5d2ea0-3ceb-47d5-9f62-118480221d9d tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb3dd19e-8a69-48e3-ab1a-b99996c359c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:26 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ef5d2ea0-3ceb-47d5-9f62-118480221d9d tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb3dd19e-8a69-48e3-ab1a-b99996c359c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddabd91b-8ddb-44f4-892c-2245b58b6c25', 'volume_name': 'volume-ddabd91b-8ddb-44f4-892c-2245b58b6c25', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:26 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ef5d2ea0-3ceb-47d5-9f62-118480221d9d tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ce5575d-32fc-4ffa-825b-d79a4d8fa212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:26 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ef5d2ea0-3ceb-47d5-9f62-118480221d9d tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ce5575d-32fc-4ffa-825b-d79a4d8fa212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:26 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ef5d2ea0-3ceb-47d5-9f62-118480221d9d tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8726f358-854b-4e2c-9916-7688add92ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:26 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-ef5d2ea0-3ceb-47d5-9f62-118480221d9d tempest-VolumesActionsTest-2128676864 None] Volume ddabd91b-8ddb-44f4-892c-2245b58b6c25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddabd91b-8ddb-44f4-892c-2245b58b6c25', 'volume_size': 1}
Apr 09 12:45:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ef5d2ea0-3ceb-47d5-9f62-118480221d9d tempest-VolumesActionsTest-2128676864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:45:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ef5d2ea0-3ceb-47d5-9f62-118480221d9d tempest-VolumesActionsTest-2128676864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:45:26 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-ef5d2ea0-3ceb-47d5-9f62-118480221d9d tempest-VolumesActionsTest-2128676864 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-625993800',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddabd91b-8ddb-44f4-892c-2245b58b6c25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5844d191f2346f6861837b2fdebd9c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:45:26Z,use_quota=True,user_id='4ea38a96fa5b4c7cae4a7b90acc9570f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:45:26 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-ef5d2ea0-3ceb-47d5-9f62-118480221d9d tempest-VolumesActionsTest-2128676864 None] Creating volume ddabd91b-8ddb-44f4-892c-2245b58b6c25 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:45:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ef5d2ea0-3ceb-47d5-9f62-118480221d9d tempest-VolumesActionsTest-2128676864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:45:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ef5d2ea0-3ceb-47d5-9f62-118480221d9d tempest-VolumesActionsTest-2128676864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:45:26 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-ef5d2ea0-3ceb-47d5-9f62-118480221d9d tempest-VolumesActionsTest-2128676864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:45:26 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-ef5d2ea0-3ceb-47d5-9f62-118480221d9d tempest-VolumesActionsTest-2128676864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:45:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ef5d2ea0-3ceb-47d5-9f62-118480221d9d tempest-VolumesActionsTest-2128676864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:45:26 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-ef5d2ea0-3ceb-47d5-9f62-118480221d9d tempest-VolumesActionsTest-2128676864 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:45:26 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-ef5d2ea0-3ceb-47d5-9f62-118480221d9d tempest-VolumesActionsTest-2128676864 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:45:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ef5d2ea0-3ceb-47d5-9f62-118480221d9d tempest-VolumesActionsTest-2128676864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ddabd91b-8ddb-44f4-892c-2245b58b6c25 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:26 devstack sudo[85994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ddabd91b-8ddb-44f4-892c-2245b58b6c25 1073741824
Apr 09 12:45:26 devstack sudo[85994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:27 devstack sudo[85994]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ef5d2ea0-3ceb-47d5-9f62-118480221d9d tempest-VolumesActionsTest-2128676864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ddabd91b-8ddb-44f4-892c-2245b58b6c25 1073741824" returned: 0 in 0.857s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ef5d2ea0-3ceb-47d5-9f62-118480221d9d tempest-VolumesActionsTest-2128676864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ddabd91b-8ddb-44f4-892c-2245b58b6c25 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:27 devstack sudo[86000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ddabd91b-8ddb-44f4-892c-2245b58b6c25
Apr 09 12:45:27 devstack sudo[86000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:28 devstack sudo[86000]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:28 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ef5d2ea0-3ceb-47d5-9f62-118480221d9d tempest-VolumesActionsTest-2128676864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ddabd91b-8ddb-44f4-892c-2245b58b6c25" returned: 0 in 0.870s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:28 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-ef5d2ea0-3ceb-47d5-9f62-118480221d9d tempest-VolumesActionsTest-2128676864 None] <== create_volume: return (1796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:45:28 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ef5d2ea0-3ceb-47d5-9f62-118480221d9d tempest-VolumesActionsTest-2128676864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.800s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:45:28 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ef5d2ea0-3ceb-47d5-9f62-118480221d9d tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8726f358-854b-4e2c-9916-7688add92ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddabd91b-8ddb-44f4-892c-2245b58b6c25', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:28 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ef5d2ea0-3ceb-47d5-9f62-118480221d9d tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0b1c9b3-d015-4c2c-b50f-d6d02ecf15ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:28 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-ef5d2ea0-3ceb-47d5-9f62-118480221d9d tempest-VolumesActionsTest-2128676864 None] Volume volume-ddabd91b-8ddb-44f4-892c-2245b58b6c25 (ddabd91b-8ddb-44f4-892c-2245b58b6c25): created successfully
Apr 09 12:45:28 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ef5d2ea0-3ceb-47d5-9f62-118480221d9d tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0b1c9b3-d015-4c2c-b50f-d6d02ecf15ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:28 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ef5d2ea0-3ceb-47d5-9f62-118480221d9d tempest-VolumesActionsTest-2128676864 None] Flow 'volume_create_manager' (150e71ef-462f-4372-a787-669d13cc42e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:45:28 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-ef5d2ea0-3ceb-47d5-9f62-118480221d9d tempest-VolumesActionsTest-2128676864 None] Created volume successfully.
Apr 09 12:45:28 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-fa2c6ced-6686-4fc0-9c70-b3a53a895f3a tempest-VolumesActionsTest-883262480 None] Acquiring lock "cinder-ddabd91b-8ddb-44f4-892c-2245b58b6c25-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:45:28 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-fa2c6ced-6686-4fc0-9c70-b3a53a895f3a tempest-VolumesActionsTest-883262480 None] Lock "cinder-ddabd91b-8ddb-44f4-892c-2245b58b6c25-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:45:28 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-fa2c6ced-6686-4fc0-9c70-b3a53a895f3a tempest-VolumesActionsTest-883262480 None] Acquiring lock "cinder-quobyte-ddabd91b-8ddb-44f4-892c-2245b58b6c25" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:45:28 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-fa2c6ced-6686-4fc0-9c70-b3a53a895f3a tempest-VolumesActionsTest-883262480 None] Lock "cinder-quobyte-ddabd91b-8ddb-44f4-892c-2245b58b6c25" acquired by "delete_volume" :: waited 0.020s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:45:28 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eae443f-3f18-4bf3-b695-86eced215c65]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:45:28 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-fa2c6ced-6686-4fc0-9c70-b3a53a895f3a tempest-VolumesActionsTest-883262480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ddabd91b-8ddb-44f4-892c-2245b58b6c25 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:29 devstack sudo[86003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ddabd91b-8ddb-44f4-892c-2245b58b6c25
Apr 09 12:45:29 devstack sudo[86003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:30 devstack sudo[86003]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:30 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-fa2c6ced-6686-4fc0-9c70-b3a53a895f3a tempest-VolumesActionsTest-883262480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ddabd91b-8ddb-44f4-892c-2245b58b6c25" returned: 0 in 1.070s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:30 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-fa2c6ced-6686-4fc0-9c70-b3a53a895f3a tempest-VolumesActionsTest-883262480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ddabd91b-8ddb-44f4-892c-2245b58b6c25 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:30 devstack sudo[86009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ddabd91b-8ddb-44f4-892c-2245b58b6c25
Apr 09 12:45:30 devstack sudo[86009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:30 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-114e66d8-1b02-4c25-a60c-cd6446cf6756 tempest-GroupsV314Test-1355707685 None] Group tempest-GroupsV314Test-Group-1374434602: creating
Apr 09 12:45:30 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-114e66d8-1b02-4c25-a60c-cd6446cf6756 tempest-GroupsV314Test-1355707685 None] Group tempest-GroupsV314Test-Group-1374434602: created successfully
Apr 09 12:45:30 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-114e66d8-1b02-4c25-a60c-cd6446cf6756 tempest-GroupsV314Test-1355707685 None] Create group completed successfully.
Apr 09 12:45:31 devstack sudo[86009]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:31 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-fa2c6ced-6686-4fc0-9c70-b3a53a895f3a tempest-VolumesActionsTest-883262480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ddabd91b-8ddb-44f4-892c-2245b58b6c25" returned: 0 in 0.998s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:31 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-fa2c6ced-6686-4fc0-9c70-b3a53a895f3a tempest-VolumesActionsTest-883262480 None] Lock "cinder-quobyte-ddabd91b-8ddb-44f4-892c-2245b58b6c25" released by "delete_volume" :: held 2.097s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:45:31 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-fa2c6ced-6686-4fc0-9c70-b3a53a895f3a tempest-VolumesActionsTest-883262480 None] Created reservations ['416e99fe-4b4a-4b29-b1d4-1560702d5732', 'f9cf085a-d649-49b3-a71d-f84c01c7eae5', 'e11cbf25-aa29-4416-89d2-984f6976a7a5', 'b13f922a-4e32-48e3-8e7c-a4586dcdb43f'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:45:31 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-fa2c6ced-6686-4fc0-9c70-b3a53a895f3a tempest-VolumesActionsTest-883262480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:45:31 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-fa2c6ced-6686-4fc0-9c70-b3a53a895f3a tempest-VolumesActionsTest-883262480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:45:31 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-fa2c6ced-6686-4fc0-9c70-b3a53a895f3a tempest-VolumesActionsTest-883262480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:45:31 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-fa2c6ced-6686-4fc0-9c70-b3a53a895f3a tempest-VolumesActionsTest-883262480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:45:31 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-fa2c6ced-6686-4fc0-9c70-b3a53a895f3a tempest-VolumesActionsTest-883262480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:45:31 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-fa2c6ced-6686-4fc0-9c70-b3a53a895f3a tempest-VolumesActionsTest-883262480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:31 devstack sudo[86039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:45:31 devstack sudo[86039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:31 devstack sudo[86039]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:31 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-fa2c6ced-6686-4fc0-9c70-b3a53a895f3a tempest-VolumesActionsTest-883262480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.512s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:31 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-fa2c6ced-6686-4fc0-9c70-b3a53a895f3a tempest-VolumesActionsTest-883262480 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:45:31 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-fa2c6ced-6686-4fc0-9c70-b3a53a895f3a tempest-VolumesActionsTest-883262480 None] Deleted volume successfully.
Apr 09 12:45:31 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-fa2c6ced-6686-4fc0-9c70-b3a53a895f3a tempest-VolumesActionsTest-883262480 None] Lock "cinder-ddabd91b-8ddb-44f4-892c-2245b58b6c25-delete_volume" released by "delete_volume" :: held 2.907s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:45:32 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ff756e9-c598-4d6c-a3cc-02e7a84a7aa5 tempest-GroupsV314Test-1355707685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:45:32 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4ff756e9-c598-4d6c-a3cc-02e7a84a7aa5 tempest-GroupsV314Test-1355707685 None] Flow 'volume_create_manager' (2802ccbd-e895-4129-ae0f-8a812e1d505d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:45:32 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4ff756e9-c598-4d6c-a3cc-02e7a84a7aa5 tempest-GroupsV314Test-1355707685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76ec2fed-1f30-4c9f-8333-7eadb6c2fc49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:32 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4ff756e9-c598-4d6c-a3cc-02e7a84a7aa5 tempest-GroupsV314Test-1355707685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76ec2fed-1f30-4c9f-8333-7eadb6c2fc49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-689726279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c9548d82-faa2-4a48-a032-adad35c76fad,host='devstack@QuobyteHD#QuobyteHD',id=a7c0fe8d-5459-4979-889a-fadcc31249e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f952a852a4cf43eda8b706a75a8eb385',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:45:32Z,use_quota=True,user_id='1d6254bc41234b21b6fc807f46e3c15a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f581890-189b-4390-adf3-d6c62eb6a776),volume_type_id=1f581890-189b-4390-adf3-d6c62eb6a776)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:32 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4ff756e9-c598-4d6c-a3cc-02e7a84a7aa5 tempest-GroupsV314Test-1355707685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6f201d9-2961-448b-952f-16fda383710b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:32 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4ff756e9-c598-4d6c-a3cc-02e7a84a7aa5 tempest-GroupsV314Test-1355707685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6f201d9-2961-448b-952f-16fda383710b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:32 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4ff756e9-c598-4d6c-a3cc-02e7a84a7aa5 tempest-GroupsV314Test-1355707685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd478833-1244-48b9-97ff-2a55c1e2a107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:32 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4ff756e9-c598-4d6c-a3cc-02e7a84a7aa5 tempest-GroupsV314Test-1355707685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd478833-1244-48b9-97ff-2a55c1e2a107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7c0fe8d-5459-4979-889a-fadcc31249e9', 'volume_name': 'volume-a7c0fe8d-5459-4979-889a-fadcc31249e9', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:32 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4ff756e9-c598-4d6c-a3cc-02e7a84a7aa5 tempest-GroupsV314Test-1355707685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d00848d-0452-448e-a344-1a1e283be005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:32 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4ff756e9-c598-4d6c-a3cc-02e7a84a7aa5 tempest-GroupsV314Test-1355707685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d00848d-0452-448e-a344-1a1e283be005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:32 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4ff756e9-c598-4d6c-a3cc-02e7a84a7aa5 tempest-GroupsV314Test-1355707685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47b848b1-a256-440d-8d01-9d8decbebed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:32 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-4ff756e9-c598-4d6c-a3cc-02e7a84a7aa5 tempest-GroupsV314Test-1355707685 None] Volume a7c0fe8d-5459-4979-889a-fadcc31249e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7c0fe8d-5459-4979-889a-fadcc31249e9', 'volume_size': 1}
Apr 09 12:45:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-4ff756e9-c598-4d6c-a3cc-02e7a84a7aa5 tempest-GroupsV314Test-1355707685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:45:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-4ff756e9-c598-4d6c-a3cc-02e7a84a7aa5 tempest-GroupsV314Test-1355707685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:45:32 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-4ff756e9-c598-4d6c-a3cc-02e7a84a7aa5 tempest-GroupsV314Test-1355707685 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=c9548d82-faa2-4a48-a032-adad35c76fad,created_at=2026-04-09T10:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-689726279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c9548d82-faa2-4a48-a032-adad35c76fad,host='devstack@QuobyteHD#QuobyteHD',id=a7c0fe8d-5459-4979-889a-fadcc31249e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f952a852a4cf43eda8b706a75a8eb385',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:45:32Z,use_quota=True,user_id='1d6254bc41234b21b6fc807f46e3c15a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f581890-189b-4390-adf3-d6c62eb6a776),volume_type_id=1f581890-189b-4390-adf3-d6c62eb6a776)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:45:32 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-4ff756e9-c598-4d6c-a3cc-02e7a84a7aa5 tempest-GroupsV314Test-1355707685 None] Creating volume a7c0fe8d-5459-4979-889a-fadcc31249e9 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:45:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-4ff756e9-c598-4d6c-a3cc-02e7a84a7aa5 tempest-GroupsV314Test-1355707685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:45:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-4ff756e9-c598-4d6c-a3cc-02e7a84a7aa5 tempest-GroupsV314Test-1355707685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:45:32 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-4ff756e9-c598-4d6c-a3cc-02e7a84a7aa5 tempest-GroupsV314Test-1355707685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:45:32 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-4ff756e9-c598-4d6c-a3cc-02e7a84a7aa5 tempest-GroupsV314Test-1355707685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:45:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-4ff756e9-c598-4d6c-a3cc-02e7a84a7aa5 tempest-GroupsV314Test-1355707685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:45:32 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-4ff756e9-c598-4d6c-a3cc-02e7a84a7aa5 tempest-GroupsV314Test-1355707685 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:45:32 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-4ff756e9-c598-4d6c-a3cc-02e7a84a7aa5 tempest-GroupsV314Test-1355707685 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:45:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-4ff756e9-c598-4d6c-a3cc-02e7a84a7aa5 tempest-GroupsV314Test-1355707685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:32 devstack sudo[86050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9 1073741824
Apr 09 12:45:32 devstack sudo[86050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:32 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e6e865c-64d0-4e4b-8f91-c36c355e687d tempest-VolumesActionsTest-2128676864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:45:32 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-9e6e865c-64d0-4e4b-8f91-c36c355e687d tempest-VolumesActionsTest-2128676864 None] Flow 'volume_create_manager' (9423236a-303c-4db9-975a-be043bd8309a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:45:32 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-9e6e865c-64d0-4e4b-8f91-c36c355e687d tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2424412e-e79c-40ee-9eb2-a0c5ce03ea2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:32 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-9e6e865c-64d0-4e4b-8f91-c36c355e687d tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2424412e-e79c-40ee-9eb2-a0c5ce03ea2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-471124644',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d02a878-17ef-4a6d-b2fc-92df7f017746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5844d191f2346f6861837b2fdebd9c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:45:33Z,use_quota=True,user_id='4ea38a96fa5b4c7cae4a7b90acc9570f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:32 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-9e6e865c-64d0-4e4b-8f91-c36c355e687d tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (941df67a-55c8-4c56-89d2-30598a1ffa0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:32 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-9e6e865c-64d0-4e4b-8f91-c36c355e687d tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (941df67a-55c8-4c56-89d2-30598a1ffa0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:32 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-9e6e865c-64d0-4e4b-8f91-c36c355e687d tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (581a25ba-0fc7-4199-9a46-1cbd054ff5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:32 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-9e6e865c-64d0-4e4b-8f91-c36c355e687d tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (581a25ba-0fc7-4199-9a46-1cbd054ff5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d02a878-17ef-4a6d-b2fc-92df7f017746', 'volume_name': 'volume-8d02a878-17ef-4a6d-b2fc-92df7f017746', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:32 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-9e6e865c-64d0-4e4b-8f91-c36c355e687d tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (865dac67-0acb-40d7-8a33-8efc085e81f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:32 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-9e6e865c-64d0-4e4b-8f91-c36c355e687d tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (865dac67-0acb-40d7-8a33-8efc085e81f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:32 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-9e6e865c-64d0-4e4b-8f91-c36c355e687d tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b89635e8-9e36-4b0d-b2eb-53269a2b23e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:32 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-9e6e865c-64d0-4e4b-8f91-c36c355e687d tempest-VolumesActionsTest-2128676864 None] Volume 8d02a878-17ef-4a6d-b2fc-92df7f017746: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d02a878-17ef-4a6d-b2fc-92df7f017746', 'volume_size': 1}
Apr 09 12:45:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-9e6e865c-64d0-4e4b-8f91-c36c355e687d tempest-VolumesActionsTest-2128676864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:45:33 devstack sudo[86050]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:33 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-4ff756e9-c598-4d6c-a3cc-02e7a84a7aa5 tempest-GroupsV314Test-1355707685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9 1073741824" returned: 0 in 0.695s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:33 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-4ff756e9-c598-4d6c-a3cc-02e7a84a7aa5 tempest-GroupsV314Test-1355707685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:33 devstack sudo[86056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9
Apr 09 12:45:33 devstack sudo[86056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:33 devstack sudo[86056]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:33 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-4ff756e9-c598-4d6c-a3cc-02e7a84a7aa5 tempest-GroupsV314Test-1355707685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9" returned: 0 in 0.569s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:33 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-4ff756e9-c598-4d6c-a3cc-02e7a84a7aa5 tempest-GroupsV314Test-1355707685 None] <== create_volume: return (1303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:45:33 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-4ff756e9-c598-4d6c-a3cc-02e7a84a7aa5 tempest-GroupsV314Test-1355707685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.306s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:45:33 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-9e6e865c-64d0-4e4b-8f91-c36c355e687d tempest-VolumesActionsTest-2128676864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.954s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:45:33 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-9e6e865c-64d0-4e4b-8f91-c36c355e687d tempest-VolumesActionsTest-2128676864 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-471124644',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d02a878-17ef-4a6d-b2fc-92df7f017746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5844d191f2346f6861837b2fdebd9c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:45:33Z,use_quota=True,user_id='4ea38a96fa5b4c7cae4a7b90acc9570f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:45:33 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-9e6e865c-64d0-4e4b-8f91-c36c355e687d tempest-VolumesActionsTest-2128676864 None] Creating volume 8d02a878-17ef-4a6d-b2fc-92df7f017746 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:45:33 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-9e6e865c-64d0-4e4b-8f91-c36c355e687d tempest-VolumesActionsTest-2128676864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:45:33 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-9e6e865c-64d0-4e4b-8f91-c36c355e687d tempest-VolumesActionsTest-2128676864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:45:33 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-9e6e865c-64d0-4e4b-8f91-c36c355e687d tempest-VolumesActionsTest-2128676864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:45:33 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-9e6e865c-64d0-4e4b-8f91-c36c355e687d tempest-VolumesActionsTest-2128676864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:45:33 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-9e6e865c-64d0-4e4b-8f91-c36c355e687d tempest-VolumesActionsTest-2128676864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:45:33 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-9e6e865c-64d0-4e4b-8f91-c36c355e687d tempest-VolumesActionsTest-2128676864 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:45:33 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-9e6e865c-64d0-4e4b-8f91-c36c355e687d tempest-VolumesActionsTest-2128676864 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:45:33 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9e6e865c-64d0-4e4b-8f91-c36c355e687d tempest-VolumesActionsTest-2128676864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8d02a878-17ef-4a6d-b2fc-92df7f017746 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:33 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4ff756e9-c598-4d6c-a3cc-02e7a84a7aa5 tempest-GroupsV314Test-1355707685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47b848b1-a256-440d-8d01-9d8decbebed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7c0fe8d-5459-4979-889a-fadcc31249e9', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:33 devstack sudo[86061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8d02a878-17ef-4a6d-b2fc-92df7f017746 1073741824
Apr 09 12:45:33 devstack sudo[86061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:33 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4ff756e9-c598-4d6c-a3cc-02e7a84a7aa5 tempest-GroupsV314Test-1355707685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3f2dbd8-30fa-4a4b-8a24-ffc169506be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:33 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-4ff756e9-c598-4d6c-a3cc-02e7a84a7aa5 tempest-GroupsV314Test-1355707685 None] Volume volume-a7c0fe8d-5459-4979-889a-fadcc31249e9 (a7c0fe8d-5459-4979-889a-fadcc31249e9): created successfully
Apr 09 12:45:33 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4ff756e9-c598-4d6c-a3cc-02e7a84a7aa5 tempest-GroupsV314Test-1355707685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3f2dbd8-30fa-4a4b-8a24-ffc169506be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:33 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4ff756e9-c598-4d6c-a3cc-02e7a84a7aa5 tempest-GroupsV314Test-1355707685 None] Flow 'volume_create_manager' (2802ccbd-e895-4129-ae0f-8a812e1d505d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:45:33 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-4ff756e9-c598-4d6c-a3cc-02e7a84a7aa5 tempest-GroupsV314Test-1355707685 None] Created volume successfully.
Apr 09 12:45:34 devstack sudo[86061]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:34 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9e6e865c-64d0-4e4b-8f91-c36c355e687d tempest-VolumesActionsTest-2128676864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8d02a878-17ef-4a6d-b2fc-92df7f017746 1073741824" returned: 0 in 0.657s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:34 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9e6e865c-64d0-4e4b-8f91-c36c355e687d tempest-VolumesActionsTest-2128676864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8d02a878-17ef-4a6d-b2fc-92df7f017746 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:34 devstack sudo[86066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8d02a878-17ef-4a6d-b2fc-92df7f017746
Apr 09 12:45:34 devstack sudo[86066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:35 devstack sudo[86066]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9e6e865c-64d0-4e4b-8f91-c36c355e687d tempest-VolumesActionsTest-2128676864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8d02a878-17ef-4a6d-b2fc-92df7f017746" returned: 0 in 0.597s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:35 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-9e6e865c-64d0-4e4b-8f91-c36c355e687d tempest-VolumesActionsTest-2128676864 None] <== create_volume: return (1296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:45:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-9e6e865c-64d0-4e4b-8f91-c36c355e687d tempest-VolumesActionsTest-2128676864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.305s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:45:35 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-9e6e865c-64d0-4e4b-8f91-c36c355e687d tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b89635e8-9e36-4b0d-b2eb-53269a2b23e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d02a878-17ef-4a6d-b2fc-92df7f017746', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:35 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-9e6e865c-64d0-4e4b-8f91-c36c355e687d tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4e067ad-2263-4a2d-bd02-65a7994572a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:35 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-9e6e865c-64d0-4e4b-8f91-c36c355e687d tempest-VolumesActionsTest-2128676864 None] Volume volume-8d02a878-17ef-4a6d-b2fc-92df7f017746 (8d02a878-17ef-4a6d-b2fc-92df7f017746): created successfully
Apr 09 12:45:35 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-9e6e865c-64d0-4e4b-8f91-c36c355e687d tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4e067ad-2263-4a2d-bd02-65a7994572a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:35 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-9e6e865c-64d0-4e4b-8f91-c36c355e687d tempest-VolumesActionsTest-2128676864 None] Flow 'volume_create_manager' (9423236a-303c-4db9-975a-be043bd8309a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:45:35 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-9e6e865c-64d0-4e4b-8f91-c36c355e687d tempest-VolumesActionsTest-2128676864 None] Created volume successfully.
Apr 09 12:45:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:45:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:45:35 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] Cloning volume a7c0fe8d-5459-4979-889a-fadcc31249e9 to volume 7962d9c7-2736-4192-9596-bfbb76cacd6d
Apr 09 12:45:35 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] Creating offline snapshot 23c5494e-073c-4b00-b90d-565230ca3d1d of volume a7c0fe8d-5459-4979-889a-fadcc31249e9 {{(pid=82760) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 12:45:35 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[28001324-7954-4e86-8d41-beadd98ff1db]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:45:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:35 devstack sudo[86096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9
Apr 09 12:45:35 devstack sudo[86096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:36 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [req-6db02c9e-7b01-4733-acab-8a5bc464acd7 req-d094662b-df23-4f86-a8f0-e68b90c1e621 tempest-VolumesSnapshotsTestJSON-1591813130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:45:36 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-6db02c9e-7b01-4733-acab-8a5bc464acd7 req-d094662b-df23-4f86-a8f0-e68b90c1e621 tempest-VolumesSnapshotsTestJSON-1591813130 None] Flow 'volume_create_manager' (2e6b9448-6ae7-42b8-b74e-f48dce5ccfca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:45:36 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-6db02c9e-7b01-4733-acab-8a5bc464acd7 req-d094662b-df23-4f86-a8f0-e68b90c1e621 tempest-VolumesSnapshotsTestJSON-1591813130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36dac6ba-6475-4f77-a066-8122322e14d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:36 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-6db02c9e-7b01-4733-acab-8a5bc464acd7 req-d094662b-df23-4f86-a8f0-e68b90c1e621 tempest-VolumesSnapshotsTestJSON-1591813130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36dac6ba-6475-4f77-a066-8122322e14d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1815323692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1aaeffd-94cd-4dc0-b3a4-952568550dc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13aa6d773ca64cbea62a59278f2f9473',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:45:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:45:36Z,use_quota=True,user_id='9479caea7e7945b78ec7c106175b0cea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:36 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-6db02c9e-7b01-4733-acab-8a5bc464acd7 req-d094662b-df23-4f86-a8f0-e68b90c1e621 tempest-VolumesSnapshotsTestJSON-1591813130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bdfc325-c51d-437a-992e-19790486c89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:36 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-6db02c9e-7b01-4733-acab-8a5bc464acd7 req-d094662b-df23-4f86-a8f0-e68b90c1e621 tempest-VolumesSnapshotsTestJSON-1591813130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bdfc325-c51d-437a-992e-19790486c89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:36 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-6db02c9e-7b01-4733-acab-8a5bc464acd7 req-d094662b-df23-4f86-a8f0-e68b90c1e621 tempest-VolumesSnapshotsTestJSON-1591813130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (178c7e1f-2974-4445-9b43-1e4ab4a23e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:36 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-6db02c9e-7b01-4733-acab-8a5bc464acd7 req-d094662b-df23-4f86-a8f0-e68b90c1e621 tempest-VolumesSnapshotsTestJSON-1591813130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (178c7e1f-2974-4445-9b43-1e4ab4a23e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1aaeffd-94cd-4dc0-b3a4-952568550dc6', 'volume_name': 'volume-c1aaeffd-94cd-4dc0-b3a4-952568550dc6', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:36 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-6db02c9e-7b01-4733-acab-8a5bc464acd7 req-d094662b-df23-4f86-a8f0-e68b90c1e621 tempest-VolumesSnapshotsTestJSON-1591813130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e8d0351-eb31-4b72-a99c-e7ee839a0a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:36 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-6db02c9e-7b01-4733-acab-8a5bc464acd7 req-d094662b-df23-4f86-a8f0-e68b90c1e621 tempest-VolumesSnapshotsTestJSON-1591813130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e8d0351-eb31-4b72-a99c-e7ee839a0a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:36 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-6db02c9e-7b01-4733-acab-8a5bc464acd7 req-d094662b-df23-4f86-a8f0-e68b90c1e621 tempest-VolumesSnapshotsTestJSON-1591813130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a8e8278-1868-4147-b75e-d6d2ccbb832b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:36 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [req-6db02c9e-7b01-4733-acab-8a5bc464acd7 req-d094662b-df23-4f86-a8f0-e68b90c1e621 tempest-VolumesSnapshotsTestJSON-1591813130 None] Volume c1aaeffd-94cd-4dc0-b3a4-952568550dc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1aaeffd-94cd-4dc0-b3a4-952568550dc6', 'volume_size': 1}
Apr 09 12:45:36 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [req-6db02c9e-7b01-4733-acab-8a5bc464acd7 req-d094662b-df23-4f86-a8f0-e68b90c1e621 tempest-VolumesSnapshotsTestJSON-1591813130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:45:36 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-f7bf6009-984f-4927-a8d8-fc9b841a1600 tempest-VolumesActionsTest-883262480 None] Acquiring lock "cinder-8d02a878-17ef-4a6d-b2fc-92df7f017746-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:45:36 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-f7bf6009-984f-4927-a8d8-fc9b841a1600 tempest-VolumesActionsTest-883262480 None] Lock "cinder-8d02a878-17ef-4a6d-b2fc-92df7f017746-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:45:36 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-f7bf6009-984f-4927-a8d8-fc9b841a1600 tempest-VolumesActionsTest-883262480 None] Acquiring lock "cinder-quobyte-8d02a878-17ef-4a6d-b2fc-92df7f017746" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:45:36 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-f7bf6009-984f-4927-a8d8-fc9b841a1600 tempest-VolumesActionsTest-883262480 None] Lock "cinder-quobyte-8d02a878-17ef-4a6d-b2fc-92df7f017746" acquired by "delete_volume" :: waited 0.014s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:45:36 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f30eda-c2d6-4d82-8b9e-09acad56c200]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:45:36 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f7bf6009-984f-4927-a8d8-fc9b841a1600 tempest-VolumesActionsTest-883262480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8d02a878-17ef-4a6d-b2fc-92df7f017746 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:36 devstack sudo[86101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8d02a878-17ef-4a6d-b2fc-92df7f017746
Apr 09 12:45:36 devstack sudo[86101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:37 devstack sudo[86096]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:37 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9" returned: 0 in 1.336s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:37 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9.23c5494e-073c-4b00-b90d-565230ca3d1d 1G {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:37 devstack sudo[86107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9.23c5494e-073c-4b00-b90d-565230ca3d1d 1G
Apr 09 12:45:37 devstack sudo[86107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:37 devstack sudo[86101]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:37 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f7bf6009-984f-4927-a8d8-fc9b841a1600 tempest-VolumesActionsTest-883262480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8d02a878-17ef-4a6d-b2fc-92df7f017746" returned: 0 in 0.758s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:37 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f7bf6009-984f-4927-a8d8-fc9b841a1600 tempest-VolumesActionsTest-883262480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8d02a878-17ef-4a6d-b2fc-92df7f017746 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:37 devstack sudo[86112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8d02a878-17ef-4a6d-b2fc-92df7f017746
Apr 09 12:45:37 devstack sudo[86112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:37 devstack sudo[86107]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:37 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9.23c5494e-073c-4b00-b90d-565230ca3d1d 1G" returned: 0 in 0.753s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:37 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7c0fe8d-5459-4979-889a-fadcc31249e9 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9.23c5494e-073c-4b00-b90d-565230ca3d1d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:37 devstack sudo[86117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7c0fe8d-5459-4979-889a-fadcc31249e9 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9.23c5494e-073c-4b00-b90d-565230ca3d1d
Apr 09 12:45:37 devstack sudo[86117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:38 devstack sudo[86112]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f7bf6009-984f-4927-a8d8-fc9b841a1600 tempest-VolumesActionsTest-883262480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8d02a878-17ef-4a6d-b2fc-92df7f017746" returned: 0 in 0.804s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:38 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-f7bf6009-984f-4927-a8d8-fc9b841a1600 tempest-VolumesActionsTest-883262480 None] Lock "cinder-quobyte-8d02a878-17ef-4a6d-b2fc-92df7f017746" released by "delete_volume" :: held 1.587s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:45:38 devstack cinder-volume[82760]: DEBUG dbcounter [-] [82760] Writing DB stats cinder:SELECT=132,cinder:UPDATE=121,cinder:INSERT=33,cinder:DELETE=6 {{(pid=82760) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 12:45:38 devstack cinder-volume[82760]: DEBUG dbcounter [-] [82760] Writing DB stats cinder:UPDATE=121,cinder:SELECT=100,cinder:INSERT=20,cinder:DELETE=7 {{(pid=82760) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 12:45:38 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-f7bf6009-984f-4927-a8d8-fc9b841a1600 tempest-VolumesActionsTest-883262480 None] Created reservations ['1182531d-b1c3-4c2c-bc18-68d41325e942', '48760422-efe6-4a8f-8dd0-4f2161c2886a', '75674aae-e46f-4058-8f58-dd6ca4372fd4', '16132e0c-ed59-403b-bdd3-90dd154de6da'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:45:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f7bf6009-984f-4927-a8d8-fc9b841a1600 tempest-VolumesActionsTest-883262480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:45:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f7bf6009-984f-4927-a8d8-fc9b841a1600 tempest-VolumesActionsTest-883262480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:45:38 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f7bf6009-984f-4927-a8d8-fc9b841a1600 tempest-VolumesActionsTest-883262480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:45:38 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f7bf6009-984f-4927-a8d8-fc9b841a1600 tempest-VolumesActionsTest-883262480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:45:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f7bf6009-984f-4927-a8d8-fc9b841a1600 tempest-VolumesActionsTest-883262480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:45:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f7bf6009-984f-4927-a8d8-fc9b841a1600 tempest-VolumesActionsTest-883262480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:38 devstack sudo[86155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:45:38 devstack sudo[86155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:38 devstack sudo[86117]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7c0fe8d-5459-4979-889a-fadcc31249e9 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9.23c5494e-073c-4b00-b90d-565230ca3d1d" returned: 0 in 1.163s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:38 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9.23c5494e-073c-4b00-b90d-565230ca3d1d is being set with open permissions: ugo+rw: NotImplementedError
Apr 09 12:45:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9.23c5494e-073c-4b00-b90d-565230ca3d1d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:38 devstack sudo[86160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9.23c5494e-073c-4b00-b90d-565230ca3d1d
Apr 09 12:45:38 devstack sudo[86160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:39 devstack sudo[86155]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f7bf6009-984f-4927-a8d8-fc9b841a1600 tempest-VolumesActionsTest-883262480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.625s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:39 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-f7bf6009-984f-4927-a8d8-fc9b841a1600 tempest-VolumesActionsTest-883262480 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:45:39 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-f7bf6009-984f-4927-a8d8-fc9b841a1600 tempest-VolumesActionsTest-883262480 None] Deleted volume successfully.
Apr 09 12:45:39 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-f7bf6009-984f-4927-a8d8-fc9b841a1600 tempest-VolumesActionsTest-883262480 None] Lock "cinder-8d02a878-17ef-4a6d-b2fc-92df7f017746-delete_volume" released by "delete_volume" :: held 2.651s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:45:39 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ad87142-8bb6-4858-b42a-beef3188e637 tempest-VolumesActionsTest-2128676864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:45:39 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-0ad87142-8bb6-4858-b42a-beef3188e637 tempest-VolumesActionsTest-2128676864 None] Flow 'volume_create_manager' (46c136e1-f874-4c82-8b33-cdb1130fb27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:45:39 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-0ad87142-8bb6-4858-b42a-beef3188e637 tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (921f0834-aee3-4832-bbc1-6f9735bf17e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:39 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-0ad87142-8bb6-4858-b42a-beef3188e637 tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (921f0834-aee3-4832-bbc1-6f9735bf17e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:45:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1727060995',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fe1d5e1-e085-479d-8a9c-faeddd705a0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5844d191f2346f6861837b2fdebd9c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:45:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:45:39Z,use_quota=True,user_id='4ea38a96fa5b4c7cae4a7b90acc9570f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:39 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-0ad87142-8bb6-4858-b42a-beef3188e637 tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed93f5b4-b6c1-45ec-9b2a-389af0c98c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:39 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-0ad87142-8bb6-4858-b42a-beef3188e637 tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed93f5b4-b6c1-45ec-9b2a-389af0c98c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:39 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-0ad87142-8bb6-4858-b42a-beef3188e637 tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7b283e1-cfec-4cb7-8218-05ec396a7f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:39 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-0ad87142-8bb6-4858-b42a-beef3188e637 tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7b283e1-cfec-4cb7-8218-05ec396a7f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fe1d5e1-e085-479d-8a9c-faeddd705a0f', 'volume_name': 'volume-6fe1d5e1-e085-479d-8a9c-faeddd705a0f', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:39 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-0ad87142-8bb6-4858-b42a-beef3188e637 tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9a78354-4ffd-457d-9aeb-b8218c5b62fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:39 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-0ad87142-8bb6-4858-b42a-beef3188e637 tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9a78354-4ffd-457d-9aeb-b8218c5b62fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:39 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-0ad87142-8bb6-4858-b42a-beef3188e637 tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (330e7d9f-f8cf-4971-a025-fd90de65df58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:39 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-0ad87142-8bb6-4858-b42a-beef3188e637 tempest-VolumesActionsTest-2128676864 None] Volume 6fe1d5e1-e085-479d-8a9c-faeddd705a0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fe1d5e1-e085-479d-8a9c-faeddd705a0f', 'volume_size': 1}
Apr 09 12:45:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-0ad87142-8bb6-4858-b42a-beef3188e637 tempest-VolumesActionsTest-2128676864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:45:39 devstack sudo[86160]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9.23c5494e-073c-4b00-b90d-565230ca3d1d" returned: 0 in 0.580s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:39 devstack sudo[86164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9.info
Apr 09 12:45:39 devstack sudo[86164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:40 devstack sudo[86164]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:40 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9.info" returned: 0 in 0.551s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:40 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 09 12:45:40 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:40 devstack sudo[86194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9.info
Apr 09 12:45:40 devstack sudo[86194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:40 devstack sudo[86194]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:40 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9.info" returned: 0 in 0.590s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:40 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] Acquiring lock "cinder-quobyte-7962d9c7-2736-4192-9596-bfbb76cacd6d" by "_copy_volume_from_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:45:40 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] Lock "cinder-quobyte-7962d9c7-2736-4192-9596-bfbb76cacd6d" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:45:40 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] snapshot: 23c5494e-073c-4b00-b90d-565230ca3d1d, volume: 7962d9c7-2736-4192-9596-bfbb76cacd6d,  {{(pid=82760) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 09 12:45:40 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:45:40 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:45:40 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:45:40 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:45:40 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:45:40 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a0b19c-c1a3-41fe-896a-f5162378cb4c]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:45:40 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9.23c5494e-073c-4b00-b90d-565230ca3d1d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:40 devstack sudo[86222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9.23c5494e-073c-4b00-b90d-565230ca3d1d
Apr 09 12:45:40 devstack sudo[86222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:41 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-a4919da0-a0ed-4849-ba5d-cd5b0f12ab83 tempest-ServerRescueNegativeTestJSON-957534914 None] Acquiring lock "cinder-ab2d0c3e-da70-4bcf-bc7c-571f3e2d1be6-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:45:41 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-a4919da0-a0ed-4849-ba5d-cd5b0f12ab83 tempest-ServerRescueNegativeTestJSON-957534914 None] Lock "cinder-ab2d0c3e-da70-4bcf-bc7c-571f3e2d1be6-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:45:41 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-a4919da0-a0ed-4849-ba5d-cd5b0f12ab83 tempest-ServerRescueNegativeTestJSON-957534914 None] Acquiring lock "cinder-quobyte-ab2d0c3e-da70-4bcf-bc7c-571f3e2d1be6" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:45:41 devstack sudo[86222]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:41 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-a4919da0-a0ed-4849-ba5d-cd5b0f12ab83 tempest-ServerRescueNegativeTestJSON-957534914 None] Lock "cinder-quobyte-ab2d0c3e-da70-4bcf-bc7c-571f3e2d1be6" acquired by "delete_volume" :: waited 0.009s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:45:41 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9.23c5494e-073c-4b00-b90d-565230ca3d1d" returned: 0 in 0.736s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:41 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7c0fe8d-5459-4979-889a-fadcc31249e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:45:41 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9 {{(pid=82760) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 09 12:45:41 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] Creating direct copy from snapshot {{(pid=82760) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 09 12:45:41 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff74022-0d87-4d97-9e86-b624c059e618]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:45:41 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-a4919da0-a0ed-4849-ba5d-cd5b0f12ab83 tempest-ServerRescueNegativeTestJSON-957534914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ab2d0c3e-da70-4bcf-bc7c-571f3e2d1be6 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:41 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[36768c53-3434-4729-b124-fdbf32244b45]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:45:41 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:41 devstack sudo[86228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ab2d0c3e-da70-4bcf-bc7c-571f3e2d1be6
Apr 09 12:45:41 devstack sudo[86228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:41 devstack sudo[86229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9
Apr 09 12:45:41 devstack sudo[86229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:42 devstack sudo[86228]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:42 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-a4919da0-a0ed-4849-ba5d-cd5b0f12ab83 tempest-ServerRescueNegativeTestJSON-957534914 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ab2d0c3e-da70-4bcf-bc7c-571f3e2d1be6" returned: 0 in 0.555s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:42 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-a4919da0-a0ed-4849-ba5d-cd5b0f12ab83 tempest-ServerRescueNegativeTestJSON-957534914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ab2d0c3e-da70-4bcf-bc7c-571f3e2d1be6 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:42 devstack sudo[86238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ab2d0c3e-da70-4bcf-bc7c-571f3e2d1be6
Apr 09 12:45:42 devstack sudo[86238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:42 devstack sudo[86229]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:42 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9" returned: 0 in 0.605s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:42 devstack cinder-volume[82760]: DEBUG cinder.utils [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] Path /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7962d9c7-2736-4192-9596-bfbb76cacd6d not found in is_blk_device check {{(pid=82760) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 09 12:45:42 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7962d9c7-2736-4192-9596-bfbb76cacd6d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:42 devstack sudo[86240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7962d9c7-2736-4192-9596-bfbb76cacd6d
Apr 09 12:45:42 devstack sudo[86240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:42 devstack sudo[86238]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:42 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-a4919da0-a0ed-4849-ba5d-cd5b0f12ab83 tempest-ServerRescueNegativeTestJSON-957534914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ab2d0c3e-da70-4bcf-bc7c-571f3e2d1be6" returned: 0 in 0.597s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:42 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-a4919da0-a0ed-4849-ba5d-cd5b0f12ab83 tempest-ServerRescueNegativeTestJSON-957534914 None] Lock "cinder-quobyte-ab2d0c3e-da70-4bcf-bc7c-571f3e2d1be6" released by "delete_volume" :: held 1.181s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:45:42 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-a4919da0-a0ed-4849-ba5d-cd5b0f12ab83 tempest-ServerRescueNegativeTestJSON-957534914 None] Created reservations ['c7d62cc0-e6a3-4fe1-b794-bdb463febf1f', '4288780c-5ec9-4213-b0ce-972eb87637ca', '63c6ab57-3744-4403-b3e6-df8b1c3a1ff3', 'b3ab5f6f-d23a-4ce4-99e4-af2266dc1c4f'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:45:42 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-a4919da0-a0ed-4849-ba5d-cd5b0f12ab83 tempest-ServerRescueNegativeTestJSON-957534914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:45:42 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-a4919da0-a0ed-4849-ba5d-cd5b0f12ab83 tempest-ServerRescueNegativeTestJSON-957534914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:45:42 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-a4919da0-a0ed-4849-ba5d-cd5b0f12ab83 tempest-ServerRescueNegativeTestJSON-957534914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:45:42 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-a4919da0-a0ed-4849-ba5d-cd5b0f12ab83 tempest-ServerRescueNegativeTestJSON-957534914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:45:42 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-a4919da0-a0ed-4849-ba5d-cd5b0f12ab83 tempest-ServerRescueNegativeTestJSON-957534914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:45:42 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-a4919da0-a0ed-4849-ba5d-cd5b0f12ab83 tempest-ServerRescueNegativeTestJSON-957534914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:42 devstack sudo[86249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:45:42 devstack sudo[86249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:45 devstack sudo[86249]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:45 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-a4919da0-a0ed-4849-ba5d-cd5b0f12ab83 tempest-ServerRescueNegativeTestJSON-957534914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 2.575s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:45 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-a4919da0-a0ed-4849-ba5d-cd5b0f12ab83 tempest-ServerRescueNegativeTestJSON-957534914 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:45:45 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-a4919da0-a0ed-4849-ba5d-cd5b0f12ab83 tempest-ServerRescueNegativeTestJSON-957534914 None] Deleted volume successfully.
Apr 09 12:45:45 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-a4919da0-a0ed-4849-ba5d-cd5b0f12ab83 tempest-ServerRescueNegativeTestJSON-957534914 None] Lock "cinder-ab2d0c3e-da70-4bcf-bc7c-571f3e2d1be6-delete_volume" released by "delete_volume" :: held 4.029s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:45:45 devstack sudo[86240]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:45 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7962d9c7-2736-4192-9596-bfbb76cacd6d" returned: 0 in 3.725s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:45 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33e4a09-5bbd-47a7-bb05-6ac220c02159]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:45:45 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:46 devstack sudo[86287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9
Apr 09 12:45:46 devstack sudo[86287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:46 devstack sudo[86287]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9" returned: 0 in 0.721s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:46 devstack cinder-volume[82760]: DEBUG cinder.image.image_utils [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] Image conversion details: src /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9, size 1024.00 MB, duration 3.73 sec, destination /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7962d9c7-2736-4192-9596-bfbb76cacd6d {{(pid=82760) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 12:45:46 devstack cinder-volume[82760]: INFO cinder.image.image_utils [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] Converted 1024.00 MB image at 274.78 MB/s
Apr 09 12:45:46 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7962d9c7-2736-4192-9596-bfbb76cacd6d is being set with open permissions: ugo+rw: NotImplementedError
Apr 09 12:45:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7962d9c7-2736-4192-9596-bfbb76cacd6d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:46 devstack sudo[86293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7962d9c7-2736-4192-9596-bfbb76cacd6d
Apr 09 12:45:46 devstack sudo[86293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:47 devstack sudo[86293]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:47 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7962d9c7-2736-4192-9596-bfbb76cacd6d" returned: 0 in 0.484s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:47 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] Lock "cinder-quobyte-7962d9c7-2736-4192-9596-bfbb76cacd6d" released by "_copy_volume_from_snapshot" :: held 6.403s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:45:47 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] Acquiring lock "cinder-quobyte-23c5494e-073c-4b00-b90d-565230ca3d1d" by "_delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:45:47 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] Lock "cinder-quobyte-23c5494e-073c-4b00-b90d-565230ca3d1d" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:45:47 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] Deleting offline snapshot 23c5494e-073c-4b00-b90d-565230ca3d1d of volume a7c0fe8d-5459-4979-889a-fadcc31249e9 {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 12:45:47 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] snapshot_file for this snap is: volume-a7c0fe8d-5459-4979-889a-fadcc31249e9.23c5494e-073c-4b00-b90d-565230ca3d1d {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 12:45:47 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9115ca9-7e91-4bf5-afb7-6ded9c70278b]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:45:47 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9.23c5494e-073c-4b00-b90d-565230ca3d1d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:47 devstack sudo[86298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9.23c5494e-073c-4b00-b90d-565230ca3d1d
Apr 09 12:45:47 devstack sudo[86298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:47 devstack sudo[86298]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:47 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9.23c5494e-073c-4b00-b90d-565230ca3d1d" returned: 0 in 0.521s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:47 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7c0fe8d-5459-4979-889a-fadcc31249e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:45:47 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04c5ae0-6d38-4dc8-9f91-a383e5fedc6f]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:45:47 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:47 devstack sudo[86303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9
Apr 09 12:45:47 devstack sudo[86303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:48 devstack sudo[86303]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:48 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9" returned: 0 in 0.523s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:48 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9.23c5494e-073c-4b00-b90d-565230ca3d1d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:48 devstack sudo[86309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9.23c5494e-073c-4b00-b90d-565230ca3d1d
Apr 09 12:45:48 devstack sudo[86309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:48 devstack sudo[86309]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:48 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9.23c5494e-073c-4b00-b90d-565230ca3d1d" returned: 0 in 0.531s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:48 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9.23c5494e-073c-4b00-b90d-565230ca3d1d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:48 devstack sudo[86314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9.23c5494e-073c-4b00-b90d-565230ca3d1d
Apr 09 12:45:48 devstack sudo[86314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:49 devstack sudo[86314]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:49 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9.23c5494e-073c-4b00-b90d-565230ca3d1d" returned: 0 in 0.515s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:49 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] Lock "cinder-quobyte-23c5494e-073c-4b00-b90d-565230ca3d1d" released by "_delete_snapshot" :: held 2.139s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:45:49 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.708s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:45:49 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [req-6db02c9e-7b01-4733-acab-8a5bc464acd7 req-d094662b-df23-4f86-a8f0-e68b90c1e621 tempest-VolumesSnapshotsTestJSON-1591813130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.843s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:45:49 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [req-6db02c9e-7b01-4733-acab-8a5bc464acd7 req-d094662b-df23-4f86-a8f0-e68b90c1e621 tempest-VolumesSnapshotsTestJSON-1591813130 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1815323692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1aaeffd-94cd-4dc0-b3a4-952568550dc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13aa6d773ca64cbea62a59278f2f9473',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:45:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:45:36Z,use_quota=True,user_id='9479caea7e7945b78ec7c106175b0cea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:45:49 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [req-6db02c9e-7b01-4733-acab-8a5bc464acd7 req-d094662b-df23-4f86-a8f0-e68b90c1e621 tempest-VolumesSnapshotsTestJSON-1591813130 None] Creating volume c1aaeffd-94cd-4dc0-b3a4-952568550dc6 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:45:49 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [req-6db02c9e-7b01-4733-acab-8a5bc464acd7 req-d094662b-df23-4f86-a8f0-e68b90c1e621 tempest-VolumesSnapshotsTestJSON-1591813130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:45:49 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [req-6db02c9e-7b01-4733-acab-8a5bc464acd7 req-d094662b-df23-4f86-a8f0-e68b90c1e621 tempest-VolumesSnapshotsTestJSON-1591813130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:45:49 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [req-6db02c9e-7b01-4733-acab-8a5bc464acd7 req-d094662b-df23-4f86-a8f0-e68b90c1e621 tempest-VolumesSnapshotsTestJSON-1591813130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:45:49 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [req-6db02c9e-7b01-4733-acab-8a5bc464acd7 req-d094662b-df23-4f86-a8f0-e68b90c1e621 tempest-VolumesSnapshotsTestJSON-1591813130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:45:49 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [req-6db02c9e-7b01-4733-acab-8a5bc464acd7 req-d094662b-df23-4f86-a8f0-e68b90c1e621 tempest-VolumesSnapshotsTestJSON-1591813130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:45:49 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [req-6db02c9e-7b01-4733-acab-8a5bc464acd7 req-d094662b-df23-4f86-a8f0-e68b90c1e621 tempest-VolumesSnapshotsTestJSON-1591813130 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:45:49 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [req-6db02c9e-7b01-4733-acab-8a5bc464acd7 req-d094662b-df23-4f86-a8f0-e68b90c1e621 tempest-VolumesSnapshotsTestJSON-1591813130 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:45:49 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-6db02c9e-7b01-4733-acab-8a5bc464acd7 req-d094662b-df23-4f86-a8f0-e68b90c1e621 tempest-VolumesSnapshotsTestJSON-1591813130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c1aaeffd-94cd-4dc0-b3a4-952568550dc6 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:49 devstack sudo[86317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c1aaeffd-94cd-4dc0-b3a4-952568550dc6 1073741824
Apr 09 12:45:49 devstack sudo[86317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:49 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-19ee8b1a-eda3-49a4-934c-d4ec94ca6baa tempest-GroupsV314Test-1355707685 None] Create group from source-group-c9548d82-faa2-4a48-a032-adad35c76fad completed successfully.
Apr 09 12:45:49 devstack sudo[86317]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:49 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-6db02c9e-7b01-4733-acab-8a5bc464acd7 req-d094662b-df23-4f86-a8f0-e68b90c1e621 tempest-VolumesSnapshotsTestJSON-1591813130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c1aaeffd-94cd-4dc0-b3a4-952568550dc6 1073741824" returned: 0 in 0.576s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:49 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-6db02c9e-7b01-4733-acab-8a5bc464acd7 req-d094662b-df23-4f86-a8f0-e68b90c1e621 tempest-VolumesSnapshotsTestJSON-1591813130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c1aaeffd-94cd-4dc0-b3a4-952568550dc6 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:49 devstack sudo[86322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c1aaeffd-94cd-4dc0-b3a4-952568550dc6
Apr 09 12:45:49 devstack sudo[86322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:50 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-78fbfe5c-b0df-45a7-bec9-d2f1084317e5 tempest-GroupsV314Test-1355707685 None] Acquiring lock "cinder-quobyte-7962d9c7-2736-4192-9596-bfbb76cacd6d" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:45:50 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-78fbfe5c-b0df-45a7-bec9-d2f1084317e5 tempest-GroupsV314Test-1355707685 None] Lock "cinder-quobyte-7962d9c7-2736-4192-9596-bfbb76cacd6d" acquired by "delete_volume" :: waited 0.009s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:45:50 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe35808-fe43-4715-a17b-45babb3d4ec6]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:45:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-78fbfe5c-b0df-45a7-bec9-d2f1084317e5 tempest-GroupsV314Test-1355707685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7962d9c7-2736-4192-9596-bfbb76cacd6d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:50 devstack sudo[86324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7962d9c7-2736-4192-9596-bfbb76cacd6d
Apr 09 12:45:50 devstack sudo[86324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:50 devstack sudo[86322]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-6db02c9e-7b01-4733-acab-8a5bc464acd7 req-d094662b-df23-4f86-a8f0-e68b90c1e621 tempest-VolumesSnapshotsTestJSON-1591813130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c1aaeffd-94cd-4dc0-b3a4-952568550dc6" returned: 0 in 0.516s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:50 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [req-6db02c9e-7b01-4733-acab-8a5bc464acd7 req-d094662b-df23-4f86-a8f0-e68b90c1e621 tempest-VolumesSnapshotsTestJSON-1591813130 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:45:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [req-6db02c9e-7b01-4733-acab-8a5bc464acd7 req-d094662b-df23-4f86-a8f0-e68b90c1e621 tempest-VolumesSnapshotsTestJSON-1591813130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:45:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-0ad87142-8bb6-4858-b42a-beef3188e637 tempest-VolumesActionsTest-2128676864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.086s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:45:50 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-0ad87142-8bb6-4858-b42a-beef3188e637 tempest-VolumesActionsTest-2128676864 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:45:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1727060995',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fe1d5e1-e085-479d-8a9c-faeddd705a0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5844d191f2346f6861837b2fdebd9c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:45:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:45:39Z,use_quota=True,user_id='4ea38a96fa5b4c7cae4a7b90acc9570f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:45:50 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-0ad87142-8bb6-4858-b42a-beef3188e637 tempest-VolumesActionsTest-2128676864 None] Creating volume 6fe1d5e1-e085-479d-8a9c-faeddd705a0f {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:45:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-0ad87142-8bb6-4858-b42a-beef3188e637 tempest-VolumesActionsTest-2128676864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:45:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-0ad87142-8bb6-4858-b42a-beef3188e637 tempest-VolumesActionsTest-2128676864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:45:50 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-0ad87142-8bb6-4858-b42a-beef3188e637 tempest-VolumesActionsTest-2128676864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:45:50 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-0ad87142-8bb6-4858-b42a-beef3188e637 tempest-VolumesActionsTest-2128676864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:45:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-0ad87142-8bb6-4858-b42a-beef3188e637 tempest-VolumesActionsTest-2128676864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:45:50 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-0ad87142-8bb6-4858-b42a-beef3188e637 tempest-VolumesActionsTest-2128676864 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:45:50 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-0ad87142-8bb6-4858-b42a-beef3188e637 tempest-VolumesActionsTest-2128676864 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:45:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-0ad87142-8bb6-4858-b42a-beef3188e637 tempest-VolumesActionsTest-2128676864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6fe1d5e1-e085-479d-8a9c-faeddd705a0f 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:50 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-6db02c9e-7b01-4733-acab-8a5bc464acd7 req-d094662b-df23-4f86-a8f0-e68b90c1e621 tempest-VolumesSnapshotsTestJSON-1591813130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a8e8278-1868-4147-b75e-d6d2ccbb832b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1aaeffd-94cd-4dc0-b3a4-952568550dc6', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:50 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-6db02c9e-7b01-4733-acab-8a5bc464acd7 req-d094662b-df23-4f86-a8f0-e68b90c1e621 tempest-VolumesSnapshotsTestJSON-1591813130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2a8c45c-a6e6-4a0c-b8ae-3444cd583588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:50 devstack sudo[86327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6fe1d5e1-e085-479d-8a9c-faeddd705a0f 1073741824
Apr 09 12:45:50 devstack sudo[86327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:50 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [req-6db02c9e-7b01-4733-acab-8a5bc464acd7 req-d094662b-df23-4f86-a8f0-e68b90c1e621 tempest-VolumesSnapshotsTestJSON-1591813130 None] Volume volume-c1aaeffd-94cd-4dc0-b3a4-952568550dc6 (c1aaeffd-94cd-4dc0-b3a4-952568550dc6): created successfully
Apr 09 12:45:50 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-6db02c9e-7b01-4733-acab-8a5bc464acd7 req-d094662b-df23-4f86-a8f0-e68b90c1e621 tempest-VolumesSnapshotsTestJSON-1591813130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2a8c45c-a6e6-4a0c-b8ae-3444cd583588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:50 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [req-6db02c9e-7b01-4733-acab-8a5bc464acd7 req-d094662b-df23-4f86-a8f0-e68b90c1e621 tempest-VolumesSnapshotsTestJSON-1591813130 None] Flow 'volume_create_manager' (2e6b9448-6ae7-42b8-b74e-f48dce5ccfca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:45:50 devstack cinder-volume[82760]: INFO cinder.volume.manager [req-6db02c9e-7b01-4733-acab-8a5bc464acd7 req-d094662b-df23-4f86-a8f0-e68b90c1e621 tempest-VolumesSnapshotsTestJSON-1591813130 None] Created volume successfully.
Apr 09 12:45:50 devstack sudo[86324]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-78fbfe5c-b0df-45a7-bec9-d2f1084317e5 tempest-GroupsV314Test-1355707685 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7962d9c7-2736-4192-9596-bfbb76cacd6d" returned: 0 in 0.607s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-78fbfe5c-b0df-45a7-bec9-d2f1084317e5 tempest-GroupsV314Test-1355707685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7962d9c7-2736-4192-9596-bfbb76cacd6d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:50 devstack sudo[86332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7962d9c7-2736-4192-9596-bfbb76cacd6d
Apr 09 12:45:50 devstack sudo[86332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [req-cc838901-e9ef-446b-a878-a420780e34ea req-87fa414a-5a06-44af-9571-faf0531f7dac tempest-VolumesSnapshotsTestJSON-1591813130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:45:51 devstack sudo[86327]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-0ad87142-8bb6-4858-b42a-beef3188e637 tempest-VolumesActionsTest-2128676864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6fe1d5e1-e085-479d-8a9c-faeddd705a0f 1073741824" returned: 0 in 0.686s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-0ad87142-8bb6-4858-b42a-beef3188e637 tempest-VolumesActionsTest-2128676864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6fe1d5e1-e085-479d-8a9c-faeddd705a0f {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:51 devstack sudo[86337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6fe1d5e1-e085-479d-8a9c-faeddd705a0f
Apr 09 12:45:51 devstack sudo[86337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:51 devstack sudo[86332]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-78fbfe5c-b0df-45a7-bec9-d2f1084317e5 tempest-GroupsV314Test-1355707685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7962d9c7-2736-4192-9596-bfbb76cacd6d" returned: 0 in 0.574s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:51 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-78fbfe5c-b0df-45a7-bec9-d2f1084317e5 tempest-GroupsV314Test-1355707685 None] Lock "cinder-quobyte-7962d9c7-2736-4192-9596-bfbb76cacd6d" released by "delete_volume" :: held 1.234s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:45:51 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-78fbfe5c-b0df-45a7-bec9-d2f1084317e5 tempest-GroupsV314Test-1355707685 None] Created reservations ['46cf5911-7062-4180-b7e5-4315ad0776e9'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:45:51 devstack cinder-volume[82760]: WARNING cinder.quota [None req-78fbfe5c-b0df-45a7-bec9-d2f1084317e5 tempest-GroupsV314Test-1355707685 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1957633070 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1957633070, it is now deprecated. Please use the default quota class for default quota.
Apr 09 12:45:51 devstack cinder-volume[82760]: WARNING cinder.quota [None req-78fbfe5c-b0df-45a7-bec9-d2f1084317e5 tempest-GroupsV314Test-1355707685 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1957633070 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1957633070, it is now deprecated. Please use the default quota class for default quota.
Apr 09 12:45:51 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-78fbfe5c-b0df-45a7-bec9-d2f1084317e5 tempest-GroupsV314Test-1355707685 None] Created reservations ['9b66b77b-cba3-4cf4-a2c7-4f20817cc8c1', 'e8d20ec7-06d7-44d2-86c2-f71603b68724', 'ff53803b-69ea-4d73-9be7-d98dea2e1864', '85857f77-b5a9-41a8-afce-e08f883fb187'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:45:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-78fbfe5c-b0df-45a7-bec9-d2f1084317e5 tempest-GroupsV314Test-1355707685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:45:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-78fbfe5c-b0df-45a7-bec9-d2f1084317e5 tempest-GroupsV314Test-1355707685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:45:51 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-78fbfe5c-b0df-45a7-bec9-d2f1084317e5 tempest-GroupsV314Test-1355707685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:45:51 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-78fbfe5c-b0df-45a7-bec9-d2f1084317e5 tempest-GroupsV314Test-1355707685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:45:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-78fbfe5c-b0df-45a7-bec9-d2f1084317e5 tempest-GroupsV314Test-1355707685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:45:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-78fbfe5c-b0df-45a7-bec9-d2f1084317e5 tempest-GroupsV314Test-1355707685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:51 devstack sudo[86341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:45:51 devstack sudo[86341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:51 devstack sudo[86337]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-0ad87142-8bb6-4858-b42a-beef3188e637 tempest-VolumesActionsTest-2128676864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6fe1d5e1-e085-479d-8a9c-faeddd705a0f" returned: 0 in 0.553s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:51 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-0ad87142-8bb6-4858-b42a-beef3188e637 tempest-VolumesActionsTest-2128676864 None] <== create_volume: return (1268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:45:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-0ad87142-8bb6-4858-b42a-beef3188e637 tempest-VolumesActionsTest-2128676864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.271s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:45:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [req-cc838901-e9ef-446b-a878-a420780e34ea req-87fa414a-5a06-44af-9571-faf0531f7dac tempest-VolumesSnapshotsTestJSON-1591813130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.763s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:45:51 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [req-cc838901-e9ef-446b-a878-a420780e34ea req-87fa414a-5a06-44af-9571-faf0531f7dac tempest-VolumesSnapshotsTestJSON-1591813130 None] Creating offline snapshot f307d6ed-9889-4b6c-81cd-ebaf332c43e3 of volume c1aaeffd-94cd-4dc0-b3a4-952568550dc6 {{(pid=82760) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 12:45:51 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-0ad87142-8bb6-4858-b42a-beef3188e637 tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (330e7d9f-f8cf-4971-a025-fd90de65df58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fe1d5e1-e085-479d-8a9c-faeddd705a0f', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:51 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-0ad87142-8bb6-4858-b42a-beef3188e637 tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a2e8921-f18e-4337-800f-2c82e3c66cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:51 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ffe1b34-f037-4dd9-871d-7a66907c1bac]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:45:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-cc838901-e9ef-446b-a878-a420780e34ea req-87fa414a-5a06-44af-9571-faf0531f7dac tempest-VolumesSnapshotsTestJSON-1591813130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c1aaeffd-94cd-4dc0-b3a4-952568550dc6 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:51 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-0ad87142-8bb6-4858-b42a-beef3188e637 tempest-VolumesActionsTest-2128676864 None] Volume volume-6fe1d5e1-e085-479d-8a9c-faeddd705a0f (6fe1d5e1-e085-479d-8a9c-faeddd705a0f): created successfully
Apr 09 12:45:51 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-0ad87142-8bb6-4858-b42a-beef3188e637 tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a2e8921-f18e-4337-800f-2c82e3c66cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:51 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-0ad87142-8bb6-4858-b42a-beef3188e637 tempest-VolumesActionsTest-2128676864 None] Flow 'volume_create_manager' (46c136e1-f874-4c82-8b33-cdb1130fb27e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:45:51 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-0ad87142-8bb6-4858-b42a-beef3188e637 tempest-VolumesActionsTest-2128676864 None] Created volume successfully.
Apr 09 12:45:51 devstack sudo[86344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c1aaeffd-94cd-4dc0-b3a4-952568550dc6
Apr 09 12:45:51 devstack sudo[86344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:52 devstack sudo[86341]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-78fbfe5c-b0df-45a7-bec9-d2f1084317e5 tempest-GroupsV314Test-1355707685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.514s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:52 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-78fbfe5c-b0df-45a7-bec9-d2f1084317e5 tempest-GroupsV314Test-1355707685 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:45:52 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-78fbfe5c-b0df-45a7-bec9-d2f1084317e5 tempest-GroupsV314Test-1355707685 None] Delete group completed successfully.
Apr 09 12:45:52 devstack sudo[86344]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-cc838901-e9ef-446b-a878-a420780e34ea req-87fa414a-5a06-44af-9571-faf0531f7dac tempest-VolumesSnapshotsTestJSON-1591813130 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c1aaeffd-94cd-4dc0-b3a4-952568550dc6" returned: 0 in 0.521s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-cc838901-e9ef-446b-a878-a420780e34ea req-87fa414a-5a06-44af-9571-faf0531f7dac tempest-VolumesSnapshotsTestJSON-1591813130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c1aaeffd-94cd-4dc0-b3a4-952568550dc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c1aaeffd-94cd-4dc0-b3a4-952568550dc6.f307d6ed-9889-4b6c-81cd-ebaf332c43e3 1G {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:52 devstack sudo[86350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c1aaeffd-94cd-4dc0-b3a4-952568550dc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c1aaeffd-94cd-4dc0-b3a4-952568550dc6.f307d6ed-9889-4b6c-81cd-ebaf332c43e3 1G
Apr 09 12:45:52 devstack sudo[86350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:52 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ffa3f186-1efc-4f4b-afd1-0da6bfd50af6 tempest-GroupsV314Test-1355707685 None] Acquiring lock "cinder-quobyte-a7c0fe8d-5459-4979-889a-fadcc31249e9" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:45:52 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ffa3f186-1efc-4f4b-afd1-0da6bfd50af6 tempest-GroupsV314Test-1355707685 None] Lock "cinder-quobyte-a7c0fe8d-5459-4979-889a-fadcc31249e9" acquired by "delete_volume" :: waited 0.012s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:45:52 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[7326047c-136b-436e-9d27-45a58a166356]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:45:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ffa3f186-1efc-4f4b-afd1-0da6bfd50af6 tempest-GroupsV314Test-1355707685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:52 devstack sudo[86361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9
Apr 09 12:45:52 devstack sudo[86361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:52 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-96a54af8-0907-4955-a4a2-a99dec0e53c5 tempest-VolumesActionsTest-883262480 None] Acquiring lock "cinder-6fe1d5e1-e085-479d-8a9c-faeddd705a0f-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:45:52 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-96a54af8-0907-4955-a4a2-a99dec0e53c5 tempest-VolumesActionsTest-883262480 None] Lock "cinder-6fe1d5e1-e085-479d-8a9c-faeddd705a0f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:45:52 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-96a54af8-0907-4955-a4a2-a99dec0e53c5 tempest-VolumesActionsTest-883262480 None] Acquiring lock "cinder-quobyte-6fe1d5e1-e085-479d-8a9c-faeddd705a0f" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:45:52 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-96a54af8-0907-4955-a4a2-a99dec0e53c5 tempest-VolumesActionsTest-883262480 None] Lock "cinder-quobyte-6fe1d5e1-e085-479d-8a9c-faeddd705a0f" acquired by "delete_volume" :: waited 0.008s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:45:52 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3fe00ce-b5ea-4a8f-8c93-56c266454376]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:45:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-96a54af8-0907-4955-a4a2-a99dec0e53c5 tempest-VolumesActionsTest-883262480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6fe1d5e1-e085-479d-8a9c-faeddd705a0f {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:52 devstack sudo[86384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6fe1d5e1-e085-479d-8a9c-faeddd705a0f
Apr 09 12:45:52 devstack sudo[86384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:53 devstack sudo[86350]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-cc838901-e9ef-446b-a878-a420780e34ea req-87fa414a-5a06-44af-9571-faf0531f7dac tempest-VolumesSnapshotsTestJSON-1591813130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c1aaeffd-94cd-4dc0-b3a4-952568550dc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c1aaeffd-94cd-4dc0-b3a4-952568550dc6.f307d6ed-9889-4b6c-81cd-ebaf332c43e3 1G" returned: 0 in 0.714s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-cc838901-e9ef-446b-a878-a420780e34ea req-87fa414a-5a06-44af-9571-faf0531f7dac tempest-VolumesSnapshotsTestJSON-1591813130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1aaeffd-94cd-4dc0-b3a4-952568550dc6 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c1aaeffd-94cd-4dc0-b3a4-952568550dc6.f307d6ed-9889-4b6c-81cd-ebaf332c43e3 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:53 devstack sudo[86386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1aaeffd-94cd-4dc0-b3a4-952568550dc6 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c1aaeffd-94cd-4dc0-b3a4-952568550dc6.f307d6ed-9889-4b6c-81cd-ebaf332c43e3
Apr 09 12:45:53 devstack sudo[86386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:53 devstack sudo[86361]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ffa3f186-1efc-4f4b-afd1-0da6bfd50af6 tempest-GroupsV314Test-1355707685 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9" returned: 0 in 0.733s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ffa3f186-1efc-4f4b-afd1-0da6bfd50af6 tempest-GroupsV314Test-1355707685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:53 devstack sudo[86392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9
Apr 09 12:45:53 devstack sudo[86392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:53 devstack sudo[86384]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-96a54af8-0907-4955-a4a2-a99dec0e53c5 tempest-VolumesActionsTest-883262480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6fe1d5e1-e085-479d-8a9c-faeddd705a0f" returned: 0 in 0.663s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-96a54af8-0907-4955-a4a2-a99dec0e53c5 tempest-VolumesActionsTest-883262480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6fe1d5e1-e085-479d-8a9c-faeddd705a0f {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:53 devstack sudo[86386]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-cc838901-e9ef-446b-a878-a420780e34ea req-87fa414a-5a06-44af-9571-faf0531f7dac tempest-VolumesSnapshotsTestJSON-1591813130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1aaeffd-94cd-4dc0-b3a4-952568550dc6 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c1aaeffd-94cd-4dc0-b3a4-952568550dc6.f307d6ed-9889-4b6c-81cd-ebaf332c43e3" returned: 0 in 0.522s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:53 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [req-cc838901-e9ef-446b-a878-a420780e34ea req-87fa414a-5a06-44af-9571-faf0531f7dac tempest-VolumesSnapshotsTestJSON-1591813130 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c1aaeffd-94cd-4dc0-b3a4-952568550dc6.f307d6ed-9889-4b6c-81cd-ebaf332c43e3 is being set with open permissions: ugo+rw
Apr 09 12:45:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-cc838901-e9ef-446b-a878-a420780e34ea req-87fa414a-5a06-44af-9571-faf0531f7dac tempest-VolumesSnapshotsTestJSON-1591813130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c1aaeffd-94cd-4dc0-b3a4-952568550dc6.f307d6ed-9889-4b6c-81cd-ebaf332c43e3 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:53 devstack sudo[86400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6fe1d5e1-e085-479d-8a9c-faeddd705a0f
Apr 09 12:45:53 devstack sudo[86400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:53 devstack sudo[86401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c1aaeffd-94cd-4dc0-b3a4-952568550dc6.f307d6ed-9889-4b6c-81cd-ebaf332c43e3
Apr 09 12:45:53 devstack sudo[86401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:53 devstack sudo[86392]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ffa3f186-1efc-4f4b-afd1-0da6bfd50af6 tempest-GroupsV314Test-1355707685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a7c0fe8d-5459-4979-889a-fadcc31249e9" returned: 0 in 0.462s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:53 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ffa3f186-1efc-4f4b-afd1-0da6bfd50af6 tempest-GroupsV314Test-1355707685 None] Lock "cinder-quobyte-a7c0fe8d-5459-4979-889a-fadcc31249e9" released by "delete_volume" :: held 1.269s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:45:53 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-ffa3f186-1efc-4f4b-afd1-0da6bfd50af6 tempest-GroupsV314Test-1355707685 None] Created reservations ['587a5f89-3a2f-4e8c-82c8-14f935cbb32b'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:45:53 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-ffa3f186-1efc-4f4b-afd1-0da6bfd50af6 tempest-GroupsV314Test-1355707685 None] Created reservations ['e95cd031-d69d-4c31-864e-754f9ac5d0da', '0192dde2-6a4f-4fdf-9637-5b04e2196f28', '602043d6-dde7-428c-a664-d4a80fc8e685', 'be228206-d313-4f5d-80a4-484db16edc7d'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:45:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ffa3f186-1efc-4f4b-afd1-0da6bfd50af6 tempest-GroupsV314Test-1355707685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:45:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ffa3f186-1efc-4f4b-afd1-0da6bfd50af6 tempest-GroupsV314Test-1355707685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:45:53 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-ffa3f186-1efc-4f4b-afd1-0da6bfd50af6 tempest-GroupsV314Test-1355707685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:45:53 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-ffa3f186-1efc-4f4b-afd1-0da6bfd50af6 tempest-GroupsV314Test-1355707685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:45:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ffa3f186-1efc-4f4b-afd1-0da6bfd50af6 tempest-GroupsV314Test-1355707685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:45:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ffa3f186-1efc-4f4b-afd1-0da6bfd50af6 tempest-GroupsV314Test-1355707685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:53 devstack sudo[86408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:45:53 devstack sudo[86408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:54 devstack sudo[86401]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-cc838901-e9ef-446b-a878-a420780e34ea req-87fa414a-5a06-44af-9571-faf0531f7dac tempest-VolumesSnapshotsTestJSON-1591813130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c1aaeffd-94cd-4dc0-b3a4-952568550dc6.f307d6ed-9889-4b6c-81cd-ebaf332c43e3" returned: 0 in 0.502s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:54 devstack sudo[86400]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-96a54af8-0907-4955-a4a2-a99dec0e53c5 tempest-VolumesActionsTest-883262480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6fe1d5e1-e085-479d-8a9c-faeddd705a0f" returned: 0 in 0.542s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:54 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-96a54af8-0907-4955-a4a2-a99dec0e53c5 tempest-VolumesActionsTest-883262480 None] Lock "cinder-quobyte-6fe1d5e1-e085-479d-8a9c-faeddd705a0f" released by "delete_volume" :: held 1.242s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:45:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-cc838901-e9ef-446b-a878-a420780e34ea req-87fa414a-5a06-44af-9571-faf0531f7dac tempest-VolumesSnapshotsTestJSON-1591813130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c1aaeffd-94cd-4dc0-b3a4-952568550dc6.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:54 devstack sudo[86410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c1aaeffd-94cd-4dc0-b3a4-952568550dc6.info
Apr 09 12:45:54 devstack sudo[86410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:54 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-96a54af8-0907-4955-a4a2-a99dec0e53c5 tempest-VolumesActionsTest-883262480 None] Created reservations ['eea8f35f-4e75-468c-a6f2-6048cc9a2a7f', 'ff65b499-f70b-41b5-9922-98052d0d73c8', '99b82733-35a3-4b7f-b712-823361fec403', '71f006bd-6458-4717-b28b-7be4f5f32b72'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:45:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-96a54af8-0907-4955-a4a2-a99dec0e53c5 tempest-VolumesActionsTest-883262480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:45:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-96a54af8-0907-4955-a4a2-a99dec0e53c5 tempest-VolumesActionsTest-883262480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:45:54 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-96a54af8-0907-4955-a4a2-a99dec0e53c5 tempest-VolumesActionsTest-883262480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:45:54 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-96a54af8-0907-4955-a4a2-a99dec0e53c5 tempest-VolumesActionsTest-883262480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:45:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-96a54af8-0907-4955-a4a2-a99dec0e53c5 tempest-VolumesActionsTest-883262480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:45:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-96a54af8-0907-4955-a4a2-a99dec0e53c5 tempest-VolumesActionsTest-883262480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:54 devstack sudo[86413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:45:54 devstack sudo[86413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:54 devstack sudo[86410]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-cc838901-e9ef-446b-a878-a420780e34ea req-87fa414a-5a06-44af-9571-faf0531f7dac tempest-VolumesSnapshotsTestJSON-1591813130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c1aaeffd-94cd-4dc0-b3a4-952568550dc6.info" returned: 0 in 0.552s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:54 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [req-cc838901-e9ef-446b-a878-a420780e34ea req-87fa414a-5a06-44af-9571-faf0531f7dac tempest-VolumesSnapshotsTestJSON-1591813130 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c1aaeffd-94cd-4dc0-b3a4-952568550dc6.info is being set with open permissions: ugo+rw
Apr 09 12:45:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-cc838901-e9ef-446b-a878-a420780e34ea req-87fa414a-5a06-44af-9571-faf0531f7dac tempest-VolumesSnapshotsTestJSON-1591813130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c1aaeffd-94cd-4dc0-b3a4-952568550dc6.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:54 devstack sudo[86419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c1aaeffd-94cd-4dc0-b3a4-952568550dc6.info
Apr 09 12:45:54 devstack sudo[86419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:54 devstack sudo[86408]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ffa3f186-1efc-4f4b-afd1-0da6bfd50af6 tempest-GroupsV314Test-1355707685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.778s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:54 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-ffa3f186-1efc-4f4b-afd1-0da6bfd50af6 tempest-GroupsV314Test-1355707685 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:45:54 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-ffa3f186-1efc-4f4b-afd1-0da6bfd50af6 tempest-GroupsV314Test-1355707685 None] Delete group completed successfully.
Apr 09 12:45:54 devstack sudo[86413]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-96a54af8-0907-4955-a4a2-a99dec0e53c5 tempest-VolumesActionsTest-883262480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.575s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:54 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-96a54af8-0907-4955-a4a2-a99dec0e53c5 tempest-VolumesActionsTest-883262480 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:45:54 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-96a54af8-0907-4955-a4a2-a99dec0e53c5 tempest-VolumesActionsTest-883262480 None] Deleted volume successfully.
Apr 09 12:45:54 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-96a54af8-0907-4955-a4a2-a99dec0e53c5 tempest-VolumesActionsTest-883262480 None] Lock "cinder-6fe1d5e1-e085-479d-8a9c-faeddd705a0f-delete_volume" released by "delete_volume" :: held 2.151s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:45:55 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec5ec9c3-1da5-45a4-b68d-bb5fe4a033a7 tempest-VolumesActionsTest-2128676864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:45:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ec5ec9c3-1da5-45a4-b68d-bb5fe4a033a7 tempest-VolumesActionsTest-2128676864 None] Flow 'volume_create_manager' (635ec8fc-e2f2-4ef6-b9f5-323171c1950f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:45:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ec5ec9c3-1da5-45a4-b68d-bb5fe4a033a7 tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abf46857-df1d-4f60-91b2-7fb4433893cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ec5ec9c3-1da5-45a4-b68d-bb5fe4a033a7 tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abf46857-df1d-4f60-91b2-7fb4433893cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:45:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1299900111',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dd97476-d1e7-4d9b-9fe8-b439fde95048,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5844d191f2346f6861837b2fdebd9c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:45:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:45:55Z,use_quota=True,user_id='4ea38a96fa5b4c7cae4a7b90acc9570f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ec5ec9c3-1da5-45a4-b68d-bb5fe4a033a7 tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (283688f7-2a10-497b-b5c3-69a13da25707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ec5ec9c3-1da5-45a4-b68d-bb5fe4a033a7 tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (283688f7-2a10-497b-b5c3-69a13da25707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ec5ec9c3-1da5-45a4-b68d-bb5fe4a033a7 tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd0812e5-e102-434f-afcd-cfc1c9a3e186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ec5ec9c3-1da5-45a4-b68d-bb5fe4a033a7 tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd0812e5-e102-434f-afcd-cfc1c9a3e186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dd97476-d1e7-4d9b-9fe8-b439fde95048', 'volume_name': 'volume-3dd97476-d1e7-4d9b-9fe8-b439fde95048', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ec5ec9c3-1da5-45a4-b68d-bb5fe4a033a7 tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (913611fe-51c9-48ba-b8a0-4065ec608b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ec5ec9c3-1da5-45a4-b68d-bb5fe4a033a7 tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (913611fe-51c9-48ba-b8a0-4065ec608b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ec5ec9c3-1da5-45a4-b68d-bb5fe4a033a7 tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95c705a5-a17d-4684-b25a-a757d35e41c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:55 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-ec5ec9c3-1da5-45a4-b68d-bb5fe4a033a7 tempest-VolumesActionsTest-2128676864 None] Volume 3dd97476-d1e7-4d9b-9fe8-b439fde95048: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dd97476-d1e7-4d9b-9fe8-b439fde95048', 'volume_size': 1}
Apr 09 12:45:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ec5ec9c3-1da5-45a4-b68d-bb5fe4a033a7 tempest-VolumesActionsTest-2128676864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:45:55 devstack sudo[86419]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-cc838901-e9ef-446b-a878-a420780e34ea req-87fa414a-5a06-44af-9571-faf0531f7dac tempest-VolumesSnapshotsTestJSON-1591813130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c1aaeffd-94cd-4dc0-b3a4-952568550dc6.info" returned: 0 in 0.684s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [req-cc838901-e9ef-446b-a878-a420780e34ea req-87fa414a-5a06-44af-9571-faf0531f7dac tempest-VolumesSnapshotsTestJSON-1591813130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.607s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:45:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ec5ec9c3-1da5-45a4-b68d-bb5fe4a033a7 tempest-VolumesActionsTest-2128676864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.018s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:45:55 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-ec5ec9c3-1da5-45a4-b68d-bb5fe4a033a7 tempest-VolumesActionsTest-2128676864 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:45:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1299900111',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dd97476-d1e7-4d9b-9fe8-b439fde95048,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5844d191f2346f6861837b2fdebd9c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:45:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:45:55Z,use_quota=True,user_id='4ea38a96fa5b4c7cae4a7b90acc9570f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:45:55 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-ec5ec9c3-1da5-45a4-b68d-bb5fe4a033a7 tempest-VolumesActionsTest-2128676864 None] Creating volume 3dd97476-d1e7-4d9b-9fe8-b439fde95048 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:45:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ec5ec9c3-1da5-45a4-b68d-bb5fe4a033a7 tempest-VolumesActionsTest-2128676864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:45:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ec5ec9c3-1da5-45a4-b68d-bb5fe4a033a7 tempest-VolumesActionsTest-2128676864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:45:55 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-ec5ec9c3-1da5-45a4-b68d-bb5fe4a033a7 tempest-VolumesActionsTest-2128676864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:45:55 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-ec5ec9c3-1da5-45a4-b68d-bb5fe4a033a7 tempest-VolumesActionsTest-2128676864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:45:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ec5ec9c3-1da5-45a4-b68d-bb5fe4a033a7 tempest-VolumesActionsTest-2128676864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:45:55 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-ec5ec9c3-1da5-45a4-b68d-bb5fe4a033a7 tempest-VolumesActionsTest-2128676864 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:45:55 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-ec5ec9c3-1da5-45a4-b68d-bb5fe4a033a7 tempest-VolumesActionsTest-2128676864 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:45:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ec5ec9c3-1da5-45a4-b68d-bb5fe4a033a7 tempest-VolumesActionsTest-2128676864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3dd97476-d1e7-4d9b-9fe8-b439fde95048 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:55 devstack sudo[86424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3dd97476-d1e7-4d9b-9fe8-b439fde95048 1073741824
Apr 09 12:45:55 devstack sudo[86424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:55 devstack cinder-volume[82760]: INFO cinder.volume.manager [req-cc838901-e9ef-446b-a878-a420780e34ea req-87fa414a-5a06-44af-9571-faf0531f7dac tempest-VolumesSnapshotsTestJSON-1591813130 None] Create snapshot completed successfully
Apr 09 12:45:56 devstack sudo[86424]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ec5ec9c3-1da5-45a4-b68d-bb5fe4a033a7 tempest-VolumesActionsTest-2128676864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3dd97476-d1e7-4d9b-9fe8-b439fde95048 1073741824" returned: 0 in 0.669s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ec5ec9c3-1da5-45a4-b68d-bb5fe4a033a7 tempest-VolumesActionsTest-2128676864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3dd97476-d1e7-4d9b-9fe8-b439fde95048 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:56 devstack sudo[86429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3dd97476-d1e7-4d9b-9fe8-b439fde95048
Apr 09 12:45:56 devstack sudo[86429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:56 devstack cinder-volume[82760]: DEBUG cinder.coordination [req-dd54409a-9c50-4733-8b20-8dd22c7271e8 req-5cefa328-bd73-4dc7-98a0-72b53f9ad488 tempest-VolumesSnapshotsTestJSON-1591813130 None] Acquiring lock "cinder-f307d6ed-9889-4b6c-81cd-ebaf332c43e3-delete_snapshot" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:45:56 devstack cinder-volume[82760]: DEBUG cinder.coordination [req-dd54409a-9c50-4733-8b20-8dd22c7271e8 req-5cefa328-bd73-4dc7-98a0-72b53f9ad488 tempest-VolumesSnapshotsTestJSON-1591813130 None] Lock "cinder-f307d6ed-9889-4b6c-81cd-ebaf332c43e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:45:56 devstack cinder-volume[82760]: DEBUG cinder.coordination [req-dd54409a-9c50-4733-8b20-8dd22c7271e8 req-5cefa328-bd73-4dc7-98a0-72b53f9ad488 tempest-VolumesSnapshotsTestJSON-1591813130 None] Acquiring lock "cinder-quobyte-c1aaeffd-94cd-4dc0-b3a4-952568550dc6" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:45:56 devstack cinder-volume[82760]: DEBUG cinder.coordination [req-dd54409a-9c50-4733-8b20-8dd22c7271e8 req-5cefa328-bd73-4dc7-98a0-72b53f9ad488 tempest-VolumesSnapshotsTestJSON-1591813130 None] Lock "cinder-quobyte-c1aaeffd-94cd-4dc0-b3a4-952568550dc6" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:45:56 devstack cinder-volume[82760]: DEBUG cinder.coordination [req-dd54409a-9c50-4733-8b20-8dd22c7271e8 req-5cefa328-bd73-4dc7-98a0-72b53f9ad488 tempest-VolumesSnapshotsTestJSON-1591813130 None] Acquiring lock "cinder-quobyte-f307d6ed-9889-4b6c-81cd-ebaf332c43e3" by "_delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:45:56 devstack cinder-volume[82760]: DEBUG cinder.coordination [req-dd54409a-9c50-4733-8b20-8dd22c7271e8 req-5cefa328-bd73-4dc7-98a0-72b53f9ad488 tempest-VolumesSnapshotsTestJSON-1591813130 None] Lock "cinder-quobyte-f307d6ed-9889-4b6c-81cd-ebaf332c43e3" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:45:56 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [req-dd54409a-9c50-4733-8b20-8dd22c7271e8 req-5cefa328-bd73-4dc7-98a0-72b53f9ad488 tempest-VolumesSnapshotsTestJSON-1591813130 None] Deleting offline snapshot f307d6ed-9889-4b6c-81cd-ebaf332c43e3 of volume c1aaeffd-94cd-4dc0-b3a4-952568550dc6 {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 12:45:56 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [req-dd54409a-9c50-4733-8b20-8dd22c7271e8 req-5cefa328-bd73-4dc7-98a0-72b53f9ad488 tempest-VolumesSnapshotsTestJSON-1591813130 None] snapshot_file for this snap is: volume-c1aaeffd-94cd-4dc0-b3a4-952568550dc6.f307d6ed-9889-4b6c-81cd-ebaf332c43e3 {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 12:45:56 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73602f3-0d93-411d-98b3-1ba8e748870d]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:45:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-dd54409a-9c50-4733-8b20-8dd22c7271e8 req-5cefa328-bd73-4dc7-98a0-72b53f9ad488 tempest-VolumesSnapshotsTestJSON-1591813130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c1aaeffd-94cd-4dc0-b3a4-952568550dc6.f307d6ed-9889-4b6c-81cd-ebaf332c43e3 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:56 devstack sudo[86429]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ec5ec9c3-1da5-45a4-b68d-bb5fe4a033a7 tempest-VolumesActionsTest-2128676864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3dd97476-d1e7-4d9b-9fe8-b439fde95048" returned: 0 in 0.607s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:56 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-ec5ec9c3-1da5-45a4-b68d-bb5fe4a033a7 tempest-VolumesActionsTest-2128676864 None] <== create_volume: return (1306ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:45:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ec5ec9c3-1da5-45a4-b68d-bb5fe4a033a7 tempest-VolumesActionsTest-2128676864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.308s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:45:56 devstack sudo[86432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c1aaeffd-94cd-4dc0-b3a4-952568550dc6.f307d6ed-9889-4b6c-81cd-ebaf332c43e3
Apr 09 12:45:56 devstack sudo[86432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:56 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ec5ec9c3-1da5-45a4-b68d-bb5fe4a033a7 tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95c705a5-a17d-4684-b25a-a757d35e41c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dd97476-d1e7-4d9b-9fe8-b439fde95048', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:56 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ec5ec9c3-1da5-45a4-b68d-bb5fe4a033a7 tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50df5f8d-65d7-4b9e-8c95-b2eb4dcd1713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:45:56 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-ec5ec9c3-1da5-45a4-b68d-bb5fe4a033a7 tempest-VolumesActionsTest-2128676864 None] Volume volume-3dd97476-d1e7-4d9b-9fe8-b439fde95048 (3dd97476-d1e7-4d9b-9fe8-b439fde95048): created successfully
Apr 09 12:45:56 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ec5ec9c3-1da5-45a4-b68d-bb5fe4a033a7 tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50df5f8d-65d7-4b9e-8c95-b2eb4dcd1713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:45:56 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ec5ec9c3-1da5-45a4-b68d-bb5fe4a033a7 tempest-VolumesActionsTest-2128676864 None] Flow 'volume_create_manager' (635ec8fc-e2f2-4ef6-b9f5-323171c1950f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:45:56 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-ec5ec9c3-1da5-45a4-b68d-bb5fe4a033a7 tempest-VolumesActionsTest-2128676864 None] Created volume successfully.
Apr 09 12:45:57 devstack sudo[86432]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-dd54409a-9c50-4733-8b20-8dd22c7271e8 req-5cefa328-bd73-4dc7-98a0-72b53f9ad488 tempest-VolumesSnapshotsTestJSON-1591813130 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c1aaeffd-94cd-4dc0-b3a4-952568550dc6.f307d6ed-9889-4b6c-81cd-ebaf332c43e3" returned: 0 in 0.544s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:57 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [req-dd54409a-9c50-4733-8b20-8dd22c7271e8 req-5cefa328-bd73-4dc7-98a0-72b53f9ad488 tempest-VolumesSnapshotsTestJSON-1591813130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1aaeffd-94cd-4dc0-b3a4-952568550dc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:45:57 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1bede8-40b7-4ae5-9bd6-a55710cff8ba]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:45:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-dd54409a-9c50-4733-8b20-8dd22c7271e8 req-5cefa328-bd73-4dc7-98a0-72b53f9ad488 tempest-VolumesSnapshotsTestJSON-1591813130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c1aaeffd-94cd-4dc0-b3a4-952568550dc6 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:57 devstack sudo[86437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c1aaeffd-94cd-4dc0-b3a4-952568550dc6
Apr 09 12:45:57 devstack sudo[86437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:57 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-c18a9f42-fbd6-4f34-8eaa-b044a811862b tempest-VolumesActionsTest-883262480 None] Acquiring lock "cinder-3dd97476-d1e7-4d9b-9fe8-b439fde95048-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:45:57 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-c18a9f42-fbd6-4f34-8eaa-b044a811862b tempest-VolumesActionsTest-883262480 None] Lock "cinder-3dd97476-d1e7-4d9b-9fe8-b439fde95048-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:45:57 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-c18a9f42-fbd6-4f34-8eaa-b044a811862b tempest-VolumesActionsTest-883262480 None] Acquiring lock "cinder-quobyte-3dd97476-d1e7-4d9b-9fe8-b439fde95048" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:45:57 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-c18a9f42-fbd6-4f34-8eaa-b044a811862b tempest-VolumesActionsTest-883262480 None] Lock "cinder-quobyte-3dd97476-d1e7-4d9b-9fe8-b439fde95048" acquired by "delete_volume" :: waited 0.011s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:45:57 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ce65b7-6057-4750-b756-ea7470159ec0]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:45:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c18a9f42-fbd6-4f34-8eaa-b044a811862b tempest-VolumesActionsTest-883262480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3dd97476-d1e7-4d9b-9fe8-b439fde95048 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:57 devstack sudo[86442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3dd97476-d1e7-4d9b-9fe8-b439fde95048
Apr 09 12:45:57 devstack sudo[86442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:57 devstack sudo[86437]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-dd54409a-9c50-4733-8b20-8dd22c7271e8 req-5cefa328-bd73-4dc7-98a0-72b53f9ad488 tempest-VolumesSnapshotsTestJSON-1591813130 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c1aaeffd-94cd-4dc0-b3a4-952568550dc6" returned: 0 in 0.582s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-dd54409a-9c50-4733-8b20-8dd22c7271e8 req-5cefa328-bd73-4dc7-98a0-72b53f9ad488 tempest-VolumesSnapshotsTestJSON-1591813130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c1aaeffd-94cd-4dc0-b3a4-952568550dc6.f307d6ed-9889-4b6c-81cd-ebaf332c43e3 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:57 devstack sudo[86444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c1aaeffd-94cd-4dc0-b3a4-952568550dc6.f307d6ed-9889-4b6c-81cd-ebaf332c43e3
Apr 09 12:45:57 devstack sudo[86444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:58 devstack sudo[86442]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c18a9f42-fbd6-4f34-8eaa-b044a811862b tempest-VolumesActionsTest-883262480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3dd97476-d1e7-4d9b-9fe8-b439fde95048" returned: 0 in 0.554s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c18a9f42-fbd6-4f34-8eaa-b044a811862b tempest-VolumesActionsTest-883262480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3dd97476-d1e7-4d9b-9fe8-b439fde95048 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:58 devstack sudo[86451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3dd97476-d1e7-4d9b-9fe8-b439fde95048
Apr 09 12:45:58 devstack sudo[86451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:58 devstack sudo[86444]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-dd54409a-9c50-4733-8b20-8dd22c7271e8 req-5cefa328-bd73-4dc7-98a0-72b53f9ad488 tempest-VolumesSnapshotsTestJSON-1591813130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c1aaeffd-94cd-4dc0-b3a4-952568550dc6.f307d6ed-9889-4b6c-81cd-ebaf332c43e3" returned: 0 in 0.659s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-dd54409a-9c50-4733-8b20-8dd22c7271e8 req-5cefa328-bd73-4dc7-98a0-72b53f9ad488 tempest-VolumesSnapshotsTestJSON-1591813130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c1aaeffd-94cd-4dc0-b3a4-952568550dc6.f307d6ed-9889-4b6c-81cd-ebaf332c43e3 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:58 devstack sudo[86454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c1aaeffd-94cd-4dc0-b3a4-952568550dc6.f307d6ed-9889-4b6c-81cd-ebaf332c43e3
Apr 09 12:45:58 devstack sudo[86454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:58 devstack sudo[86451]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c18a9f42-fbd6-4f34-8eaa-b044a811862b tempest-VolumesActionsTest-883262480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3dd97476-d1e7-4d9b-9fe8-b439fde95048" returned: 0 in 0.545s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:58 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-c18a9f42-fbd6-4f34-8eaa-b044a811862b tempest-VolumesActionsTest-883262480 None] Lock "cinder-quobyte-3dd97476-d1e7-4d9b-9fe8-b439fde95048" released by "delete_volume" :: held 1.127s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:45:58 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-c18a9f42-fbd6-4f34-8eaa-b044a811862b tempest-VolumesActionsTest-883262480 None] Created reservations ['7353f8ec-f0e6-4f10-a225-5500ee5205dc', '4377d056-1631-41a3-b77b-61ce329d88b4', '4e169667-723b-4291-9c82-ec557632663a', '2c52df5c-8f1d-49fe-a2d4-318e94fd9bad'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:45:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c18a9f42-fbd6-4f34-8eaa-b044a811862b tempest-VolumesActionsTest-883262480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:45:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c18a9f42-fbd6-4f34-8eaa-b044a811862b tempest-VolumesActionsTest-883262480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:45:58 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-c18a9f42-fbd6-4f34-8eaa-b044a811862b tempest-VolumesActionsTest-883262480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:45:58 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-c18a9f42-fbd6-4f34-8eaa-b044a811862b tempest-VolumesActionsTest-883262480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:45:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c18a9f42-fbd6-4f34-8eaa-b044a811862b tempest-VolumesActionsTest-883262480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:45:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c18a9f42-fbd6-4f34-8eaa-b044a811862b tempest-VolumesActionsTest-883262480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:45:58 devstack sudo[86458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:45:58 devstack sudo[86458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:45:58 devstack sudo[86454]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-dd54409a-9c50-4733-8b20-8dd22c7271e8 req-5cefa328-bd73-4dc7-98a0-72b53f9ad488 tempest-VolumesSnapshotsTestJSON-1591813130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c1aaeffd-94cd-4dc0-b3a4-952568550dc6.f307d6ed-9889-4b6c-81cd-ebaf332c43e3" returned: 0 in 0.550s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:58 devstack cinder-volume[82760]: DEBUG cinder.coordination [req-dd54409a-9c50-4733-8b20-8dd22c7271e8 req-5cefa328-bd73-4dc7-98a0-72b53f9ad488 tempest-VolumesSnapshotsTestJSON-1591813130 None] Lock "cinder-quobyte-f307d6ed-9889-4b6c-81cd-ebaf332c43e3" released by "_delete_snapshot" :: held 2.418s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:45:58 devstack cinder-volume[82760]: DEBUG cinder.coordination [req-dd54409a-9c50-4733-8b20-8dd22c7271e8 req-5cefa328-bd73-4dc7-98a0-72b53f9ad488 tempest-VolumesSnapshotsTestJSON-1591813130 None] Lock "cinder-quobyte-c1aaeffd-94cd-4dc0-b3a4-952568550dc6" released by "delete_snapshot" :: held 2.448s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:45:59 devstack cinder-volume[82760]: WARNING cinder.quota [req-dd54409a-9c50-4733-8b20-8dd22c7271e8 req-5cefa328-bd73-4dc7-98a0-72b53f9ad488 tempest-VolumesSnapshotsTestJSON-1591813130 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 09 12:45:59 devstack cinder-volume[82760]: DEBUG cinder.quota [req-dd54409a-9c50-4733-8b20-8dd22c7271e8 req-5cefa328-bd73-4dc7-98a0-72b53f9ad488 tempest-VolumesSnapshotsTestJSON-1591813130 None] Created reservations ['aa0f22d8-887b-465d-bbb2-d41bf321762c', 'ec670f6b-a535-4fad-8ab0-62754949de90', '7a262220-e0ce-404d-aecd-f2b5685292c5', 'a2fe7947-290c-4a64-a47d-69995a720217'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:45:59 devstack cinder-volume[82760]: INFO cinder.volume.manager [req-dd54409a-9c50-4733-8b20-8dd22c7271e8 req-5cefa328-bd73-4dc7-98a0-72b53f9ad488 tempest-VolumesSnapshotsTestJSON-1591813130 None] Delete snapshot completed successfully.
Apr 09 12:45:59 devstack cinder-volume[82760]: DEBUG cinder.coordination [req-dd54409a-9c50-4733-8b20-8dd22c7271e8 req-5cefa328-bd73-4dc7-98a0-72b53f9ad488 tempest-VolumesSnapshotsTestJSON-1591813130 None] Lock "cinder-f307d6ed-9889-4b6c-81cd-ebaf332c43e3-delete_snapshot" released by "delete_snapshot" :: held 2.555s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:45:59 devstack sudo[86458]: pam_unix(sudo:session): session closed for user root
Apr 09 12:45:59 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c18a9f42-fbd6-4f34-8eaa-b044a811862b tempest-VolumesActionsTest-883262480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.507s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:45:59 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-c18a9f42-fbd6-4f34-8eaa-b044a811862b tempest-VolumesActionsTest-883262480 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:45:59 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-c18a9f42-fbd6-4f34-8eaa-b044a811862b tempest-VolumesActionsTest-883262480 None] Deleted volume successfully.
Apr 09 12:45:59 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-c18a9f42-fbd6-4f34-8eaa-b044a811862b tempest-VolumesActionsTest-883262480 None] Lock "cinder-3dd97476-d1e7-4d9b-9fe8-b439fde95048-delete_volume" released by "delete_volume" :: held 1.783s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:45:59 devstack cinder-volume[82760]: DEBUG cinder.coordination [req-fe829083-299a-4562-9c51-a1294907e6cc req-50775921-9f96-4fba-a30e-7ad7bc9392e5 tempest-VolumesSnapshotsTestJSON-1591813130 None] Acquiring lock "cinder-c1aaeffd-94cd-4dc0-b3a4-952568550dc6-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:45:59 devstack cinder-volume[82760]: DEBUG cinder.coordination [req-fe829083-299a-4562-9c51-a1294907e6cc req-50775921-9f96-4fba-a30e-7ad7bc9392e5 tempest-VolumesSnapshotsTestJSON-1591813130 None] Lock "cinder-c1aaeffd-94cd-4dc0-b3a4-952568550dc6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:45:59 devstack cinder-volume[82760]: DEBUG cinder.coordination [req-fe829083-299a-4562-9c51-a1294907e6cc req-50775921-9f96-4fba-a30e-7ad7bc9392e5 tempest-VolumesSnapshotsTestJSON-1591813130 None] Acquiring lock "cinder-quobyte-c1aaeffd-94cd-4dc0-b3a4-952568550dc6" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:45:59 devstack cinder-volume[82760]: DEBUG cinder.coordination [req-fe829083-299a-4562-9c51-a1294907e6cc req-50775921-9f96-4fba-a30e-7ad7bc9392e5 tempest-VolumesSnapshotsTestJSON-1591813130 None] Lock "cinder-quobyte-c1aaeffd-94cd-4dc0-b3a4-952568550dc6" acquired by "delete_volume" :: waited 0.016s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:45:59 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84a77f5-85da-4251-937e-ed17e1e0377b]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:45:59 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-fe829083-299a-4562-9c51-a1294907e6cc req-50775921-9f96-4fba-a30e-7ad7bc9392e5 tempest-VolumesSnapshotsTestJSON-1591813130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c1aaeffd-94cd-4dc0-b3a4-952568550dc6 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:00 devstack sudo[86461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c1aaeffd-94cd-4dc0-b3a4-952568550dc6
Apr 09 12:46:00 devstack sudo[86461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:00 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-c873330f-c6c0-46e5-9d27-15ed6b8a42ed tempest-VolumesActionsTest-2128676864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:46:00 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c873330f-c6c0-46e5-9d27-15ed6b8a42ed tempest-VolumesActionsTest-2128676864 None] Flow 'volume_create_manager' (bcbef9a4-a79b-4afc-8a50-ae9041689283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:46:00 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c873330f-c6c0-46e5-9d27-15ed6b8a42ed tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (976c5638-3d59-4e01-8ccd-2316a97d97b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:00 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c873330f-c6c0-46e5-9d27-15ed6b8a42ed tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (976c5638-3d59-4e01-8ccd-2316a97d97b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1936974050',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e96c9241-2794-4755-a693-b8c74b18a7ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5844d191f2346f6861837b2fdebd9c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:46:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:46:00Z,use_quota=True,user_id='4ea38a96fa5b4c7cae4a7b90acc9570f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:00 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c873330f-c6c0-46e5-9d27-15ed6b8a42ed tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b1ef2e8-2fbd-43e8-a990-8da6d8eb3fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:00 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c873330f-c6c0-46e5-9d27-15ed6b8a42ed tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b1ef2e8-2fbd-43e8-a990-8da6d8eb3fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:00 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c873330f-c6c0-46e5-9d27-15ed6b8a42ed tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eab9fd4-e73d-4c0d-8ee9-95f9acebc3ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:00 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c873330f-c6c0-46e5-9d27-15ed6b8a42ed tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eab9fd4-e73d-4c0d-8ee9-95f9acebc3ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e96c9241-2794-4755-a693-b8c74b18a7ef', 'volume_name': 'volume-e96c9241-2794-4755-a693-b8c74b18a7ef', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:00 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c873330f-c6c0-46e5-9d27-15ed6b8a42ed tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d007d204-021f-4a6f-a114-ca645226ed6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:00 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c873330f-c6c0-46e5-9d27-15ed6b8a42ed tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d007d204-021f-4a6f-a114-ca645226ed6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:00 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c873330f-c6c0-46e5-9d27-15ed6b8a42ed tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e954bf4c-6f23-47e6-87c8-a9254249225a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:00 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-c873330f-c6c0-46e5-9d27-15ed6b8a42ed tempest-VolumesActionsTest-2128676864 None] Volume e96c9241-2794-4755-a693-b8c74b18a7ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e96c9241-2794-4755-a693-b8c74b18a7ef', 'volume_size': 1}
Apr 09 12:46:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c873330f-c6c0-46e5-9d27-15ed6b8a42ed tempest-VolumesActionsTest-2128676864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:46:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c873330f-c6c0-46e5-9d27-15ed6b8a42ed tempest-VolumesActionsTest-2128676864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:46:00 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-c873330f-c6c0-46e5-9d27-15ed6b8a42ed tempest-VolumesActionsTest-2128676864 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1936974050',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e96c9241-2794-4755-a693-b8c74b18a7ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5844d191f2346f6861837b2fdebd9c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:46:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:46:00Z,use_quota=True,user_id='4ea38a96fa5b4c7cae4a7b90acc9570f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:46:00 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-c873330f-c6c0-46e5-9d27-15ed6b8a42ed tempest-VolumesActionsTest-2128676864 None] Creating volume e96c9241-2794-4755-a693-b8c74b18a7ef {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:46:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c873330f-c6c0-46e5-9d27-15ed6b8a42ed tempest-VolumesActionsTest-2128676864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:46:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c873330f-c6c0-46e5-9d27-15ed6b8a42ed tempest-VolumesActionsTest-2128676864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:46:00 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-c873330f-c6c0-46e5-9d27-15ed6b8a42ed tempest-VolumesActionsTest-2128676864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:46:00 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-c873330f-c6c0-46e5-9d27-15ed6b8a42ed tempest-VolumesActionsTest-2128676864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:46:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c873330f-c6c0-46e5-9d27-15ed6b8a42ed tempest-VolumesActionsTest-2128676864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:46:00 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-c873330f-c6c0-46e5-9d27-15ed6b8a42ed tempest-VolumesActionsTest-2128676864 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:46:00 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-c873330f-c6c0-46e5-9d27-15ed6b8a42ed tempest-VolumesActionsTest-2128676864 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:46:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c873330f-c6c0-46e5-9d27-15ed6b8a42ed tempest-VolumesActionsTest-2128676864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e96c9241-2794-4755-a693-b8c74b18a7ef 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:00 devstack sudo[86464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e96c9241-2794-4755-a693-b8c74b18a7ef 1073741824
Apr 09 12:46:00 devstack sudo[86464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:00 devstack sudo[86461]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-fe829083-299a-4562-9c51-a1294907e6cc req-50775921-9f96-4fba-a30e-7ad7bc9392e5 tempest-VolumesSnapshotsTestJSON-1591813130 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c1aaeffd-94cd-4dc0-b3a4-952568550dc6" returned: 0 in 0.761s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-fe829083-299a-4562-9c51-a1294907e6cc req-50775921-9f96-4fba-a30e-7ad7bc9392e5 tempest-VolumesSnapshotsTestJSON-1591813130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c1aaeffd-94cd-4dc0-b3a4-952568550dc6 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:00 devstack sudo[86469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c1aaeffd-94cd-4dc0-b3a4-952568550dc6
Apr 09 12:46:00 devstack sudo[86469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:01 devstack sudo[86464]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c873330f-c6c0-46e5-9d27-15ed6b8a42ed tempest-VolumesActionsTest-2128676864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e96c9241-2794-4755-a693-b8c74b18a7ef 1073741824" returned: 0 in 0.850s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c873330f-c6c0-46e5-9d27-15ed6b8a42ed tempest-VolumesActionsTest-2128676864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e96c9241-2794-4755-a693-b8c74b18a7ef {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:01 devstack sudo[86475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e96c9241-2794-4755-a693-b8c74b18a7ef
Apr 09 12:46:01 devstack sudo[86475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:01 devstack sudo[86469]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-fe829083-299a-4562-9c51-a1294907e6cc req-50775921-9f96-4fba-a30e-7ad7bc9392e5 tempest-VolumesSnapshotsTestJSON-1591813130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c1aaeffd-94cd-4dc0-b3a4-952568550dc6" returned: 0 in 0.674s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:01 devstack cinder-volume[82760]: DEBUG cinder.coordination [req-fe829083-299a-4562-9c51-a1294907e6cc req-50775921-9f96-4fba-a30e-7ad7bc9392e5 tempest-VolumesSnapshotsTestJSON-1591813130 None] Lock "cinder-quobyte-c1aaeffd-94cd-4dc0-b3a4-952568550dc6" released by "delete_volume" :: held 1.478s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:46:01 devstack cinder-volume[82760]: DEBUG cinder.quota [req-fe829083-299a-4562-9c51-a1294907e6cc req-50775921-9f96-4fba-a30e-7ad7bc9392e5 tempest-VolumesSnapshotsTestJSON-1591813130 None] Created reservations ['e5749149-ba22-40b3-a8ab-51abab2d554a', '2a80babe-472a-46a0-aa3e-5fab665c6b58', 'd7702942-b4f1-4a48-8cf7-de010bae401d', 'ed822a16-e0c2-46d0-b757-ed043773f411'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:46:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [req-fe829083-299a-4562-9c51-a1294907e6cc req-50775921-9f96-4fba-a30e-7ad7bc9392e5 tempest-VolumesSnapshotsTestJSON-1591813130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:46:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [req-fe829083-299a-4562-9c51-a1294907e6cc req-50775921-9f96-4fba-a30e-7ad7bc9392e5 tempest-VolumesSnapshotsTestJSON-1591813130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:46:01 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [req-fe829083-299a-4562-9c51-a1294907e6cc req-50775921-9f96-4fba-a30e-7ad7bc9392e5 tempest-VolumesSnapshotsTestJSON-1591813130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:46:01 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [req-fe829083-299a-4562-9c51-a1294907e6cc req-50775921-9f96-4fba-a30e-7ad7bc9392e5 tempest-VolumesSnapshotsTestJSON-1591813130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:46:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [req-fe829083-299a-4562-9c51-a1294907e6cc req-50775921-9f96-4fba-a30e-7ad7bc9392e5 tempest-VolumesSnapshotsTestJSON-1591813130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:46:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-fe829083-299a-4562-9c51-a1294907e6cc req-50775921-9f96-4fba-a30e-7ad7bc9392e5 tempest-VolumesSnapshotsTestJSON-1591813130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:01 devstack sudo[86477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:46:01 devstack sudo[86477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:01 devstack sudo[86475]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c873330f-c6c0-46e5-9d27-15ed6b8a42ed tempest-VolumesActionsTest-2128676864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e96c9241-2794-4755-a693-b8c74b18a7ef" returned: 0 in 0.577s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:01 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-c873330f-c6c0-46e5-9d27-15ed6b8a42ed tempest-VolumesActionsTest-2128676864 None] <== create_volume: return (1485ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:46:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c873330f-c6c0-46e5-9d27-15ed6b8a42ed tempest-VolumesActionsTest-2128676864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.488s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:46:01 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c873330f-c6c0-46e5-9d27-15ed6b8a42ed tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e954bf4c-6f23-47e6-87c8-a9254249225a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e96c9241-2794-4755-a693-b8c74b18a7ef', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:01 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c873330f-c6c0-46e5-9d27-15ed6b8a42ed tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (467dffcb-2156-414a-a498-d68986e2b397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:01 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-c873330f-c6c0-46e5-9d27-15ed6b8a42ed tempest-VolumesActionsTest-2128676864 None] Volume volume-e96c9241-2794-4755-a693-b8c74b18a7ef (e96c9241-2794-4755-a693-b8c74b18a7ef): created successfully
Apr 09 12:46:01 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c873330f-c6c0-46e5-9d27-15ed6b8a42ed tempest-VolumesActionsTest-2128676864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (467dffcb-2156-414a-a498-d68986e2b397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:01 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c873330f-c6c0-46e5-9d27-15ed6b8a42ed tempest-VolumesActionsTest-2128676864 None] Flow 'volume_create_manager' (bcbef9a4-a79b-4afc-8a50-ae9041689283) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:46:01 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-c873330f-c6c0-46e5-9d27-15ed6b8a42ed tempest-VolumesActionsTest-2128676864 None] Created volume successfully.
Apr 09 12:46:02 devstack sudo[86477]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [req-fe829083-299a-4562-9c51-a1294907e6cc req-50775921-9f96-4fba-a30e-7ad7bc9392e5 tempest-VolumesSnapshotsTestJSON-1591813130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.687s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:02 devstack cinder-volume[82760]: DEBUG cinder.manager [req-fe829083-299a-4562-9c51-a1294907e6cc req-50775921-9f96-4fba-a30e-7ad7bc9392e5 tempest-VolumesSnapshotsTestJSON-1591813130 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:46:02 devstack cinder-volume[82760]: INFO cinder.volume.manager [req-fe829083-299a-4562-9c51-a1294907e6cc req-50775921-9f96-4fba-a30e-7ad7bc9392e5 tempest-VolumesSnapshotsTestJSON-1591813130 None] Deleted volume successfully.
Apr 09 12:46:02 devstack cinder-volume[82760]: DEBUG cinder.coordination [req-fe829083-299a-4562-9c51-a1294907e6cc req-50775921-9f96-4fba-a30e-7ad7bc9392e5 tempest-VolumesSnapshotsTestJSON-1591813130 None] Lock "cinder-c1aaeffd-94cd-4dc0-b3a4-952568550dc6-delete_volume" released by "delete_volume" :: held 2.375s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:46:02 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-e3c7b694-4d06-4a12-8b4d-f16b6be3f57b tempest-VolumesActionsTest-2128676864 None] Acquiring lock "cinder-e96c9241-2794-4755-a693-b8c74b18a7ef-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:46:02 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-e3c7b694-4d06-4a12-8b4d-f16b6be3f57b tempest-VolumesActionsTest-2128676864 None] Lock "cinder-e96c9241-2794-4755-a693-b8c74b18a7ef-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:46:03 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-e3c7b694-4d06-4a12-8b4d-f16b6be3f57b tempest-VolumesActionsTest-2128676864 None] Acquiring lock "cinder-quobyte-e96c9241-2794-4755-a693-b8c74b18a7ef" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:46:03 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-e3c7b694-4d06-4a12-8b4d-f16b6be3f57b tempest-VolumesActionsTest-2128676864 None] Lock "cinder-quobyte-e96c9241-2794-4755-a693-b8c74b18a7ef" acquired by "delete_volume" :: waited 0.008s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:46:03 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c9f22b-8a59-48c3-952c-9e545c4f84da]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:46:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e3c7b694-4d06-4a12-8b4d-f16b6be3f57b tempest-VolumesActionsTest-2128676864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e96c9241-2794-4755-a693-b8c74b18a7ef {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:03 devstack sudo[86483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e96c9241-2794-4755-a693-b8c74b18a7ef
Apr 09 12:46:03 devstack sudo[86483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:03 devstack sudo[86483]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e3c7b694-4d06-4a12-8b4d-f16b6be3f57b tempest-VolumesActionsTest-2128676864 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e96c9241-2794-4755-a693-b8c74b18a7ef" returned: 0 in 0.773s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e3c7b694-4d06-4a12-8b4d-f16b6be3f57b tempest-VolumesActionsTest-2128676864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e96c9241-2794-4755-a693-b8c74b18a7ef {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:03 devstack sudo[86488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e96c9241-2794-4755-a693-b8c74b18a7ef
Apr 09 12:46:03 devstack sudo[86488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:04 devstack sudo[86488]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e3c7b694-4d06-4a12-8b4d-f16b6be3f57b tempest-VolumesActionsTest-2128676864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e96c9241-2794-4755-a693-b8c74b18a7ef" returned: 0 in 0.513s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:04 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-e3c7b694-4d06-4a12-8b4d-f16b6be3f57b tempest-VolumesActionsTest-2128676864 None] Lock "cinder-quobyte-e96c9241-2794-4755-a693-b8c74b18a7ef" released by "delete_volume" :: held 1.330s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:46:04 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-e3c7b694-4d06-4a12-8b4d-f16b6be3f57b tempest-VolumesActionsTest-2128676864 None] Created reservations ['f151b7a8-7bcc-420a-842d-44826c7e5503', '6217eb30-badf-40d4-b9ac-d281c643fc46', '0c03cc2a-171a-45ec-a14b-c1e0ba8e2766', '2c11a902-277a-4c9c-8a5b-5633c37be621'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:46:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-e3c7b694-4d06-4a12-8b4d-f16b6be3f57b tempest-VolumesActionsTest-2128676864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:46:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-e3c7b694-4d06-4a12-8b4d-f16b6be3f57b tempest-VolumesActionsTest-2128676864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:46:04 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-e3c7b694-4d06-4a12-8b4d-f16b6be3f57b tempest-VolumesActionsTest-2128676864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:46:04 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-e3c7b694-4d06-4a12-8b4d-f16b6be3f57b tempest-VolumesActionsTest-2128676864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:46:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-e3c7b694-4d06-4a12-8b4d-f16b6be3f57b tempest-VolumesActionsTest-2128676864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:46:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e3c7b694-4d06-4a12-8b4d-f16b6be3f57b tempest-VolumesActionsTest-2128676864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:04 devstack sudo[86491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:46:04 devstack sudo[86491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:04 devstack sudo[86491]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e3c7b694-4d06-4a12-8b4d-f16b6be3f57b tempest-VolumesActionsTest-2128676864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.471s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:04 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-e3c7b694-4d06-4a12-8b4d-f16b6be3f57b tempest-VolumesActionsTest-2128676864 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:46:04 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-e3c7b694-4d06-4a12-8b4d-f16b6be3f57b tempest-VolumesActionsTest-2128676864 None] Deleted volume successfully.
Apr 09 12:46:05 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-e3c7b694-4d06-4a12-8b4d-f16b6be3f57b tempest-VolumesActionsTest-2128676864 None] Lock "cinder-e96c9241-2794-4755-a693-b8c74b18a7ef-delete_volume" released by "delete_volume" :: held 2.042s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:46:09 devstack cinder-volume[82760]: DEBUG oslo_service.periodic_task [None req-f8337202-8290-4658-916e-19cfa929172e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82760) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 09 12:46:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f8337202-8290-4658-916e-19cfa929172e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:46:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f8337202-8290-4658-916e-19cfa929172e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:46:09 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f8337202-8290-4658-916e-19cfa929172e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:46:09 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f8337202-8290-4658-916e-19cfa929172e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:46:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f8337202-8290-4658-916e-19cfa929172e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:46:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f8337202-8290-4658-916e-19cfa929172e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:09 devstack sudo[86496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:46:09 devstack sudo[86496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:10 devstack sudo[86496]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f8337202-8290-4658-916e-19cfa929172e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.662s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:10 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-f8337202-8290-4658-916e-19cfa929172e None None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:46:12 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-d888ade4-0d42-4724-8b7d-dfaa68be29d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:46:12 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d888ade4-0d42-4724-8b7d-dfaa68be29d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Flow 'volume_create_manager' (8a4731d7-a641-4fe8-8f64-71c1e00ee915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:46:12 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d888ade4-0d42-4724-8b7d-dfaa68be29d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbb74f45-f196-4e0a-87cb-83ceb7485dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:12 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d888ade4-0d42-4724-8b7d-dfaa68be29d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbb74f45-f196-4e0a-87cb-83ceb7485dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:46:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-188354607',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d688faa47d7643e8b5598289f824ce48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:46:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:46:12Z,use_quota=True,user_id='5cdf8b19a98a475aa9d62541aca56811',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:12 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d888ade4-0d42-4724-8b7d-dfaa68be29d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35a28829-fa3b-4541-96cf-abb018091961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:12 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d888ade4-0d42-4724-8b7d-dfaa68be29d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35a28829-fa3b-4541-96cf-abb018091961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:12 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d888ade4-0d42-4724-8b7d-dfaa68be29d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8737c780-d3a6-4967-8198-ffd938d3b81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:12 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d888ade4-0d42-4724-8b7d-dfaa68be29d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8737c780-d3a6-4967-8198-ffd938d3b81a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa', 'volume_name': 'volume-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:12 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d888ade4-0d42-4724-8b7d-dfaa68be29d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a86f52ef-0451-4930-a7fa-9733add9f13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:12 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d888ade4-0d42-4724-8b7d-dfaa68be29d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a86f52ef-0451-4930-a7fa-9733add9f13b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:12 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d888ade4-0d42-4724-8b7d-dfaa68be29d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b898aef5-ead7-45dc-9ff9-c3cb92f40656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:12 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-d888ade4-0d42-4724-8b7d-dfaa68be29d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Volume 9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa', 'volume_size': 1}
Apr 09 12:46:12 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d888ade4-0d42-4724-8b7d-dfaa68be29d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:46:12 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d888ade4-0d42-4724-8b7d-dfaa68be29d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:46:12 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-d888ade4-0d42-4724-8b7d-dfaa68be29d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:46:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-188354607',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d688faa47d7643e8b5598289f824ce48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:46:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:46:12Z,use_quota=True,user_id='5cdf8b19a98a475aa9d62541aca56811',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:46:12 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-d888ade4-0d42-4724-8b7d-dfaa68be29d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Creating volume 9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:46:12 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d888ade4-0d42-4724-8b7d-dfaa68be29d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:46:12 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d888ade4-0d42-4724-8b7d-dfaa68be29d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:46:12 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-d888ade4-0d42-4724-8b7d-dfaa68be29d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:46:12 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-d888ade4-0d42-4724-8b7d-dfaa68be29d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:46:12 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d888ade4-0d42-4724-8b7d-dfaa68be29d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:46:12 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-d888ade4-0d42-4724-8b7d-dfaa68be29d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:46:12 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-d888ade4-0d42-4724-8b7d-dfaa68be29d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:46:12 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d888ade4-0d42-4724-8b7d-dfaa68be29d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:12 devstack sudo[86501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa 1073741824
Apr 09 12:46:12 devstack sudo[86501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:13 devstack sudo[86501]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:13 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d888ade4-0d42-4724-8b7d-dfaa68be29d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa 1073741824" returned: 0 in 0.771s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:13 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d888ade4-0d42-4724-8b7d-dfaa68be29d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:13 devstack sudo[86507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa
Apr 09 12:46:13 devstack sudo[86507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:13 devstack sudo[86507]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:13 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d888ade4-0d42-4724-8b7d-dfaa68be29d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa" returned: 0 in 0.643s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:13 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-d888ade4-0d42-4724-8b7d-dfaa68be29d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] <== create_volume: return (1458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:46:13 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d888ade4-0d42-4724-8b7d-dfaa68be29d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:46:13 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d888ade4-0d42-4724-8b7d-dfaa68be29d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b898aef5-ead7-45dc-9ff9-c3cb92f40656) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:13 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d888ade4-0d42-4724-8b7d-dfaa68be29d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (582bbf46-acee-479a-a911-29b78f37e3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:13 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-d888ade4-0d42-4724-8b7d-dfaa68be29d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Volume volume-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa (9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa): created successfully
Apr 09 12:46:13 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d888ade4-0d42-4724-8b7d-dfaa68be29d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (582bbf46-acee-479a-a911-29b78f37e3b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:13 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d888ade4-0d42-4724-8b7d-dfaa68be29d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Flow 'volume_create_manager' (8a4731d7-a641-4fe8-8f64-71c1e00ee915) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:46:13 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-d888ade4-0d42-4724-8b7d-dfaa68be29d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Created volume successfully.
Apr 09 12:46:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f1ccc280-5d6d-44ea-874b-ca9ec20dabc1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:46:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f1ccc280-5d6d-44ea-874b-ca9ec20dabc1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:46:14 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-f1ccc280-5d6d-44ea-874b-ca9ec20dabc1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Creating offline snapshot 3f7b5dd2-ef8b-46aa-8b15-58a63b572aad of volume 9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa {{(pid=82760) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 12:46:14 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[baffe6ef-3185-47e2-bca0-7a4aaac52ffe]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:46:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f1ccc280-5d6d-44ea-874b-ca9ec20dabc1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:14 devstack sudo[86511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa
Apr 09 12:46:14 devstack sudo[86511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:15 devstack sudo[86511]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:15 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f1ccc280-5d6d-44ea-874b-ca9ec20dabc1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa" returned: 0 in 0.719s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:15 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f1ccc280-5d6d-44ea-874b-ca9ec20dabc1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa.3f7b5dd2-ef8b-46aa-8b15-58a63b572aad 1G {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:15 devstack sudo[86520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa.3f7b5dd2-ef8b-46aa-8b15-58a63b572aad 1G
Apr 09 12:46:15 devstack sudo[86520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:16 devstack sudo[86520]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:16 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f1ccc280-5d6d-44ea-874b-ca9ec20dabc1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa.3f7b5dd2-ef8b-46aa-8b15-58a63b572aad 1G" returned: 0 in 0.727s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:16 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f1ccc280-5d6d-44ea-874b-ca9ec20dabc1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa.3f7b5dd2-ef8b-46aa-8b15-58a63b572aad {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:16 devstack sudo[86526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa.3f7b5dd2-ef8b-46aa-8b15-58a63b572aad
Apr 09 12:46:16 devstack sudo[86526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:16 devstack sudo[86526]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:16 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f1ccc280-5d6d-44ea-874b-ca9ec20dabc1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa.3f7b5dd2-ef8b-46aa-8b15-58a63b572aad" returned: 0 in 0.641s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:16 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-f1ccc280-5d6d-44ea-874b-ca9ec20dabc1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa.3f7b5dd2-ef8b-46aa-8b15-58a63b572aad is being set with open permissions: ugo+rw
Apr 09 12:46:16 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f1ccc280-5d6d-44ea-874b-ca9ec20dabc1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa.3f7b5dd2-ef8b-46aa-8b15-58a63b572aad {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:16 devstack sudo[86532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa.3f7b5dd2-ef8b-46aa-8b15-58a63b572aad
Apr 09 12:46:16 devstack sudo[86532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:17 devstack sudo[86532]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:17 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f1ccc280-5d6d-44ea-874b-ca9ec20dabc1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa.3f7b5dd2-ef8b-46aa-8b15-58a63b572aad" returned: 0 in 0.634s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:17 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f1ccc280-5d6d-44ea-874b-ca9ec20dabc1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:17 devstack sudo[86535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa.info
Apr 09 12:46:17 devstack sudo[86535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:17 devstack sudo[86535]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:17 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f1ccc280-5d6d-44ea-874b-ca9ec20dabc1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa.info" returned: 0 in 0.591s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:17 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-f1ccc280-5d6d-44ea-874b-ca9ec20dabc1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa.info is being set with open permissions: ugo+rw
Apr 09 12:46:17 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f1ccc280-5d6d-44ea-874b-ca9ec20dabc1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:17 devstack sudo[86538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa.info
Apr 09 12:46:17 devstack sudo[86538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:18 devstack sudo[86538]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f1ccc280-5d6d-44ea-874b-ca9ec20dabc1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa.info" returned: 0 in 0.593s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f1ccc280-5d6d-44ea-874b-ca9ec20dabc1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.016s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:46:18 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-f1ccc280-5d6d-44ea-874b-ca9ec20dabc1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Create snapshot completed successfully
Apr 09 12:46:19 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-83629e22-d0e5-4102-8496-9965b17aa02a tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Acquiring lock "cinder-3f7b5dd2-ef8b-46aa-8b15-58a63b572aad-delete_snapshot" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:46:19 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-83629e22-d0e5-4102-8496-9965b17aa02a tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Lock "cinder-3f7b5dd2-ef8b-46aa-8b15-58a63b572aad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:46:19 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-83629e22-d0e5-4102-8496-9965b17aa02a tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Acquiring lock "cinder-quobyte-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:46:19 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-83629e22-d0e5-4102-8496-9965b17aa02a tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Lock "cinder-quobyte-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:46:19 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-83629e22-d0e5-4102-8496-9965b17aa02a tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Acquiring lock "cinder-quobyte-3f7b5dd2-ef8b-46aa-8b15-58a63b572aad" by "_delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:46:19 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-83629e22-d0e5-4102-8496-9965b17aa02a tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Lock "cinder-quobyte-3f7b5dd2-ef8b-46aa-8b15-58a63b572aad" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:46:19 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-83629e22-d0e5-4102-8496-9965b17aa02a tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Deleting offline snapshot 3f7b5dd2-ef8b-46aa-8b15-58a63b572aad of volume 9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 12:46:19 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-83629e22-d0e5-4102-8496-9965b17aa02a tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] snapshot_file for this snap is: volume-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa.3f7b5dd2-ef8b-46aa-8b15-58a63b572aad {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 12:46:19 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[e182d113-6dd4-4b03-b230-e09576949b0b]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:46:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-83629e22-d0e5-4102-8496-9965b17aa02a tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa.3f7b5dd2-ef8b-46aa-8b15-58a63b572aad {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:19 devstack sudo[86541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa.3f7b5dd2-ef8b-46aa-8b15-58a63b572aad
Apr 09 12:46:19 devstack sudo[86541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:19 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-473bf203-91eb-4927-baeb-4997742597ad tempest-VolumesListAdminTestJSON-247238328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:46:19 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-473bf203-91eb-4927-baeb-4997742597ad tempest-VolumesListAdminTestJSON-247238328 None] Flow 'volume_create_manager' (ff01063f-190c-4311-8f35-6a88b4567d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:46:19 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-473bf203-91eb-4927-baeb-4997742597ad tempest-VolumesListAdminTestJSON-247238328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b61e8b6-f763-489e-b820-ca2b073e6238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:19 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-473bf203-91eb-4927-baeb-4997742597ad tempest-VolumesListAdminTestJSON-247238328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b61e8b6-f763-489e-b820-ca2b073e6238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-473882193',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfc7565c-7084-4526-8d6f-07ee7c26b398,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fb59ea4d38e45afa5d9acb7bf02666b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:46:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:46:20Z,use_quota=True,user_id='7b626fde63b34c76aad1f41d361394fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:19 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-473bf203-91eb-4927-baeb-4997742597ad tempest-VolumesListAdminTestJSON-247238328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc78f67d-30ab-4487-9181-51dffdc1ffb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:19 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-473bf203-91eb-4927-baeb-4997742597ad tempest-VolumesListAdminTestJSON-247238328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc78f67d-30ab-4487-9181-51dffdc1ffb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:19 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-473bf203-91eb-4927-baeb-4997742597ad tempest-VolumesListAdminTestJSON-247238328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7332e31d-30d4-4f90-b2d9-233516a41993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:19 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-473bf203-91eb-4927-baeb-4997742597ad tempest-VolumesListAdminTestJSON-247238328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7332e31d-30d4-4f90-b2d9-233516a41993) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfc7565c-7084-4526-8d6f-07ee7c26b398', 'volume_name': 'volume-dfc7565c-7084-4526-8d6f-07ee7c26b398', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:19 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-473bf203-91eb-4927-baeb-4997742597ad tempest-VolumesListAdminTestJSON-247238328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (544670d0-d14a-4f47-a3f6-19225c1337ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:19 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-473bf203-91eb-4927-baeb-4997742597ad tempest-VolumesListAdminTestJSON-247238328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (544670d0-d14a-4f47-a3f6-19225c1337ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:19 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-473bf203-91eb-4927-baeb-4997742597ad tempest-VolumesListAdminTestJSON-247238328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e7e23a9-0f19-4888-841a-4adfcfb150bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:19 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-473bf203-91eb-4927-baeb-4997742597ad tempest-VolumesListAdminTestJSON-247238328 None] Volume dfc7565c-7084-4526-8d6f-07ee7c26b398: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfc7565c-7084-4526-8d6f-07ee7c26b398', 'volume_size': 1}
Apr 09 12:46:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-473bf203-91eb-4927-baeb-4997742597ad tempest-VolumesListAdminTestJSON-247238328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:46:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-473bf203-91eb-4927-baeb-4997742597ad tempest-VolumesListAdminTestJSON-247238328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:46:19 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-473bf203-91eb-4927-baeb-4997742597ad tempest-VolumesListAdminTestJSON-247238328 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-473882193',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfc7565c-7084-4526-8d6f-07ee7c26b398,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fb59ea4d38e45afa5d9acb7bf02666b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:46:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:46:20Z,use_quota=True,user_id='7b626fde63b34c76aad1f41d361394fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:46:19 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-473bf203-91eb-4927-baeb-4997742597ad tempest-VolumesListAdminTestJSON-247238328 None] Creating volume dfc7565c-7084-4526-8d6f-07ee7c26b398 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:46:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-473bf203-91eb-4927-baeb-4997742597ad tempest-VolumesListAdminTestJSON-247238328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:46:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-473bf203-91eb-4927-baeb-4997742597ad tempest-VolumesListAdminTestJSON-247238328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:46:19 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-473bf203-91eb-4927-baeb-4997742597ad tempest-VolumesListAdminTestJSON-247238328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:46:19 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-473bf203-91eb-4927-baeb-4997742597ad tempest-VolumesListAdminTestJSON-247238328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:46:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-473bf203-91eb-4927-baeb-4997742597ad tempest-VolumesListAdminTestJSON-247238328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:46:19 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-473bf203-91eb-4927-baeb-4997742597ad tempest-VolumesListAdminTestJSON-247238328 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:46:19 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-473bf203-91eb-4927-baeb-4997742597ad tempest-VolumesListAdminTestJSON-247238328 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:46:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-473bf203-91eb-4927-baeb-4997742597ad tempest-VolumesListAdminTestJSON-247238328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dfc7565c-7084-4526-8d6f-07ee7c26b398 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:19 devstack sudo[86546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dfc7565c-7084-4526-8d6f-07ee7c26b398 1073741824
Apr 09 12:46:19 devstack sudo[86546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:19 devstack sudo[86541]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-83629e22-d0e5-4102-8496-9965b17aa02a tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa.3f7b5dd2-ef8b-46aa-8b15-58a63b572aad" returned: 0 in 0.790s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:19 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-83629e22-d0e5-4102-8496-9965b17aa02a tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:46:19 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea177e6f-c2ea-4e5d-b90b-09d5b83a94e2]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:46:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-83629e22-d0e5-4102-8496-9965b17aa02a tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:20 devstack sudo[86548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa
Apr 09 12:46:20 devstack sudo[86548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:20 devstack sudo[86546]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:20 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-473bf203-91eb-4927-baeb-4997742597ad tempest-VolumesListAdminTestJSON-247238328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dfc7565c-7084-4526-8d6f-07ee7c26b398 1073741824" returned: 0 in 0.716s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:20 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-473bf203-91eb-4927-baeb-4997742597ad tempest-VolumesListAdminTestJSON-247238328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dfc7565c-7084-4526-8d6f-07ee7c26b398 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:20 devstack sudo[86556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dfc7565c-7084-4526-8d6f-07ee7c26b398
Apr 09 12:46:20 devstack sudo[86556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:20 devstack sudo[86548]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:20 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-83629e22-d0e5-4102-8496-9965b17aa02a tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa" returned: 0 in 0.804s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:20 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-83629e22-d0e5-4102-8496-9965b17aa02a tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa.3f7b5dd2-ef8b-46aa-8b15-58a63b572aad {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:20 devstack sudo[86558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa.3f7b5dd2-ef8b-46aa-8b15-58a63b572aad
Apr 09 12:46:20 devstack sudo[86558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:21 devstack sudo[86556]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:21 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-473bf203-91eb-4927-baeb-4997742597ad tempest-VolumesListAdminTestJSON-247238328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dfc7565c-7084-4526-8d6f-07ee7c26b398" returned: 0 in 0.603s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:21 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-473bf203-91eb-4927-baeb-4997742597ad tempest-VolumesListAdminTestJSON-247238328 None] <== create_volume: return (1396ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:46:21 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-473bf203-91eb-4927-baeb-4997742597ad tempest-VolumesListAdminTestJSON-247238328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.399s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:46:21 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-473bf203-91eb-4927-baeb-4997742597ad tempest-VolumesListAdminTestJSON-247238328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e7e23a9-0f19-4888-841a-4adfcfb150bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfc7565c-7084-4526-8d6f-07ee7c26b398', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:21 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-473bf203-91eb-4927-baeb-4997742597ad tempest-VolumesListAdminTestJSON-247238328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (386d7168-d65d-491d-aa48-4ebeffee1c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:21 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-473bf203-91eb-4927-baeb-4997742597ad tempest-VolumesListAdminTestJSON-247238328 None] Volume volume-dfc7565c-7084-4526-8d6f-07ee7c26b398 (dfc7565c-7084-4526-8d6f-07ee7c26b398): created successfully
Apr 09 12:46:21 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-473bf203-91eb-4927-baeb-4997742597ad tempest-VolumesListAdminTestJSON-247238328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (386d7168-d65d-491d-aa48-4ebeffee1c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:21 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-473bf203-91eb-4927-baeb-4997742597ad tempest-VolumesListAdminTestJSON-247238328 None] Flow 'volume_create_manager' (ff01063f-190c-4311-8f35-6a88b4567d7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:46:21 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-473bf203-91eb-4927-baeb-4997742597ad tempest-VolumesListAdminTestJSON-247238328 None] Created volume successfully.
Apr 09 12:46:21 devstack sudo[86558]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:21 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-83629e22-d0e5-4102-8496-9965b17aa02a tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa.3f7b5dd2-ef8b-46aa-8b15-58a63b572aad" returned: 0 in 0.613s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:21 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-83629e22-d0e5-4102-8496-9965b17aa02a tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa.3f7b5dd2-ef8b-46aa-8b15-58a63b572aad {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:21 devstack sudo[86578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa.3f7b5dd2-ef8b-46aa-8b15-58a63b572aad
Apr 09 12:46:21 devstack sudo[86578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:21 devstack sudo[86578]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:21 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-83629e22-d0e5-4102-8496-9965b17aa02a tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa.3f7b5dd2-ef8b-46aa-8b15-58a63b572aad" returned: 0 in 0.482s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:21 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-83629e22-d0e5-4102-8496-9965b17aa02a tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Lock "cinder-quobyte-3f7b5dd2-ef8b-46aa-8b15-58a63b572aad" released by "_delete_snapshot" :: held 2.777s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:46:21 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-83629e22-d0e5-4102-8496-9965b17aa02a tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Lock "cinder-quobyte-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa" released by "delete_snapshot" :: held 2.807s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:46:21 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-83629e22-d0e5-4102-8496-9965b17aa02a tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Created reservations ['c1fac259-3648-4802-88f1-7a95b2332e87', '148565b1-c1db-4217-bfad-8e427a79f953', 'cdac756f-bab0-4f59-9829-f4c5cba649b1', '178c49e3-f7c3-4646-987a-64658dd959aa'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:46:21 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-83629e22-d0e5-4102-8496-9965b17aa02a tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Delete snapshot completed successfully.
Apr 09 12:46:21 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-83629e22-d0e5-4102-8496-9965b17aa02a tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Lock "cinder-3f7b5dd2-ef8b-46aa-8b15-58a63b572aad-delete_snapshot" released by "delete_snapshot" :: held 2.945s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:46:22 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-b248d894-1975-440e-a6c6-24a926725a67 tempest-VolumesListAdminTestJSON-247238328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:46:22 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b248d894-1975-440e-a6c6-24a926725a67 tempest-VolumesListAdminTestJSON-247238328 None] Flow 'volume_create_manager' (d21be33a-8373-41fa-beae-f050214e83e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:46:22 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b248d894-1975-440e-a6c6-24a926725a67 tempest-VolumesListAdminTestJSON-247238328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecf6b1a6-b46f-4740-b91d-4c7e0e5b4ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:22 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b248d894-1975-440e-a6c6-24a926725a67 tempest-VolumesListAdminTestJSON-247238328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecf6b1a6-b46f-4740-b91d-4c7e0e5b4ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-791784058',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=164118fe-279c-4d56-af9d-21688cab6b64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fb59ea4d38e45afa5d9acb7bf02666b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:46:22Z,use_quota=True,user_id='7b626fde63b34c76aad1f41d361394fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:22 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b248d894-1975-440e-a6c6-24a926725a67 tempest-VolumesListAdminTestJSON-247238328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a68d41f6-82e7-4cd8-ac63-6ae3c0eaea97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:22 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b248d894-1975-440e-a6c6-24a926725a67 tempest-VolumesListAdminTestJSON-247238328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a68d41f6-82e7-4cd8-ac63-6ae3c0eaea97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:22 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b248d894-1975-440e-a6c6-24a926725a67 tempest-VolumesListAdminTestJSON-247238328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68ff2315-0224-4e10-8d5d-c5f39778a8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:22 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b248d894-1975-440e-a6c6-24a926725a67 tempest-VolumesListAdminTestJSON-247238328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68ff2315-0224-4e10-8d5d-c5f39778a8f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '164118fe-279c-4d56-af9d-21688cab6b64', 'volume_name': 'volume-164118fe-279c-4d56-af9d-21688cab6b64', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:22 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b248d894-1975-440e-a6c6-24a926725a67 tempest-VolumesListAdminTestJSON-247238328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eadfa60c-9398-4e79-9a25-1e98025b586d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:22 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b248d894-1975-440e-a6c6-24a926725a67 tempest-VolumesListAdminTestJSON-247238328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eadfa60c-9398-4e79-9a25-1e98025b586d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:22 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b248d894-1975-440e-a6c6-24a926725a67 tempest-VolumesListAdminTestJSON-247238328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe8ff949-de4f-4302-85b6-b1b17bea9ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:22 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-b248d894-1975-440e-a6c6-24a926725a67 tempest-VolumesListAdminTestJSON-247238328 None] Volume 164118fe-279c-4d56-af9d-21688cab6b64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-164118fe-279c-4d56-af9d-21688cab6b64', 'volume_size': 1}
Apr 09 12:46:22 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b248d894-1975-440e-a6c6-24a926725a67 tempest-VolumesListAdminTestJSON-247238328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:46:22 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b248d894-1975-440e-a6c6-24a926725a67 tempest-VolumesListAdminTestJSON-247238328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:46:22 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-b248d894-1975-440e-a6c6-24a926725a67 tempest-VolumesListAdminTestJSON-247238328 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-791784058',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=164118fe-279c-4d56-af9d-21688cab6b64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fb59ea4d38e45afa5d9acb7bf02666b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:46:22Z,use_quota=True,user_id='7b626fde63b34c76aad1f41d361394fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:46:22 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-b248d894-1975-440e-a6c6-24a926725a67 tempest-VolumesListAdminTestJSON-247238328 None] Creating volume 164118fe-279c-4d56-af9d-21688cab6b64 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:46:22 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b248d894-1975-440e-a6c6-24a926725a67 tempest-VolumesListAdminTestJSON-247238328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:46:22 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b248d894-1975-440e-a6c6-24a926725a67 tempest-VolumesListAdminTestJSON-247238328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:46:22 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-b248d894-1975-440e-a6c6-24a926725a67 tempest-VolumesListAdminTestJSON-247238328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:46:22 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-b248d894-1975-440e-a6c6-24a926725a67 tempest-VolumesListAdminTestJSON-247238328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:46:22 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b248d894-1975-440e-a6c6-24a926725a67 tempest-VolumesListAdminTestJSON-247238328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:46:22 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-b248d894-1975-440e-a6c6-24a926725a67 tempest-VolumesListAdminTestJSON-247238328 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:46:22 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-b248d894-1975-440e-a6c6-24a926725a67 tempest-VolumesListAdminTestJSON-247238328 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:46:22 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b248d894-1975-440e-a6c6-24a926725a67 tempest-VolumesListAdminTestJSON-247238328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-164118fe-279c-4d56-af9d-21688cab6b64 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:22 devstack sudo[86586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-164118fe-279c-4d56-af9d-21688cab6b64 1073741824
Apr 09 12:46:22 devstack sudo[86586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:22 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-81f3d40c-8eef-4f36-b63c-ecb29cc62ce4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Acquiring lock "cinder-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:46:22 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-81f3d40c-8eef-4f36-b63c-ecb29cc62ce4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Lock "cinder-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:46:22 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-81f3d40c-8eef-4f36-b63c-ecb29cc62ce4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Acquiring lock "cinder-quobyte-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:46:22 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-81f3d40c-8eef-4f36-b63c-ecb29cc62ce4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Lock "cinder-quobyte-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa" acquired by "delete_volume" :: waited 0.007s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:46:22 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58604ac-ec29-41cb-9e13-9560ebb614aa]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:46:22 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-81f3d40c-8eef-4f36-b63c-ecb29cc62ce4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:22 devstack sudo[86589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa
Apr 09 12:46:22 devstack sudo[86589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:22 devstack sudo[86586]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:22 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b248d894-1975-440e-a6c6-24a926725a67 tempest-VolumesListAdminTestJSON-247238328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-164118fe-279c-4d56-af9d-21688cab6b64 1073741824" returned: 0 in 0.669s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b248d894-1975-440e-a6c6-24a926725a67 tempest-VolumesListAdminTestJSON-247238328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-164118fe-279c-4d56-af9d-21688cab6b64 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:23 devstack sudo[86603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-164118fe-279c-4d56-af9d-21688cab6b64
Apr 09 12:46:23 devstack sudo[86603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:23 devstack sudo[86589]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-81f3d40c-8eef-4f36-b63c-ecb29cc62ce4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa" returned: 0 in 0.657s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-81f3d40c-8eef-4f36-b63c-ecb29cc62ce4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:23 devstack sudo[86605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa
Apr 09 12:46:23 devstack sudo[86605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:23 devstack sudo[86603]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b248d894-1975-440e-a6c6-24a926725a67 tempest-VolumesListAdminTestJSON-247238328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-164118fe-279c-4d56-af9d-21688cab6b64" returned: 0 in 0.496s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:23 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-b248d894-1975-440e-a6c6-24a926725a67 tempest-VolumesListAdminTestJSON-247238328 None] <== create_volume: return (1220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:46:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b248d894-1975-440e-a6c6-24a926725a67 tempest-VolumesListAdminTestJSON-247238328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.222s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:46:23 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b248d894-1975-440e-a6c6-24a926725a67 tempest-VolumesListAdminTestJSON-247238328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe8ff949-de4f-4302-85b6-b1b17bea9ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-164118fe-279c-4d56-af9d-21688cab6b64', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:23 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b248d894-1975-440e-a6c6-24a926725a67 tempest-VolumesListAdminTestJSON-247238328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f54fc9db-bc4e-4ebc-b29e-2f67b241a395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:23 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-b248d894-1975-440e-a6c6-24a926725a67 tempest-VolumesListAdminTestJSON-247238328 None] Volume volume-164118fe-279c-4d56-af9d-21688cab6b64 (164118fe-279c-4d56-af9d-21688cab6b64): created successfully
Apr 09 12:46:23 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b248d894-1975-440e-a6c6-24a926725a67 tempest-VolumesListAdminTestJSON-247238328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f54fc9db-bc4e-4ebc-b29e-2f67b241a395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:23 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b248d894-1975-440e-a6c6-24a926725a67 tempest-VolumesListAdminTestJSON-247238328 None] Flow 'volume_create_manager' (d21be33a-8373-41fa-beae-f050214e83e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:46:23 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-b248d894-1975-440e-a6c6-24a926725a67 tempest-VolumesListAdminTestJSON-247238328 None] Created volume successfully.
Apr 09 12:46:23 devstack sudo[86605]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-81f3d40c-8eef-4f36-b63c-ecb29cc62ce4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa" returned: 0 in 0.539s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:23 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-81f3d40c-8eef-4f36-b63c-ecb29cc62ce4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Lock "cinder-quobyte-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa" released by "delete_volume" :: held 1.234s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:46:23 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-81f3d40c-8eef-4f36-b63c-ecb29cc62ce4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Created reservations ['5ac4d5a3-7ee0-4879-832e-01ddb4f255be', 'fb9ed855-e49f-4904-851d-855985f477c8', '810a232b-51b4-48af-a59f-604e04438ada', '69857d1b-5e81-4d2f-864c-a8d1d7f37268'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:46:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-81f3d40c-8eef-4f36-b63c-ecb29cc62ce4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:46:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-81f3d40c-8eef-4f36-b63c-ecb29cc62ce4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:46:23 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-81f3d40c-8eef-4f36-b63c-ecb29cc62ce4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:46:23 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-81f3d40c-8eef-4f36-b63c-ecb29cc62ce4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:46:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-81f3d40c-8eef-4f36-b63c-ecb29cc62ce4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:46:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-81f3d40c-8eef-4f36-b63c-ecb29cc62ce4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:23 devstack sudo[86609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:46:23 devstack sudo[86609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:24 devstack sudo[86609]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-81f3d40c-8eef-4f36-b63c-ecb29cc62ce4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.548s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:24 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-81f3d40c-8eef-4f36-b63c-ecb29cc62ce4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:46:24 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-81f3d40c-8eef-4f36-b63c-ecb29cc62ce4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Deleted volume successfully.
Apr 09 12:46:24 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-81f3d40c-8eef-4f36-b63c-ecb29cc62ce4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1091923381 None] Lock "cinder-9a1e5fc0-1e59-4896-981e-4cbb5f7a2dfa-delete_volume" released by "delete_volume" :: held 1.947s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:46:24 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-f40060f6-de03-4a9a-8359-ae8b3748eb45 tempest-VolumesListAdminTestJSON-247238328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:46:24 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f40060f6-de03-4a9a-8359-ae8b3748eb45 tempest-VolumesListAdminTestJSON-247238328 None] Flow 'volume_create_manager' (3bc868a9-f3c6-417f-b140-c8a1260d3dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:46:24 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f40060f6-de03-4a9a-8359-ae8b3748eb45 tempest-VolumesListAdminTestJSON-247238328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (154d8641-7685-45d8-8074-f19d1c9bd3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:24 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f40060f6-de03-4a9a-8359-ae8b3748eb45 tempest-VolumesListAdminTestJSON-247238328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (154d8641-7685-45d8-8074-f19d1c9bd3c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:46:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1744438508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=585196e1-a389-480e-b484-4116633de872,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fb59ea4d38e45afa5d9acb7bf02666b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:46:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:46:25Z,use_quota=True,user_id='7b626fde63b34c76aad1f41d361394fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:24 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f40060f6-de03-4a9a-8359-ae8b3748eb45 tempest-VolumesListAdminTestJSON-247238328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2b0db22-863d-4a9c-9f46-8afff0190a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:24 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f40060f6-de03-4a9a-8359-ae8b3748eb45 tempest-VolumesListAdminTestJSON-247238328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2b0db22-863d-4a9c-9f46-8afff0190a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:24 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f40060f6-de03-4a9a-8359-ae8b3748eb45 tempest-VolumesListAdminTestJSON-247238328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6201f588-3408-49ac-9172-b4e98b6f67df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:24 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f40060f6-de03-4a9a-8359-ae8b3748eb45 tempest-VolumesListAdminTestJSON-247238328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6201f588-3408-49ac-9172-b4e98b6f67df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '585196e1-a389-480e-b484-4116633de872', 'volume_name': 'volume-585196e1-a389-480e-b484-4116633de872', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:24 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f40060f6-de03-4a9a-8359-ae8b3748eb45 tempest-VolumesListAdminTestJSON-247238328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da296781-5844-4d04-a3fb-77e0b9624c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:24 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f40060f6-de03-4a9a-8359-ae8b3748eb45 tempest-VolumesListAdminTestJSON-247238328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da296781-5844-4d04-a3fb-77e0b9624c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:24 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f40060f6-de03-4a9a-8359-ae8b3748eb45 tempest-VolumesListAdminTestJSON-247238328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd7153f6-566b-496a-9638-8199959fb8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:24 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-f40060f6-de03-4a9a-8359-ae8b3748eb45 tempest-VolumesListAdminTestJSON-247238328 None] Volume 585196e1-a389-480e-b484-4116633de872: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-585196e1-a389-480e-b484-4116633de872', 'volume_size': 1}
Apr 09 12:46:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f40060f6-de03-4a9a-8359-ae8b3748eb45 tempest-VolumesListAdminTestJSON-247238328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:46:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f40060f6-de03-4a9a-8359-ae8b3748eb45 tempest-VolumesListAdminTestJSON-247238328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:46:24 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f40060f6-de03-4a9a-8359-ae8b3748eb45 tempest-VolumesListAdminTestJSON-247238328 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:46:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1744438508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=585196e1-a389-480e-b484-4116633de872,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fb59ea4d38e45afa5d9acb7bf02666b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:46:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:46:25Z,use_quota=True,user_id='7b626fde63b34c76aad1f41d361394fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:46:24 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-f40060f6-de03-4a9a-8359-ae8b3748eb45 tempest-VolumesListAdminTestJSON-247238328 None] Creating volume 585196e1-a389-480e-b484-4116633de872 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:46:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f40060f6-de03-4a9a-8359-ae8b3748eb45 tempest-VolumesListAdminTestJSON-247238328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:46:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f40060f6-de03-4a9a-8359-ae8b3748eb45 tempest-VolumesListAdminTestJSON-247238328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:46:24 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f40060f6-de03-4a9a-8359-ae8b3748eb45 tempest-VolumesListAdminTestJSON-247238328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:46:24 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f40060f6-de03-4a9a-8359-ae8b3748eb45 tempest-VolumesListAdminTestJSON-247238328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:46:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f40060f6-de03-4a9a-8359-ae8b3748eb45 tempest-VolumesListAdminTestJSON-247238328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:46:24 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f40060f6-de03-4a9a-8359-ae8b3748eb45 tempest-VolumesListAdminTestJSON-247238328 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:46:24 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-f40060f6-de03-4a9a-8359-ae8b3748eb45 tempest-VolumesListAdminTestJSON-247238328 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:46:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f40060f6-de03-4a9a-8359-ae8b3748eb45 tempest-VolumesListAdminTestJSON-247238328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-585196e1-a389-480e-b484-4116633de872 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:24 devstack sudo[86615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-585196e1-a389-480e-b484-4116633de872 1073741824
Apr 09 12:46:24 devstack sudo[86615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:25 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1e28e09-7fdd-43da-b8bf-6901957fff5d tempest-VolumesServicesTestJSON-1182201487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:46:25 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f1e28e09-7fdd-43da-b8bf-6901957fff5d tempest-VolumesServicesTestJSON-1182201487 None] Flow 'volume_create_manager' (cc53ec72-2197-4931-818c-b6d8cb2e8b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:46:25 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f1e28e09-7fdd-43da-b8bf-6901957fff5d tempest-VolumesServicesTestJSON-1182201487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5544e716-4d1e-4cd2-96fd-f49f906a44b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:25 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f1e28e09-7fdd-43da-b8bf-6901957fff5d tempest-VolumesServicesTestJSON-1182201487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5544e716-4d1e-4cd2-96fd-f49f906a44b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:46:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-145283262',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=202542e6-09d2-4e15-a8ba-81be5d558f3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63b97d8383244bf7a532bde3770b5b84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:46:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:46:25Z,use_quota=True,user_id='25fc1efc164147efa6da745e55f0167e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:25 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f1e28e09-7fdd-43da-b8bf-6901957fff5d tempest-VolumesServicesTestJSON-1182201487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5ef9431-556a-4d97-b0e7-788047965ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:25 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f1e28e09-7fdd-43da-b8bf-6901957fff5d tempest-VolumesServicesTestJSON-1182201487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5ef9431-556a-4d97-b0e7-788047965ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:25 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f1e28e09-7fdd-43da-b8bf-6901957fff5d tempest-VolumesServicesTestJSON-1182201487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01b08922-4100-4c76-a1b8-d575138df9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:25 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f1e28e09-7fdd-43da-b8bf-6901957fff5d tempest-VolumesServicesTestJSON-1182201487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01b08922-4100-4c76-a1b8-d575138df9b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '202542e6-09d2-4e15-a8ba-81be5d558f3d', 'volume_name': 'volume-202542e6-09d2-4e15-a8ba-81be5d558f3d', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:25 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f1e28e09-7fdd-43da-b8bf-6901957fff5d tempest-VolumesServicesTestJSON-1182201487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb8d1105-2313-42cd-87c7-7df68c54bc82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:25 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f1e28e09-7fdd-43da-b8bf-6901957fff5d tempest-VolumesServicesTestJSON-1182201487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb8d1105-2313-42cd-87c7-7df68c54bc82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:25 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f1e28e09-7fdd-43da-b8bf-6901957fff5d tempest-VolumesServicesTestJSON-1182201487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18610056-4ac9-4a0a-99fc-02739f9ba908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:25 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-f1e28e09-7fdd-43da-b8bf-6901957fff5d tempest-VolumesServicesTestJSON-1182201487 None] Volume 202542e6-09d2-4e15-a8ba-81be5d558f3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-202542e6-09d2-4e15-a8ba-81be5d558f3d', 'volume_size': 1}
Apr 09 12:46:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f1e28e09-7fdd-43da-b8bf-6901957fff5d tempest-VolumesServicesTestJSON-1182201487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:46:25 devstack sudo[86615]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f40060f6-de03-4a9a-8359-ae8b3748eb45 tempest-VolumesListAdminTestJSON-247238328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-585196e1-a389-480e-b484-4116633de872 1073741824" returned: 0 in 0.575s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f40060f6-de03-4a9a-8359-ae8b3748eb45 tempest-VolumesListAdminTestJSON-247238328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-585196e1-a389-480e-b484-4116633de872 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:25 devstack sudo[86620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-585196e1-a389-480e-b484-4116633de872
Apr 09 12:46:25 devstack sudo[86620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:25 devstack sudo[86620]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f40060f6-de03-4a9a-8359-ae8b3748eb45 tempest-VolumesListAdminTestJSON-247238328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-585196e1-a389-480e-b484-4116633de872" returned: 0 in 0.539s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:25 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f40060f6-de03-4a9a-8359-ae8b3748eb45 tempest-VolumesListAdminTestJSON-247238328 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:46:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f40060f6-de03-4a9a-8359-ae8b3748eb45 tempest-VolumesListAdminTestJSON-247238328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:46:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f1e28e09-7fdd-43da-b8bf-6901957fff5d tempest-VolumesServicesTestJSON-1182201487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.751s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:46:25 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f1e28e09-7fdd-43da-b8bf-6901957fff5d tempest-VolumesServicesTestJSON-1182201487 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:46:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-145283262',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=202542e6-09d2-4e15-a8ba-81be5d558f3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63b97d8383244bf7a532bde3770b5b84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:46:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:46:25Z,use_quota=True,user_id='25fc1efc164147efa6da745e55f0167e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:46:25 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-f1e28e09-7fdd-43da-b8bf-6901957fff5d tempest-VolumesServicesTestJSON-1182201487 None] Creating volume 202542e6-09d2-4e15-a8ba-81be5d558f3d {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:46:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f1e28e09-7fdd-43da-b8bf-6901957fff5d tempest-VolumesServicesTestJSON-1182201487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:46:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f1e28e09-7fdd-43da-b8bf-6901957fff5d tempest-VolumesServicesTestJSON-1182201487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:46:25 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f1e28e09-7fdd-43da-b8bf-6901957fff5d tempest-VolumesServicesTestJSON-1182201487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:46:25 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f1e28e09-7fdd-43da-b8bf-6901957fff5d tempest-VolumesServicesTestJSON-1182201487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:46:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f1e28e09-7fdd-43da-b8bf-6901957fff5d tempest-VolumesServicesTestJSON-1182201487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:46:25 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f1e28e09-7fdd-43da-b8bf-6901957fff5d tempest-VolumesServicesTestJSON-1182201487 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:46:25 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-f1e28e09-7fdd-43da-b8bf-6901957fff5d tempest-VolumesServicesTestJSON-1182201487 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:46:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f1e28e09-7fdd-43da-b8bf-6901957fff5d tempest-VolumesServicesTestJSON-1182201487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-202542e6-09d2-4e15-a8ba-81be5d558f3d 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:25 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f40060f6-de03-4a9a-8359-ae8b3748eb45 tempest-VolumesListAdminTestJSON-247238328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd7153f6-566b-496a-9638-8199959fb8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-585196e1-a389-480e-b484-4116633de872', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:25 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f40060f6-de03-4a9a-8359-ae8b3748eb45 tempest-VolumesListAdminTestJSON-247238328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f0882a7-c569-4591-8c33-21a53dafcec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:25 devstack sudo[86648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-202542e6-09d2-4e15-a8ba-81be5d558f3d 1073741824
Apr 09 12:46:25 devstack sudo[86648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:25 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-f40060f6-de03-4a9a-8359-ae8b3748eb45 tempest-VolumesListAdminTestJSON-247238328 None] Volume volume-585196e1-a389-480e-b484-4116633de872 (585196e1-a389-480e-b484-4116633de872): created successfully
Apr 09 12:46:25 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f40060f6-de03-4a9a-8359-ae8b3748eb45 tempest-VolumesListAdminTestJSON-247238328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f0882a7-c569-4591-8c33-21a53dafcec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:25 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f40060f6-de03-4a9a-8359-ae8b3748eb45 tempest-VolumesListAdminTestJSON-247238328 None] Flow 'volume_create_manager' (3bc868a9-f3c6-417f-b140-c8a1260d3dfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:46:26 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-f40060f6-de03-4a9a-8359-ae8b3748eb45 tempest-VolumesListAdminTestJSON-247238328 None] Created volume successfully.
Apr 09 12:46:26 devstack sudo[86648]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f1e28e09-7fdd-43da-b8bf-6901957fff5d tempest-VolumesServicesTestJSON-1182201487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-202542e6-09d2-4e15-a8ba-81be5d558f3d 1073741824" returned: 0 in 0.823s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f1e28e09-7fdd-43da-b8bf-6901957fff5d tempest-VolumesServicesTestJSON-1182201487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-202542e6-09d2-4e15-a8ba-81be5d558f3d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:26 devstack sudo[86657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-202542e6-09d2-4e15-a8ba-81be5d558f3d
Apr 09 12:46:26 devstack sudo[86657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:27 devstack sudo[86657]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f1e28e09-7fdd-43da-b8bf-6901957fff5d tempest-VolumesServicesTestJSON-1182201487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-202542e6-09d2-4e15-a8ba-81be5d558f3d" returned: 0 in 0.833s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:27 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f1e28e09-7fdd-43da-b8bf-6901957fff5d tempest-VolumesServicesTestJSON-1182201487 None] <== create_volume: return (1691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:46:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f1e28e09-7fdd-43da-b8bf-6901957fff5d tempest-VolumesServicesTestJSON-1182201487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.694s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:46:27 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-20d348ab-8745-45d7-a21b-93e0344e3e02 tempest-VolumesListAdminTestJSON-684482113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:46:27 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-20d348ab-8745-45d7-a21b-93e0344e3e02 tempest-VolumesListAdminTestJSON-684482113 None] Flow 'volume_create_manager' (033ac655-90c0-4add-880f-34d3a8e2b682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:46:27 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-20d348ab-8745-45d7-a21b-93e0344e3e02 tempest-VolumesListAdminTestJSON-684482113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f79eaaa1-c7f9-4e5e-927d-64e6960a06cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:27 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f1e28e09-7fdd-43da-b8bf-6901957fff5d tempest-VolumesServicesTestJSON-1182201487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18610056-4ac9-4a0a-99fc-02739f9ba908) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-202542e6-09d2-4e15-a8ba-81be5d558f3d', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:27 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f1e28e09-7fdd-43da-b8bf-6901957fff5d tempest-VolumesServicesTestJSON-1182201487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6145df8e-f4f0-4f88-a334-ec2bb1611efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:27 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-20d348ab-8745-45d7-a21b-93e0344e3e02 tempest-VolumesListAdminTestJSON-684482113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f79eaaa1-c7f9-4e5e-927d-64e6960a06cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:46:27Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea018214-350d-44f0-a0ee-6b5c6b95f05e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d30dc370cbff4f17b646dbedfe833f40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:46:28Z,use_quota=True,user_id='841d1a1ae6e94d449b9ebf6c1f2bbcb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:27 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-20d348ab-8745-45d7-a21b-93e0344e3e02 tempest-VolumesListAdminTestJSON-684482113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f110c7a-5c4d-44a7-b9d1-a96a7664b95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:27 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-20d348ab-8745-45d7-a21b-93e0344e3e02 tempest-VolumesListAdminTestJSON-684482113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f110c7a-5c4d-44a7-b9d1-a96a7664b95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:27 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-20d348ab-8745-45d7-a21b-93e0344e3e02 tempest-VolumesListAdminTestJSON-684482113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0d9e3d4-99a6-41e0-855f-d83c1d7bc230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:27 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-20d348ab-8745-45d7-a21b-93e0344e3e02 tempest-VolumesListAdminTestJSON-684482113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0d9e3d4-99a6-41e0-855f-d83c1d7bc230) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea018214-350d-44f0-a0ee-6b5c6b95f05e', 'volume_name': 'volume-ea018214-350d-44f0-a0ee-6b5c6b95f05e', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:27 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-20d348ab-8745-45d7-a21b-93e0344e3e02 tempest-VolumesListAdminTestJSON-684482113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b708802-edf7-4ff6-9238-75a6dcc2e067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:27 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-20d348ab-8745-45d7-a21b-93e0344e3e02 tempest-VolumesListAdminTestJSON-684482113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b708802-edf7-4ff6-9238-75a6dcc2e067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:27 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-20d348ab-8745-45d7-a21b-93e0344e3e02 tempest-VolumesListAdminTestJSON-684482113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (096d32cb-b6ef-4645-921c-f361992e87d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:27 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-20d348ab-8745-45d7-a21b-93e0344e3e02 tempest-VolumesListAdminTestJSON-684482113 None] Volume ea018214-350d-44f0-a0ee-6b5c6b95f05e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea018214-350d-44f0-a0ee-6b5c6b95f05e', 'volume_size': 1}
Apr 09 12:46:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-20d348ab-8745-45d7-a21b-93e0344e3e02 tempest-VolumesListAdminTestJSON-684482113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:46:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-20d348ab-8745-45d7-a21b-93e0344e3e02 tempest-VolumesListAdminTestJSON-684482113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:46:27 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-20d348ab-8745-45d7-a21b-93e0344e3e02 tempest-VolumesListAdminTestJSON-684482113 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:46:27Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea018214-350d-44f0-a0ee-6b5c6b95f05e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d30dc370cbff4f17b646dbedfe833f40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:46:28Z,use_quota=True,user_id='841d1a1ae6e94d449b9ebf6c1f2bbcb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:46:27 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-20d348ab-8745-45d7-a21b-93e0344e3e02 tempest-VolumesListAdminTestJSON-684482113 None] Creating volume ea018214-350d-44f0-a0ee-6b5c6b95f05e {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:46:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-20d348ab-8745-45d7-a21b-93e0344e3e02 tempest-VolumesListAdminTestJSON-684482113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:46:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-20d348ab-8745-45d7-a21b-93e0344e3e02 tempest-VolumesListAdminTestJSON-684482113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:46:27 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-20d348ab-8745-45d7-a21b-93e0344e3e02 tempest-VolumesListAdminTestJSON-684482113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:46:27 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-20d348ab-8745-45d7-a21b-93e0344e3e02 tempest-VolumesListAdminTestJSON-684482113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:46:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-20d348ab-8745-45d7-a21b-93e0344e3e02 tempest-VolumesListAdminTestJSON-684482113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:46:27 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-20d348ab-8745-45d7-a21b-93e0344e3e02 tempest-VolumesListAdminTestJSON-684482113 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:46:27 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-20d348ab-8745-45d7-a21b-93e0344e3e02 tempest-VolumesListAdminTestJSON-684482113 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:46:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-20d348ab-8745-45d7-a21b-93e0344e3e02 tempest-VolumesListAdminTestJSON-684482113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea018214-350d-44f0-a0ee-6b5c6b95f05e 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:27 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-f1e28e09-7fdd-43da-b8bf-6901957fff5d tempest-VolumesServicesTestJSON-1182201487 None] Volume volume-202542e6-09d2-4e15-a8ba-81be5d558f3d (202542e6-09d2-4e15-a8ba-81be5d558f3d): created successfully
Apr 09 12:46:27 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f1e28e09-7fdd-43da-b8bf-6901957fff5d tempest-VolumesServicesTestJSON-1182201487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6145df8e-f4f0-4f88-a334-ec2bb1611efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:27 devstack sudo[86660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea018214-350d-44f0-a0ee-6b5c6b95f05e 1073741824
Apr 09 12:46:27 devstack sudo[86660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:27 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f1e28e09-7fdd-43da-b8bf-6901957fff5d tempest-VolumesServicesTestJSON-1182201487 None] Flow 'volume_create_manager' (cc53ec72-2197-4931-818c-b6d8cb2e8b71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:46:27 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-f1e28e09-7fdd-43da-b8bf-6901957fff5d tempest-VolumesServicesTestJSON-1182201487 None] Created volume successfully.
Apr 09 12:46:28 devstack sudo[86660]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:28 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-20d348ab-8745-45d7-a21b-93e0344e3e02 tempest-VolumesListAdminTestJSON-684482113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea018214-350d-44f0-a0ee-6b5c6b95f05e 1073741824" returned: 0 in 0.769s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:28 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-20d348ab-8745-45d7-a21b-93e0344e3e02 tempest-VolumesListAdminTestJSON-684482113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea018214-350d-44f0-a0ee-6b5c6b95f05e {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:28 devstack sudo[86666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea018214-350d-44f0-a0ee-6b5c6b95f05e
Apr 09 12:46:28 devstack sudo[86666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:28 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-c1e273b9-63fd-4049-9c88-985a8c6deca2 tempest-VolumesServicesTestJSON-1182201487 None] Acquiring lock "cinder-202542e6-09d2-4e15-a8ba-81be5d558f3d-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:46:28 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-c1e273b9-63fd-4049-9c88-985a8c6deca2 tempest-VolumesServicesTestJSON-1182201487 None] Lock "cinder-202542e6-09d2-4e15-a8ba-81be5d558f3d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:46:28 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-c1e273b9-63fd-4049-9c88-985a8c6deca2 tempest-VolumesServicesTestJSON-1182201487 None] Acquiring lock "cinder-quobyte-202542e6-09d2-4e15-a8ba-81be5d558f3d" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:46:28 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-c1e273b9-63fd-4049-9c88-985a8c6deca2 tempest-VolumesServicesTestJSON-1182201487 None] Lock "cinder-quobyte-202542e6-09d2-4e15-a8ba-81be5d558f3d" acquired by "delete_volume" :: waited 0.026s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:46:28 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e13684-ca3e-4a8c-be0b-bd9b488370a3]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:46:28 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c1e273b9-63fd-4049-9c88-985a8c6deca2 tempest-VolumesServicesTestJSON-1182201487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-202542e6-09d2-4e15-a8ba-81be5d558f3d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:28 devstack sudo[86668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-202542e6-09d2-4e15-a8ba-81be5d558f3d
Apr 09 12:46:28 devstack sudo[86668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:29 devstack sudo[86666]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:29 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-20d348ab-8745-45d7-a21b-93e0344e3e02 tempest-VolumesListAdminTestJSON-684482113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea018214-350d-44f0-a0ee-6b5c6b95f05e" returned: 0 in 0.813s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:29 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-20d348ab-8745-45d7-a21b-93e0344e3e02 tempest-VolumesListAdminTestJSON-684482113 None] <== create_volume: return (1644ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:46:29 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-20d348ab-8745-45d7-a21b-93e0344e3e02 tempest-VolumesListAdminTestJSON-684482113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.649s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:46:29 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-20d348ab-8745-45d7-a21b-93e0344e3e02 tempest-VolumesListAdminTestJSON-684482113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (096d32cb-b6ef-4645-921c-f361992e87d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea018214-350d-44f0-a0ee-6b5c6b95f05e', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:29 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-20d348ab-8745-45d7-a21b-93e0344e3e02 tempest-VolumesListAdminTestJSON-684482113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (254526f5-cc57-45fc-acca-54622635495b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:29 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-20d348ab-8745-45d7-a21b-93e0344e3e02 tempest-VolumesListAdminTestJSON-684482113 None] Volume volume-ea018214-350d-44f0-a0ee-6b5c6b95f05e (ea018214-350d-44f0-a0ee-6b5c6b95f05e): created successfully
Apr 09 12:46:29 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-20d348ab-8745-45d7-a21b-93e0344e3e02 tempest-VolumesListAdminTestJSON-684482113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (254526f5-cc57-45fc-acca-54622635495b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:29 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-20d348ab-8745-45d7-a21b-93e0344e3e02 tempest-VolumesListAdminTestJSON-684482113 None] Flow 'volume_create_manager' (033ac655-90c0-4add-880f-34d3a8e2b682) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:46:29 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-20d348ab-8745-45d7-a21b-93e0344e3e02 tempest-VolumesListAdminTestJSON-684482113 None] Created volume successfully.
Apr 09 12:46:29 devstack sudo[86668]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:29 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c1e273b9-63fd-4049-9c88-985a8c6deca2 tempest-VolumesServicesTestJSON-1182201487 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-202542e6-09d2-4e15-a8ba-81be5d558f3d" returned: 0 in 0.906s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:29 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c1e273b9-63fd-4049-9c88-985a8c6deca2 tempest-VolumesServicesTestJSON-1182201487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-202542e6-09d2-4e15-a8ba-81be5d558f3d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:29 devstack sudo[86678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-202542e6-09d2-4e15-a8ba-81be5d558f3d
Apr 09 12:46:29 devstack sudo[86678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:29 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-d6f373ac-85ce-49cc-bed4-7af5c6638096 tempest-VolumesListAdminTestJSON-684482113 None] Acquiring lock "cinder-ea018214-350d-44f0-a0ee-6b5c6b95f05e-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:46:30 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-d6f373ac-85ce-49cc-bed4-7af5c6638096 tempest-VolumesListAdminTestJSON-684482113 None] Lock "cinder-ea018214-350d-44f0-a0ee-6b5c6b95f05e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:46:30 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-d6f373ac-85ce-49cc-bed4-7af5c6638096 tempest-VolumesListAdminTestJSON-684482113 None] Acquiring lock "cinder-quobyte-ea018214-350d-44f0-a0ee-6b5c6b95f05e" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:46:30 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-d6f373ac-85ce-49cc-bed4-7af5c6638096 tempest-VolumesListAdminTestJSON-684482113 None] Lock "cinder-quobyte-ea018214-350d-44f0-a0ee-6b5c6b95f05e" acquired by "delete_volume" :: waited 0.032s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:46:30 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-07e3d664-1eff-47bf-ab8e-a44fcb112356 tempest-VolumesListAdminTestJSON-247238328 None] Acquiring lock "cinder-585196e1-a389-480e-b484-4116633de872-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:46:30 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9a74ec-4071-4b17-b6f3-198f848709e8]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:46:30 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d6f373ac-85ce-49cc-bed4-7af5c6638096 tempest-VolumesListAdminTestJSON-684482113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea018214-350d-44f0-a0ee-6b5c6b95f05e {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:30 devstack sudo[86678]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:30 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-07e3d664-1eff-47bf-ab8e-a44fcb112356 tempest-VolumesListAdminTestJSON-247238328 None] Lock "cinder-585196e1-a389-480e-b484-4116633de872-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:46:30 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c1e273b9-63fd-4049-9c88-985a8c6deca2 tempest-VolumesServicesTestJSON-1182201487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-202542e6-09d2-4e15-a8ba-81be5d558f3d" returned: 0 in 0.610s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:30 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-c1e273b9-63fd-4049-9c88-985a8c6deca2 tempest-VolumesServicesTestJSON-1182201487 None] Lock "cinder-quobyte-202542e6-09d2-4e15-a8ba-81be5d558f3d" released by "delete_volume" :: held 1.603s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:46:30 devstack sudo[86681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea018214-350d-44f0-a0ee-6b5c6b95f05e
Apr 09 12:46:30 devstack sudo[86681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:30 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-07e3d664-1eff-47bf-ab8e-a44fcb112356 tempest-VolumesListAdminTestJSON-247238328 None] Acquiring lock "cinder-quobyte-585196e1-a389-480e-b484-4116633de872" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:46:30 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-07e3d664-1eff-47bf-ab8e-a44fcb112356 tempest-VolumesListAdminTestJSON-247238328 None] Lock "cinder-quobyte-585196e1-a389-480e-b484-4116633de872" acquired by "delete_volume" :: waited 0.021s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:46:30 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18620e5-4d29-4049-988e-fd75497bdf09]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:46:30 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-07e3d664-1eff-47bf-ab8e-a44fcb112356 tempest-VolumesListAdminTestJSON-247238328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-585196e1-a389-480e-b484-4116633de872 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:30 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-c1e273b9-63fd-4049-9c88-985a8c6deca2 tempest-VolumesServicesTestJSON-1182201487 None] Created reservations ['0cdaf8c7-2870-4f2e-8418-d40338a260aa', 'e64037ab-ae68-416a-88a9-3a6d812a8351', '68c066b2-b1f0-44df-b9f4-b529c6ff8394', 'ab41135a-b30a-4732-90ec-a0195b53a477'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:46:30 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c1e273b9-63fd-4049-9c88-985a8c6deca2 tempest-VolumesServicesTestJSON-1182201487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:46:30 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c1e273b9-63fd-4049-9c88-985a8c6deca2 tempest-VolumesServicesTestJSON-1182201487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:46:30 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-c1e273b9-63fd-4049-9c88-985a8c6deca2 tempest-VolumesServicesTestJSON-1182201487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:46:30 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-c1e273b9-63fd-4049-9c88-985a8c6deca2 tempest-VolumesServicesTestJSON-1182201487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:46:30 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c1e273b9-63fd-4049-9c88-985a8c6deca2 tempest-VolumesServicesTestJSON-1182201487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:46:30 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c1e273b9-63fd-4049-9c88-985a8c6deca2 tempest-VolumesServicesTestJSON-1182201487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:30 devstack sudo[86684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:46:30 devstack sudo[86684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:30 devstack sudo[86683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-585196e1-a389-480e-b484-4116633de872
Apr 09 12:46:30 devstack sudo[86683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:31 devstack sudo[86681]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:31 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d6f373ac-85ce-49cc-bed4-7af5c6638096 tempest-VolumesListAdminTestJSON-684482113 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea018214-350d-44f0-a0ee-6b5c6b95f05e" returned: 0 in 0.880s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:31 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d6f373ac-85ce-49cc-bed4-7af5c6638096 tempest-VolumesListAdminTestJSON-684482113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea018214-350d-44f0-a0ee-6b5c6b95f05e {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:31 devstack sudo[86691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea018214-350d-44f0-a0ee-6b5c6b95f05e
Apr 09 12:46:31 devstack sudo[86691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:31 devstack sudo[86684]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:31 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c1e273b9-63fd-4049-9c88-985a8c6deca2 tempest-VolumesServicesTestJSON-1182201487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.926s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:31 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-c1e273b9-63fd-4049-9c88-985a8c6deca2 tempest-VolumesServicesTestJSON-1182201487 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:46:31 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-c1e273b9-63fd-4049-9c88-985a8c6deca2 tempest-VolumesServicesTestJSON-1182201487 None] Deleted volume successfully.
Apr 09 12:46:31 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-c1e273b9-63fd-4049-9c88-985a8c6deca2 tempest-VolumesServicesTestJSON-1182201487 None] Lock "cinder-202542e6-09d2-4e15-a8ba-81be5d558f3d-delete_volume" released by "delete_volume" :: held 2.828s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:46:31 devstack sudo[86683]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:31 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-07e3d664-1eff-47bf-ab8e-a44fcb112356 tempest-VolumesListAdminTestJSON-247238328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-585196e1-a389-480e-b484-4116633de872" returned: 0 in 1.430s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:31 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-07e3d664-1eff-47bf-ab8e-a44fcb112356 tempest-VolumesListAdminTestJSON-247238328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-585196e1-a389-480e-b484-4116633de872 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:31 devstack sudo[86697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-585196e1-a389-480e-b484-4116633de872
Apr 09 12:46:31 devstack sudo[86697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:32 devstack sudo[86691]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d6f373ac-85ce-49cc-bed4-7af5c6638096 tempest-VolumesListAdminTestJSON-684482113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea018214-350d-44f0-a0ee-6b5c6b95f05e" returned: 0 in 1.006s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:32 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-d6f373ac-85ce-49cc-bed4-7af5c6638096 tempest-VolumesListAdminTestJSON-684482113 None] Lock "cinder-quobyte-ea018214-350d-44f0-a0ee-6b5c6b95f05e" released by "delete_volume" :: held 1.953s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:46:32 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-d6f373ac-85ce-49cc-bed4-7af5c6638096 tempest-VolumesListAdminTestJSON-684482113 None] Created reservations ['75899980-648a-4ee1-ac42-00be3a1901ae', '83d5c542-8255-4432-b0ed-9c8e89e37f5d', 'c7fe32c0-31bd-40f3-9c35-5488cda95587', '561dd800-9f6e-4d82-a993-f9ea12daa0ab'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:46:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d6f373ac-85ce-49cc-bed4-7af5c6638096 tempest-VolumesListAdminTestJSON-684482113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:46:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d6f373ac-85ce-49cc-bed4-7af5c6638096 tempest-VolumesListAdminTestJSON-684482113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:46:32 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-d6f373ac-85ce-49cc-bed4-7af5c6638096 tempest-VolumesListAdminTestJSON-684482113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:46:32 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-d6f373ac-85ce-49cc-bed4-7af5c6638096 tempest-VolumesListAdminTestJSON-684482113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:46:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d6f373ac-85ce-49cc-bed4-7af5c6638096 tempest-VolumesListAdminTestJSON-684482113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:46:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d6f373ac-85ce-49cc-bed4-7af5c6638096 tempest-VolumesListAdminTestJSON-684482113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:32 devstack sudo[86699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:46:32 devstack sudo[86699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:32 devstack sudo[86697]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-07e3d664-1eff-47bf-ab8e-a44fcb112356 tempest-VolumesListAdminTestJSON-247238328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-585196e1-a389-480e-b484-4116633de872" returned: 0 in 0.575s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:32 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-07e3d664-1eff-47bf-ab8e-a44fcb112356 tempest-VolumesListAdminTestJSON-247238328 None] Lock "cinder-quobyte-585196e1-a389-480e-b484-4116633de872" released by "delete_volume" :: held 2.039s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:46:32 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-07e3d664-1eff-47bf-ab8e-a44fcb112356 tempest-VolumesListAdminTestJSON-247238328 None] Created reservations ['2e154bfe-1468-4357-a0cd-3e16a388cb3b', 'a553840f-316c-4a24-a7bc-173527295984', '5088e8da-001a-4aaa-94fd-90c5efff26c1', 'ceb189b9-71d0-499b-8e00-cbde7eb730f5'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:46:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-07e3d664-1eff-47bf-ab8e-a44fcb112356 tempest-VolumesListAdminTestJSON-247238328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:46:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-07e3d664-1eff-47bf-ab8e-a44fcb112356 tempest-VolumesListAdminTestJSON-247238328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:46:32 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-07e3d664-1eff-47bf-ab8e-a44fcb112356 tempest-VolumesListAdminTestJSON-247238328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:46:32 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-07e3d664-1eff-47bf-ab8e-a44fcb112356 tempest-VolumesListAdminTestJSON-247238328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:46:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-07e3d664-1eff-47bf-ab8e-a44fcb112356 tempest-VolumesListAdminTestJSON-247238328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:46:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-07e3d664-1eff-47bf-ab8e-a44fcb112356 tempest-VolumesListAdminTestJSON-247238328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:32 devstack sudo[86703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:46:32 devstack sudo[86703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:33 devstack sudo[86703]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:33 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-07e3d664-1eff-47bf-ab8e-a44fcb112356 tempest-VolumesListAdminTestJSON-247238328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.693s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:33 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-07e3d664-1eff-47bf-ab8e-a44fcb112356 tempest-VolumesListAdminTestJSON-247238328 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:46:33 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-07e3d664-1eff-47bf-ab8e-a44fcb112356 tempest-VolumesListAdminTestJSON-247238328 None] Deleted volume successfully.
Apr 09 12:46:33 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-07e3d664-1eff-47bf-ab8e-a44fcb112356 tempest-VolumesListAdminTestJSON-247238328 None] Lock "cinder-585196e1-a389-480e-b484-4116633de872-delete_volume" released by "delete_volume" :: held 3.030s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:46:33 devstack sudo[86699]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:33 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d6f373ac-85ce-49cc-bed4-7af5c6638096 tempest-VolumesListAdminTestJSON-684482113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 1.140s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:33 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-d6f373ac-85ce-49cc-bed4-7af5c6638096 tempest-VolumesListAdminTestJSON-684482113 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:46:33 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-d6f373ac-85ce-49cc-bed4-7af5c6638096 tempest-VolumesListAdminTestJSON-684482113 None] Deleted volume successfully.
Apr 09 12:46:33 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-d6f373ac-85ce-49cc-bed4-7af5c6638096 tempest-VolumesListAdminTestJSON-684482113 None] Lock "cinder-ea018214-350d-44f0-a0ee-6b5c6b95f05e-delete_volume" released by "delete_volume" :: held 3.328s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:46:33 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ec3dbff2-c5a3-4d4c-929c-9e080b1dd4eb tempest-VolumesListAdminTestJSON-247238328 None] Acquiring lock "cinder-164118fe-279c-4d56-af9d-21688cab6b64-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:46:33 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ec3dbff2-c5a3-4d4c-929c-9e080b1dd4eb tempest-VolumesListAdminTestJSON-247238328 None] Lock "cinder-164118fe-279c-4d56-af9d-21688cab6b64-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:46:33 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ec3dbff2-c5a3-4d4c-929c-9e080b1dd4eb tempest-VolumesListAdminTestJSON-247238328 None] Acquiring lock "cinder-quobyte-164118fe-279c-4d56-af9d-21688cab6b64" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:46:33 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ec3dbff2-c5a3-4d4c-929c-9e080b1dd4eb tempest-VolumesListAdminTestJSON-247238328 None] Lock "cinder-quobyte-164118fe-279c-4d56-af9d-21688cab6b64" acquired by "delete_volume" :: waited 0.010s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:46:33 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7bbef31-a6c4-4401-81ae-000443c149a9]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:46:33 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ec3dbff2-c5a3-4d4c-929c-9e080b1dd4eb tempest-VolumesListAdminTestJSON-247238328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-164118fe-279c-4d56-af9d-21688cab6b64 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:33 devstack sudo[86707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-164118fe-279c-4d56-af9d-21688cab6b64
Apr 09 12:46:33 devstack sudo[86707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:34 devstack sudo[86707]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:34 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ec3dbff2-c5a3-4d4c-929c-9e080b1dd4eb tempest-VolumesListAdminTestJSON-247238328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-164118fe-279c-4d56-af9d-21688cab6b64" returned: 0 in 1.073s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:34 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ec3dbff2-c5a3-4d4c-929c-9e080b1dd4eb tempest-VolumesListAdminTestJSON-247238328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-164118fe-279c-4d56-af9d-21688cab6b64 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:34 devstack sudo[86712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-164118fe-279c-4d56-af9d-21688cab6b64
Apr 09 12:46:34 devstack sudo[86712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:35 devstack sudo[86712]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ec3dbff2-c5a3-4d4c-929c-9e080b1dd4eb tempest-VolumesListAdminTestJSON-247238328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-164118fe-279c-4d56-af9d-21688cab6b64" returned: 0 in 0.721s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:35 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ec3dbff2-c5a3-4d4c-929c-9e080b1dd4eb tempest-VolumesListAdminTestJSON-247238328 None] Lock "cinder-quobyte-164118fe-279c-4d56-af9d-21688cab6b64" released by "delete_volume" :: held 1.829s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:46:35 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-ec3dbff2-c5a3-4d4c-929c-9e080b1dd4eb tempest-VolumesListAdminTestJSON-247238328 None] Created reservations ['ce7ebbbb-aa41-439c-907c-52990fe5cc4d', 'cb970115-c27e-4869-990b-59649330e8df', 'ad108459-83a7-41db-abf6-87b9ba3c928f', '3280a63b-88a2-4a6b-91aa-f65e9d3ea134'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:46:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ec3dbff2-c5a3-4d4c-929c-9e080b1dd4eb tempest-VolumesListAdminTestJSON-247238328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:46:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ec3dbff2-c5a3-4d4c-929c-9e080b1dd4eb tempest-VolumesListAdminTestJSON-247238328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:46:35 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-ec3dbff2-c5a3-4d4c-929c-9e080b1dd4eb tempest-VolumesListAdminTestJSON-247238328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:46:35 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-ec3dbff2-c5a3-4d4c-929c-9e080b1dd4eb tempest-VolumesListAdminTestJSON-247238328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:46:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ec3dbff2-c5a3-4d4c-929c-9e080b1dd4eb tempest-VolumesListAdminTestJSON-247238328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:46:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ec3dbff2-c5a3-4d4c-929c-9e080b1dd4eb tempest-VolumesListAdminTestJSON-247238328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:35 devstack sudo[86725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:46:35 devstack sudo[86725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:36 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-600a7bd9-999e-4c24-8278-01e8dbb62e0d tempest-VolumesListAdminTestJSON-247238328 None] Acquiring lock "cinder-dfc7565c-7084-4526-8d6f-07ee7c26b398-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:46:36 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-600a7bd9-999e-4c24-8278-01e8dbb62e0d tempest-VolumesListAdminTestJSON-247238328 None] Lock "cinder-dfc7565c-7084-4526-8d6f-07ee7c26b398-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:46:36 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-600a7bd9-999e-4c24-8278-01e8dbb62e0d tempest-VolumesListAdminTestJSON-247238328 None] Acquiring lock "cinder-quobyte-dfc7565c-7084-4526-8d6f-07ee7c26b398" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:46:36 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-600a7bd9-999e-4c24-8278-01e8dbb62e0d tempest-VolumesListAdminTestJSON-247238328 None] Lock "cinder-quobyte-dfc7565c-7084-4526-8d6f-07ee7c26b398" acquired by "delete_volume" :: waited 0.017s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:46:36 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[f978a921-3849-4973-8645-47d33f49e7be]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:46:36 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-600a7bd9-999e-4c24-8278-01e8dbb62e0d tempest-VolumesListAdminTestJSON-247238328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dfc7565c-7084-4526-8d6f-07ee7c26b398 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:36 devstack sudo[86732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dfc7565c-7084-4526-8d6f-07ee7c26b398
Apr 09 12:46:36 devstack sudo[86732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:36 devstack sudo[86725]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:36 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ec3dbff2-c5a3-4d4c-929c-9e080b1dd4eb tempest-VolumesListAdminTestJSON-247238328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.927s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:36 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-ec3dbff2-c5a3-4d4c-929c-9e080b1dd4eb tempest-VolumesListAdminTestJSON-247238328 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:46:36 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-ec3dbff2-c5a3-4d4c-929c-9e080b1dd4eb tempest-VolumesListAdminTestJSON-247238328 None] Deleted volume successfully.
Apr 09 12:46:36 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ec3dbff2-c5a3-4d4c-929c-9e080b1dd4eb tempest-VolumesListAdminTestJSON-247238328 None] Lock "cinder-164118fe-279c-4d56-af9d-21688cab6b64-delete_volume" released by "delete_volume" :: held 3.074s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:46:37 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-329ee3cd-6fbf-4688-a27e-8597d93d017f tempest-VolumesCloneTest-717382768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:46:37 devstack sudo[86732]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:37 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-329ee3cd-6fbf-4688-a27e-8597d93d017f tempest-VolumesCloneTest-717382768 None] Flow 'volume_create_manager' (83b9506c-6b9f-4bab-ae48-2e5e19a47e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:46:37 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-329ee3cd-6fbf-4688-a27e-8597d93d017f tempest-VolumesCloneTest-717382768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f149565-9982-48de-b5ed-80d5af8bf9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:37 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-600a7bd9-999e-4c24-8278-01e8dbb62e0d tempest-VolumesListAdminTestJSON-247238328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dfc7565c-7084-4526-8d6f-07ee7c26b398" returned: 0 in 0.944s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:37 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-600a7bd9-999e-4c24-8278-01e8dbb62e0d tempest-VolumesListAdminTestJSON-247238328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dfc7565c-7084-4526-8d6f-07ee7c26b398 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:37 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-329ee3cd-6fbf-4688-a27e-8597d93d017f tempest-VolumesCloneTest-717382768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f149565-9982-48de-b5ed-80d5af8bf9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-959814439',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bce01497-1325-4ce9-a4f4-c9213b0b90a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f5af8bc3ce547a5bc04dc2530f5aa35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:46:37Z,use_quota=True,user_id='73a6b36b06e94dcc9dae35e41698668d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:37 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-329ee3cd-6fbf-4688-a27e-8597d93d017f tempest-VolumesCloneTest-717382768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8299d1f-12a0-4241-8314-0f55f08c082c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:37 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-329ee3cd-6fbf-4688-a27e-8597d93d017f tempest-VolumesCloneTest-717382768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8299d1f-12a0-4241-8314-0f55f08c082c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:37 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-329ee3cd-6fbf-4688-a27e-8597d93d017f tempest-VolumesCloneTest-717382768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e914db1-9728-4d83-acfa-66291800d436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:37 devstack sudo[86739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dfc7565c-7084-4526-8d6f-07ee7c26b398
Apr 09 12:46:37 devstack sudo[86739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:37 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-329ee3cd-6fbf-4688-a27e-8597d93d017f tempest-VolumesCloneTest-717382768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e914db1-9728-4d83-acfa-66291800d436) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bce01497-1325-4ce9-a4f4-c9213b0b90a1', 'volume_name': 'volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:37 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-329ee3cd-6fbf-4688-a27e-8597d93d017f tempest-VolumesCloneTest-717382768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (985bdf5a-c169-4d24-9abf-9c1eaf05b49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:37 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-329ee3cd-6fbf-4688-a27e-8597d93d017f tempest-VolumesCloneTest-717382768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (985bdf5a-c169-4d24-9abf-9c1eaf05b49a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:37 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-329ee3cd-6fbf-4688-a27e-8597d93d017f tempest-VolumesCloneTest-717382768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eff554a-c530-4ec6-ba33-81a870fe8f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:37 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-329ee3cd-6fbf-4688-a27e-8597d93d017f tempest-VolumesCloneTest-717382768 None] Volume bce01497-1325-4ce9-a4f4-c9213b0b90a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1', 'volume_size': 1}
Apr 09 12:46:37 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-329ee3cd-6fbf-4688-a27e-8597d93d017f tempest-VolumesCloneTest-717382768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:46:37 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-329ee3cd-6fbf-4688-a27e-8597d93d017f tempest-VolumesCloneTest-717382768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:46:37 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-329ee3cd-6fbf-4688-a27e-8597d93d017f tempest-VolumesCloneTest-717382768 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-959814439',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bce01497-1325-4ce9-a4f4-c9213b0b90a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f5af8bc3ce547a5bc04dc2530f5aa35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:46:37Z,use_quota=True,user_id='73a6b36b06e94dcc9dae35e41698668d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:46:37 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-329ee3cd-6fbf-4688-a27e-8597d93d017f tempest-VolumesCloneTest-717382768 None] Creating volume bce01497-1325-4ce9-a4f4-c9213b0b90a1 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:46:37 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-329ee3cd-6fbf-4688-a27e-8597d93d017f tempest-VolumesCloneTest-717382768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:46:37 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-329ee3cd-6fbf-4688-a27e-8597d93d017f tempest-VolumesCloneTest-717382768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:46:37 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-329ee3cd-6fbf-4688-a27e-8597d93d017f tempest-VolumesCloneTest-717382768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:46:37 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-329ee3cd-6fbf-4688-a27e-8597d93d017f tempest-VolumesCloneTest-717382768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:46:37 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-329ee3cd-6fbf-4688-a27e-8597d93d017f tempest-VolumesCloneTest-717382768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:46:37 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-329ee3cd-6fbf-4688-a27e-8597d93d017f tempest-VolumesCloneTest-717382768 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:46:37 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-329ee3cd-6fbf-4688-a27e-8597d93d017f tempest-VolumesCloneTest-717382768 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:46:37 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-329ee3cd-6fbf-4688-a27e-8597d93d017f tempest-VolumesCloneTest-717382768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:37 devstack sudo[86741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1 1073741824
Apr 09 12:46:37 devstack sudo[86741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:37 devstack sudo[86739]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:37 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-600a7bd9-999e-4c24-8278-01e8dbb62e0d tempest-VolumesListAdminTestJSON-247238328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dfc7565c-7084-4526-8d6f-07ee7c26b398" returned: 0 in 0.727s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:37 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-600a7bd9-999e-4c24-8278-01e8dbb62e0d tempest-VolumesListAdminTestJSON-247238328 None] Lock "cinder-quobyte-dfc7565c-7084-4526-8d6f-07ee7c26b398" released by "delete_volume" :: held 1.700s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:46:37 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-600a7bd9-999e-4c24-8278-01e8dbb62e0d tempest-VolumesListAdminTestJSON-247238328 None] Created reservations ['5ab50535-c7aa-40f9-89e9-08a78c7549a1', 'abc0ffd1-548e-461a-8978-2b7899c79365', '3c2654d3-298c-469b-aeda-18e3d7c22fa9', '9a23deec-1b87-4694-bbb1-761b585ce4b3'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:46:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-600a7bd9-999e-4c24-8278-01e8dbb62e0d tempest-VolumesListAdminTestJSON-247238328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:46:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-600a7bd9-999e-4c24-8278-01e8dbb62e0d tempest-VolumesListAdminTestJSON-247238328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:46:38 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-600a7bd9-999e-4c24-8278-01e8dbb62e0d tempest-VolumesListAdminTestJSON-247238328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:46:38 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-600a7bd9-999e-4c24-8278-01e8dbb62e0d tempest-VolumesListAdminTestJSON-247238328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:46:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-600a7bd9-999e-4c24-8278-01e8dbb62e0d tempest-VolumesListAdminTestJSON-247238328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:46:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-600a7bd9-999e-4c24-8278-01e8dbb62e0d tempest-VolumesListAdminTestJSON-247238328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:38 devstack sudo[86747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:46:38 devstack sudo[86747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:38 devstack sudo[86741]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-329ee3cd-6fbf-4688-a27e-8597d93d017f tempest-VolumesCloneTest-717382768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1 1073741824" returned: 0 in 0.783s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-329ee3cd-6fbf-4688-a27e-8597d93d017f tempest-VolumesCloneTest-717382768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:38 devstack sudo[86749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1
Apr 09 12:46:38 devstack sudo[86749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:39 devstack sudo[86747]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-600a7bd9-999e-4c24-8278-01e8dbb62e0d tempest-VolumesListAdminTestJSON-247238328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 1.086s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:39 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-600a7bd9-999e-4c24-8278-01e8dbb62e0d tempest-VolumesListAdminTestJSON-247238328 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:46:39 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-600a7bd9-999e-4c24-8278-01e8dbb62e0d tempest-VolumesListAdminTestJSON-247238328 None] Deleted volume successfully.
Apr 09 12:46:39 devstack cinder-volume[82760]: DEBUG dbcounter [-] [82760] Writing DB stats cinder:INSERT=41,cinder:UPDATE=167,cinder:SELECT=113,cinder:DELETE=14 {{(pid=82760) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 12:46:39 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-600a7bd9-999e-4c24-8278-01e8dbb62e0d tempest-VolumesListAdminTestJSON-247238328 None] Lock "cinder-dfc7565c-7084-4526-8d6f-07ee7c26b398-delete_volume" released by "delete_volume" :: held 3.069s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:46:39 devstack sudo[86749]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-329ee3cd-6fbf-4688-a27e-8597d93d017f tempest-VolumesCloneTest-717382768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1" returned: 0 in 1.143s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:39 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-329ee3cd-6fbf-4688-a27e-8597d93d017f tempest-VolumesCloneTest-717382768 None] <== create_volume: return (1968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:46:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-329ee3cd-6fbf-4688-a27e-8597d93d017f tempest-VolumesCloneTest-717382768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.970s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:46:39 devstack cinder-volume[82760]: DEBUG dbcounter [-] [82760] Writing DB stats cinder:SELECT=126,cinder:INSERT=39,cinder:UPDATE=166,cinder:DELETE=10 {{(pid=82760) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 12:46:39 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-329ee3cd-6fbf-4688-a27e-8597d93d017f tempest-VolumesCloneTest-717382768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eff554a-c530-4ec6-ba33-81a870fe8f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:39 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-329ee3cd-6fbf-4688-a27e-8597d93d017f tempest-VolumesCloneTest-717382768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ac2e3a1-dc50-441c-8048-46c78f0a9786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:39 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-329ee3cd-6fbf-4688-a27e-8597d93d017f tempest-VolumesCloneTest-717382768 None] Volume volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1 (bce01497-1325-4ce9-a4f4-c9213b0b90a1): created successfully
Apr 09 12:46:39 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-329ee3cd-6fbf-4688-a27e-8597d93d017f tempest-VolumesCloneTest-717382768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ac2e3a1-dc50-441c-8048-46c78f0a9786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:39 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-329ee3cd-6fbf-4688-a27e-8597d93d017f tempest-VolumesCloneTest-717382768 None] Flow 'volume_create_manager' (83b9506c-6b9f-4bab-ae48-2e5e19a47e80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:46:39 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-329ee3cd-6fbf-4688-a27e-8597d93d017f tempest-VolumesCloneTest-717382768 None] Created volume successfully.
Apr 09 12:46:41 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:46:41 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] Flow 'volume_create_manager' (561cf8ad-63a4-4ad3-9cac-cd78459c40fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:46:41 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63af81dd-ab16-4835-936c-6a6ea84e36b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:41 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63af81dd-ab16-4835-936c-6a6ea84e36b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:46:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-648962932',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43aab58e-1627-4757-b866-befe78e02d7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f5af8bc3ce547a5bc04dc2530f5aa35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:46:41Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=bce01497-1325-4ce9-a4f4-c9213b0b90a1,status='creating',terminated_at=None,updated_at=2026-04-09T10:46:41Z,use_quota=True,user_id='73a6b36b06e94dcc9dae35e41698668d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:41 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b2206a0-9cd4-45e1-8bfa-8f25bf45efc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:41 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b2206a0-9cd4-45e1-8bfa-8f25bf45efc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:41 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc5c8198-4850-4e22-b9b8-fafbe981d20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:41 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc5c8198-4850-4e22-b9b8-fafbe981d20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '43aab58e-1627-4757-b866-befe78e02d7b', 'volume_name': 'volume-43aab58e-1627-4757-b866-befe78e02d7b', 'volume_size': 2, 'source_volid': 'bce01497-1325-4ce9-a4f4-c9213b0b90a1', 'source_volstatus': 'available'}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:41 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70408203-7bfa-4da2-b0fe-a55bf4771a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:41 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70408203-7bfa-4da2-b0fe-a55bf4771a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:41 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b61f382e-834f-4a8b-b20c-5368f925cd9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:41 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] Volume 43aab58e-1627-4757-b866-befe78e02d7b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-43aab58e-1627-4757-b866-befe78e02d7b', 'volume_size': 2, 'source_volid': 'bce01497-1325-4ce9-a4f4-c9213b0b90a1', 'source_volstatus': 'available'}
Apr 09 12:46:41 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:46:41 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:46:41 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] Cloning volume bce01497-1325-4ce9-a4f4-c9213b0b90a1 to volume 43aab58e-1627-4757-b866-befe78e02d7b
Apr 09 12:46:41 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] Creating offline snapshot 39833745-612d-4ad8-8884-8ff77a936a18 of volume bce01497-1325-4ce9-a4f4-c9213b0b90a1 {{(pid=82760) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 12:46:41 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14a05df-2b81-4285-bf90-35028c4cc6e1]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:46:41 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:41 devstack sudo[86790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1
Apr 09 12:46:41 devstack sudo[86790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:42 devstack sudo[86790]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:42 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1" returned: 0 in 0.766s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:42 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1.39833745-612d-4ad8-8884-8ff77a936a18 1G {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:42 devstack sudo[86820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1.39833745-612d-4ad8-8884-8ff77a936a18 1G
Apr 09 12:46:42 devstack sudo[86820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:42 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-7575c9e9-b369-483a-ba71-63634e90c6ba tempest-SnapshotMetadataTestJSON-905008483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:46:42 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-7575c9e9-b369-483a-ba71-63634e90c6ba tempest-SnapshotMetadataTestJSON-905008483 None] Flow 'volume_create_manager' (ff298bf7-24c8-46d0-ad4d-101e41a2f979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:46:42 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-7575c9e9-b369-483a-ba71-63634e90c6ba tempest-SnapshotMetadataTestJSON-905008483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f184ae60-69ce-4660-853f-0693908d3148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:42 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-7575c9e9-b369-483a-ba71-63634e90c6ba tempest-SnapshotMetadataTestJSON-905008483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f184ae60-69ce-4660-853f-0693908d3148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1456283390',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=999a8d5e-5f61-4a76-9389-d8c0a3d13932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d2ae97f30ae40beb47fb1fe88e5ac04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:46:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:46:43Z,use_quota=True,user_id='ae6893d8769a4ec1b51980dcc369fc13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:42 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-7575c9e9-b369-483a-ba71-63634e90c6ba tempest-SnapshotMetadataTestJSON-905008483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5cfcf9c-7c97-4cf6-b980-2d57e11a0614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:42 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-7575c9e9-b369-483a-ba71-63634e90c6ba tempest-SnapshotMetadataTestJSON-905008483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5cfcf9c-7c97-4cf6-b980-2d57e11a0614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:42 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-7575c9e9-b369-483a-ba71-63634e90c6ba tempest-SnapshotMetadataTestJSON-905008483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5b167e7-e5c9-4324-a783-e6687c01d8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:42 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-7575c9e9-b369-483a-ba71-63634e90c6ba tempest-SnapshotMetadataTestJSON-905008483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5b167e7-e5c9-4324-a783-e6687c01d8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '999a8d5e-5f61-4a76-9389-d8c0a3d13932', 'volume_name': 'volume-999a8d5e-5f61-4a76-9389-d8c0a3d13932', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:42 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-7575c9e9-b369-483a-ba71-63634e90c6ba tempest-SnapshotMetadataTestJSON-905008483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0378d89c-6451-41bb-96ac-086f162cd488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:42 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-7575c9e9-b369-483a-ba71-63634e90c6ba tempest-SnapshotMetadataTestJSON-905008483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0378d89c-6451-41bb-96ac-086f162cd488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:42 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-7575c9e9-b369-483a-ba71-63634e90c6ba tempest-SnapshotMetadataTestJSON-905008483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7a25d7c-79d8-4b23-b49c-09ea641ff1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:42 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-7575c9e9-b369-483a-ba71-63634e90c6ba tempest-SnapshotMetadataTestJSON-905008483 None] Volume 999a8d5e-5f61-4a76-9389-d8c0a3d13932: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-999a8d5e-5f61-4a76-9389-d8c0a3d13932', 'volume_size': 1}
Apr 09 12:46:42 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-7575c9e9-b369-483a-ba71-63634e90c6ba tempest-SnapshotMetadataTestJSON-905008483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:46:43 devstack sudo[86820]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:43 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1.39833745-612d-4ad8-8884-8ff77a936a18 1G" returned: 0 in 1.140s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:43 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1.39833745-612d-4ad8-8884-8ff77a936a18 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:43 devstack sudo[86829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1.39833745-612d-4ad8-8884-8ff77a936a18
Apr 09 12:46:43 devstack sudo[86829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:43 devstack sudo[86829]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:43 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1.39833745-612d-4ad8-8884-8ff77a936a18" returned: 0 in 0.697s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:43 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1.39833745-612d-4ad8-8884-8ff77a936a18 is being set with open permissions: ugo+rw
Apr 09 12:46:43 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1.39833745-612d-4ad8-8884-8ff77a936a18 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:43 devstack sudo[86834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1.39833745-612d-4ad8-8884-8ff77a936a18
Apr 09 12:46:43 devstack sudo[86834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:44 devstack sudo[86834]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:44 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1.39833745-612d-4ad8-8884-8ff77a936a18" returned: 0 in 0.744s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:44 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:44 devstack sudo[86838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1.info
Apr 09 12:46:44 devstack sudo[86838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:45 devstack sudo[86838]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:45 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1.info" returned: 0 in 0.667s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:45 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1.info is being set with open permissions: ugo+rw
Apr 09 12:46:45 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:45 devstack sudo[86842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1.info
Apr 09 12:46:45 devstack sudo[86842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:46 devstack sudo[86842]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1.info" returned: 0 in 0.740s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:46 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] Acquiring lock "cinder-quobyte-43aab58e-1627-4757-b866-befe78e02d7b" by "_copy_volume_from_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:46:46 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] Lock "cinder-quobyte-43aab58e-1627-4757-b866-befe78e02d7b" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:46:46 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] snapshot: 39833745-612d-4ad8-8884-8ff77a936a18, volume: 43aab58e-1627-4757-b866-befe78e02d7b,  {{(pid=82760) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 09 12:46:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:46:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:46:46 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:46:46 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:46:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:46:46 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b4ec80-74ce-4364-b595-2896a724ba88]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:46:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1.39833745-612d-4ad8-8884-8ff77a936a18 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:46 devstack sudo[86851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1.39833745-612d-4ad8-8884-8ff77a936a18
Apr 09 12:46:46 devstack sudo[86851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:47 devstack sudo[86851]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:47 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1.39833745-612d-4ad8-8884-8ff77a936a18" returned: 0 in 0.948s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:47 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:46:47 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1 {{(pid=82760) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 09 12:46:47 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] Creating direct copy from snapshot {{(pid=82760) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 09 12:46:47 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8aadaf-74a3-446e-b503-b114d1cdd751]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:46:47 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:47 devstack sudo[86872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1
Apr 09 12:46:47 devstack sudo[86872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:47 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:46:47 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] Flow 'volume_create_manager' (c66e5ef4-d955-42c7-81c4-4102dc6b73c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:46:47 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55f0b759-cbb7-4f1d-8a34-00b17ceedd8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:47 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55f0b759-cbb7-4f1d-8a34-00b17ceedd8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:46:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1831905320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8e38472-2021-449c-a478-10e62b6c0125,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='567ecfa1d31043d781ce1ecd06452a4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:46:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:46:47Z,use_quota=True,user_id='ff4b15843a57475aa5b81d21f7687421',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:47 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ffe5ccf-146c-4b59-9544-a13da8427aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:47 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ffe5ccf-146c-4b59-9544-a13da8427aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:47 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6cef793-c2f8-432a-bf88-964f58a38bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:47 devstack cinder-volume[82760]: DEBUG cinder.image.glance [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] Creating Keystone auth plugin from conf {{(pid=82760) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 09 12:46:47 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6cef793-c2f8-432a-bf88-964f58a38bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd8e38472-2021-449c-a478-10e62b6c0125', 'volume_name': 'volume-d8e38472-2021-449c-a478-10e62b6c0125', 'volume_size': 1, 'image_id': '11bf303b-adca-49d8-8d80-d4a3c72e719a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11bf303b-adca-49d8-8d80-d4a3c72e719a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c43b4928ecdf4421ad23e5f918ea33fe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '11bf303b-adca-49d8-8d80-d4a3c72e719a', 'created_at': datetime.datetime(2026, 4, 9, 10, 38, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 10, 38, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11bf303b-adca-49d8-8d80-d4a3c72e719a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f378da88430>}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:47 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ebe3950-2a56-4681-9f5d-eaf722515943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:47 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ebe3950-2a56-4681-9f5d-eaf722515943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:47 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de4708ab-d691-4e9a-85e0-53721023e556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:47 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] Volume d8e38472-2021-449c-a478-10e62b6c0125: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d8e38472-2021-449c-a478-10e62b6c0125', 'volume_size': 1, 'image_id': '11bf303b-adca-49d8-8d80-d4a3c72e719a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11bf303b-adca-49d8-8d80-d4a3c72e719a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c43b4928ecdf4421ad23e5f918ea33fe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '11bf303b-adca-49d8-8d80-d4a3c72e719a', 'created_at': datetime.datetime(2026, 4, 9, 10, 38, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 10, 38, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11bf303b-adca-49d8-8d80-d4a3c72e719a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f378da88430>}
Apr 09 12:46:47 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] Trying to clone d8e38472-2021-449c-a478-10e62b6c0125 from image 11bf303b-adca-49d8-8d80-d4a3c72e719a at location (None, [{'url': 'file:///opt/stack/data/glance/images/11bf303b-adca-49d8-8d80-d4a3c72e719a', 'metadata': {}}]). {{(pid=82760) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 09 12:46:47 devstack sudo[86872]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:47 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1" returned: 0 in 0.714s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:47 devstack cinder-volume[82760]: DEBUG cinder.utils [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] Path /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-43aab58e-1627-4757-b866-befe78e02d7b not found in is_blk_device check {{(pid=82760) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 09 12:46:47 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-43aab58e-1627-4757-b866-befe78e02d7b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:47 devstack sudo[86880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-43aab58e-1627-4757-b866-befe78e02d7b
Apr 09 12:46:47 devstack sudo[86880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:47 devstack cinder-volume[82760]: DEBUG cinder.image.image_utils [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_11bf303b-adca-49d8-8d80-d4a3c72e719a_19pjcatldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82760) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 09 12:46:47 devstack cinder-volume[82760]: INFO cinder.image.image_utils [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] Image download 20.69 MB at 20.69 MB/s
Apr 09 12:46:48 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33fe8d9-62ce-44a7-a4dc-6e9312a3783b]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:46:48 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11bf303b-adca-49d8-8d80-d4a3c72e719a_19pjcatldevstack@QuobyteHD {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:48 devstack sudo[86885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11bf303b-adca-49d8-8d80-d4a3c72e719a_19pjcatldevstack@QuobyteHD
Apr 09 12:46:48 devstack sudo[86885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:48 devstack sudo[86885]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:48 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11bf303b-adca-49d8-8d80-d4a3c72e719a_19pjcatldevstack@QuobyteHD" returned: 0 in 0.783s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:48 devstack cinder-volume[82760]: DEBUG cinder.image.image_utils [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] Temporary image 11bf303b-adca-49d8-8d80-d4a3c72e719a is fetched for user ff4b15843a57475aa5b81d21f7687421. {{(pid=82760) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 09 12:46:48 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee78ffe-8492-4df9-af1c-0852242f5187]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:46:48 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11bf303b-adca-49d8-8d80-d4a3c72e719a_19pjcatldevstack@QuobyteHD {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:49 devstack sudo[86919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11bf303b-adca-49d8-8d80-d4a3c72e719a_19pjcatldevstack@QuobyteHD
Apr 09 12:46:49 devstack sudo[86919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:50 devstack sudo[86919]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11bf303b-adca-49d8-8d80-d4a3c72e719a_19pjcatldevstack@QuobyteHD" returned: 0 in 2.004s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:46:51 devstack sudo[86880]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-43aab58e-1627-4757-b866-befe78e02d7b" returned: 0 in 3.316s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:51 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89bafa9-42cb-4703-8430-fdf4884e437a]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:46:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:51 devstack sudo[86924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1
Apr 09 12:46:51 devstack sudo[86924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:51 devstack sudo[86924]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1" returned: 0 in 0.707s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:51 devstack cinder-volume[82760]: DEBUG cinder.image.image_utils [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] Image conversion details: src /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1, size 1024.00 MB, duration 3.32 sec, destination /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-43aab58e-1627-4757-b866-befe78e02d7b {{(pid=82760) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 12:46:51 devstack cinder-volume[82760]: INFO cinder.image.image_utils [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] Converted 1024.00 MB image at 308.68 MB/s
Apr 09 12:46:51 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-43aab58e-1627-4757-b866-befe78e02d7b is being set with open permissions: ugo+rw
Apr 09 12:46:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-43aab58e-1627-4757-b866-befe78e02d7b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:51 devstack sudo[86929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-43aab58e-1627-4757-b866-befe78e02d7b
Apr 09 12:46:51 devstack sudo[86929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:52 devstack sudo[86929]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-43aab58e-1627-4757-b866-befe78e02d7b" returned: 0 in 0.534s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:52 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] Lock "cinder-quobyte-43aab58e-1627-4757-b866-befe78e02d7b" released by "_copy_volume_from_snapshot" :: held 6.318s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:46:52 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] Acquiring lock "cinder-quobyte-39833745-612d-4ad8-8884-8ff77a936a18" by "_delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:46:52 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] Lock "cinder-quobyte-39833745-612d-4ad8-8884-8ff77a936a18" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:46:52 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] Deleting offline snapshot 39833745-612d-4ad8-8884-8ff77a936a18 of volume bce01497-1325-4ce9-a4f4-c9213b0b90a1 {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 12:46:52 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] snapshot_file for this snap is: volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1.39833745-612d-4ad8-8884-8ff77a936a18 {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 12:46:52 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ae18be-cf9f-4d82-af57-a2fc8110f656]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:46:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1.39833745-612d-4ad8-8884-8ff77a936a18 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:52 devstack sudo[86933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1.39833745-612d-4ad8-8884-8ff77a936a18
Apr 09 12:46:52 devstack sudo[86933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:52 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7018793-a83b-4745-846c-1c66ce931235 tempest-ServersNegativeTestJSON-40084337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:46:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-a7018793-a83b-4745-846c-1c66ce931235 tempest-ServersNegativeTestJSON-40084337 None] Flow 'volume_create_manager' (0e1f3e06-11bb-4687-8a23-eb9563ba593b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:46:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-a7018793-a83b-4745-846c-1c66ce931235 tempest-ServersNegativeTestJSON-40084337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d94a989e-36ce-4d97-ba88-29f256d907d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-a7018793-a83b-4745-846c-1c66ce931235 tempest-ServersNegativeTestJSON-40084337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d94a989e-36ce-4d97-ba88-29f256d907d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:46:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1580687944',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c2109ed-8a0b-409c-8738-4acbfc46060e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a63233b0edc243cea3351ecfca4abe6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:46:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:46:53Z,use_quota=True,user_id='fee0b59388354d319636c889f9506d3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-a7018793-a83b-4745-846c-1c66ce931235 tempest-ServersNegativeTestJSON-40084337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c66eff5-fbe1-48e1-930f-e0e9617d469d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-a7018793-a83b-4745-846c-1c66ce931235 tempest-ServersNegativeTestJSON-40084337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c66eff5-fbe1-48e1-930f-e0e9617d469d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-a7018793-a83b-4745-846c-1c66ce931235 tempest-ServersNegativeTestJSON-40084337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4612fc29-d661-4c7d-8258-660cbcd96f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-a7018793-a83b-4745-846c-1c66ce931235 tempest-ServersNegativeTestJSON-40084337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4612fc29-d661-4c7d-8258-660cbcd96f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c2109ed-8a0b-409c-8738-4acbfc46060e', 'volume_name': 'volume-4c2109ed-8a0b-409c-8738-4acbfc46060e', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-a7018793-a83b-4745-846c-1c66ce931235 tempest-ServersNegativeTestJSON-40084337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5e0b7c4-e0f3-41e4-82b1-3a7652eb7da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-a7018793-a83b-4745-846c-1c66ce931235 tempest-ServersNegativeTestJSON-40084337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5e0b7c4-e0f3-41e4-82b1-3a7652eb7da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-a7018793-a83b-4745-846c-1c66ce931235 tempest-ServersNegativeTestJSON-40084337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e872fd3-a272-49a1-8ffd-8f25deaa1844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:52 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-a7018793-a83b-4745-846c-1c66ce931235 tempest-ServersNegativeTestJSON-40084337 None] Volume 4c2109ed-8a0b-409c-8738-4acbfc46060e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c2109ed-8a0b-409c-8738-4acbfc46060e', 'volume_size': 1}
Apr 09 12:46:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-a7018793-a83b-4745-846c-1c66ce931235 tempest-ServersNegativeTestJSON-40084337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:46:53 devstack sudo[86933]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1.39833745-612d-4ad8-8884-8ff77a936a18" returned: 0 in 0.662s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:53 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:46:53 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ba47c4-9527-486d-b886-f203cd92d358]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:46:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:53 devstack sudo[86942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1
Apr 09 12:46:53 devstack sudo[86942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:53 devstack sudo[86942]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1" returned: 0 in 0.574s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1.39833745-612d-4ad8-8884-8ff77a936a18 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:53 devstack sudo[86950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1.39833745-612d-4ad8-8884-8ff77a936a18
Apr 09 12:46:53 devstack sudo[86950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:54 devstack sudo[86950]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1.39833745-612d-4ad8-8884-8ff77a936a18" returned: 0 in 0.562s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1.39833745-612d-4ad8-8884-8ff77a936a18 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:54 devstack sudo[86955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1.39833745-612d-4ad8-8884-8ff77a936a18
Apr 09 12:46:54 devstack sudo[86955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:54 devstack sudo[86955]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1.39833745-612d-4ad8-8884-8ff77a936a18" returned: 0 in 0.545s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:54 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] Lock "cinder-quobyte-39833745-612d-4ad8-8884-8ff77a936a18" released by "_delete_snapshot" :: held 2.431s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:46:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.707s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:46:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-7575c9e9-b369-483a-ba71-63634e90c6ba tempest-SnapshotMetadataTestJSON-905008483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.981s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:46:54 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-7575c9e9-b369-483a-ba71-63634e90c6ba tempest-SnapshotMetadataTestJSON-905008483 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1456283390',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=999a8d5e-5f61-4a76-9389-d8c0a3d13932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d2ae97f30ae40beb47fb1fe88e5ac04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:46:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:46:43Z,use_quota=True,user_id='ae6893d8769a4ec1b51980dcc369fc13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:46:54 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-7575c9e9-b369-483a-ba71-63634e90c6ba tempest-SnapshotMetadataTestJSON-905008483 None] Creating volume 999a8d5e-5f61-4a76-9389-d8c0a3d13932 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:46:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-7575c9e9-b369-483a-ba71-63634e90c6ba tempest-SnapshotMetadataTestJSON-905008483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:46:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-7575c9e9-b369-483a-ba71-63634e90c6ba tempest-SnapshotMetadataTestJSON-905008483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:46:54 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-7575c9e9-b369-483a-ba71-63634e90c6ba tempest-SnapshotMetadataTestJSON-905008483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:46:54 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-7575c9e9-b369-483a-ba71-63634e90c6ba tempest-SnapshotMetadataTestJSON-905008483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:46:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-7575c9e9-b369-483a-ba71-63634e90c6ba tempest-SnapshotMetadataTestJSON-905008483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:46:54 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-7575c9e9-b369-483a-ba71-63634e90c6ba tempest-SnapshotMetadataTestJSON-905008483 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:46:54 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-7575c9e9-b369-483a-ba71-63634e90c6ba tempest-SnapshotMetadataTestJSON-905008483 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:46:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-7575c9e9-b369-483a-ba71-63634e90c6ba tempest-SnapshotMetadataTestJSON-905008483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-999a8d5e-5f61-4a76-9389-d8c0a3d13932 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:54 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b61f382e-834f-4a8b-b20c-5368f925cd9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43aab58e-1627-4757-b866-befe78e02d7b', 'volume_size': 2, 'source_volid': 'bce01497-1325-4ce9-a4f4-c9213b0b90a1', 'source_volstatus': 'available'}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ab097f6-0821-4c08-b842-404b3504d5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:55 devstack sudo[86958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-999a8d5e-5f61-4a76-9389-d8c0a3d13932 1073741824
Apr 09 12:46:55 devstack sudo[86958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:55 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] Volume volume-43aab58e-1627-4757-b866-befe78e02d7b (43aab58e-1627-4757-b866-befe78e02d7b): created successfully
Apr 09 12:46:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ab097f6-0821-4c08-b842-404b3504d5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] Flow 'volume_create_manager' (561cf8ad-63a4-4ad3-9cac-cd78459c40fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:46:55 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-c9ff0733-f2fd-44fe-9275-e93b75f799a0 tempest-VolumesCloneTest-717382768 None] Created volume successfully.
Apr 09 12:46:55 devstack sudo[86958]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-7575c9e9-b369-483a-ba71-63634e90c6ba tempest-SnapshotMetadataTestJSON-905008483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-999a8d5e-5f61-4a76-9389-d8c0a3d13932 1073741824" returned: 0 in 0.585s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-7575c9e9-b369-483a-ba71-63634e90c6ba tempest-SnapshotMetadataTestJSON-905008483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-999a8d5e-5f61-4a76-9389-d8c0a3d13932 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:55 devstack sudo[86963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-999a8d5e-5f61-4a76-9389-d8c0a3d13932
Apr 09 12:46:55 devstack sudo[86963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:55 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-baccc909-81cd-4650-8f4d-1dd770dd9e85 tempest-VolumesCloneTest-717382768 None] Acquiring lock "cinder-43aab58e-1627-4757-b866-befe78e02d7b-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:46:55 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-baccc909-81cd-4650-8f4d-1dd770dd9e85 tempest-VolumesCloneTest-717382768 None] Lock "cinder-43aab58e-1627-4757-b866-befe78e02d7b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:46:55 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-baccc909-81cd-4650-8f4d-1dd770dd9e85 tempest-VolumesCloneTest-717382768 None] Acquiring lock "cinder-quobyte-43aab58e-1627-4757-b866-befe78e02d7b" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:46:55 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-baccc909-81cd-4650-8f4d-1dd770dd9e85 tempest-VolumesCloneTest-717382768 None] Lock "cinder-quobyte-43aab58e-1627-4757-b866-befe78e02d7b" acquired by "delete_volume" :: waited 0.008s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:46:55 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6ffc00-ad01-4b45-a040-10ccae8ab8f9]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:46:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-baccc909-81cd-4650-8f4d-1dd770dd9e85 tempest-VolumesCloneTest-717382768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-43aab58e-1627-4757-b866-befe78e02d7b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:56 devstack sudo[86965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-43aab58e-1627-4757-b866-befe78e02d7b
Apr 09 12:46:56 devstack sudo[86965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:56 devstack sudo[86963]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-7575c9e9-b369-483a-ba71-63634e90c6ba tempest-SnapshotMetadataTestJSON-905008483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-999a8d5e-5f61-4a76-9389-d8c0a3d13932" returned: 0 in 0.505s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:56 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-7575c9e9-b369-483a-ba71-63634e90c6ba tempest-SnapshotMetadataTestJSON-905008483 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:46:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-7575c9e9-b369-483a-ba71-63634e90c6ba tempest-SnapshotMetadataTestJSON-905008483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:46:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.092s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:46:56 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:46:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1831905320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8e38472-2021-449c-a478-10e62b6c0125,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='567ecfa1d31043d781ce1ecd06452a4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:46:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:46:47Z,use_quota=True,user_id='ff4b15843a57475aa5b81d21f7687421',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:46:56 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] Creating volume d8e38472-2021-449c-a478-10e62b6c0125 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:46:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:46:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:46:56 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:46:56 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:46:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:46:56 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:46:56 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:46:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d8e38472-2021-449c-a478-10e62b6c0125 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:56 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-7575c9e9-b369-483a-ba71-63634e90c6ba tempest-SnapshotMetadataTestJSON-905008483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7a25d7c-79d8-4b23-b49c-09ea641ff1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-999a8d5e-5f61-4a76-9389-d8c0a3d13932', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:56 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-7575c9e9-b369-483a-ba71-63634e90c6ba tempest-SnapshotMetadataTestJSON-905008483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c13044f-031f-4833-9105-f847fd0171dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:56 devstack sudo[86968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d8e38472-2021-449c-a478-10e62b6c0125 1073741824
Apr 09 12:46:56 devstack sudo[86968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:56 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-7575c9e9-b369-483a-ba71-63634e90c6ba tempest-SnapshotMetadataTestJSON-905008483 None] Volume volume-999a8d5e-5f61-4a76-9389-d8c0a3d13932 (999a8d5e-5f61-4a76-9389-d8c0a3d13932): created successfully
Apr 09 12:46:56 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-7575c9e9-b369-483a-ba71-63634e90c6ba tempest-SnapshotMetadataTestJSON-905008483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c13044f-031f-4833-9105-f847fd0171dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:56 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-7575c9e9-b369-483a-ba71-63634e90c6ba tempest-SnapshotMetadataTestJSON-905008483 None] Flow 'volume_create_manager' (ff298bf7-24c8-46d0-ad4d-101e41a2f979) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:46:56 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-7575c9e9-b369-483a-ba71-63634e90c6ba tempest-SnapshotMetadataTestJSON-905008483 None] Created volume successfully.
Apr 09 12:46:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-5c613e05-6e5c-45b8-96cf-c3f4ca71cdd1 tempest-SnapshotMetadataTestJSON-905008483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:46:56 devstack sudo[86965]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-baccc909-81cd-4650-8f4d-1dd770dd9e85 tempest-VolumesCloneTest-717382768 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-43aab58e-1627-4757-b866-befe78e02d7b" returned: 0 in 0.666s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-baccc909-81cd-4650-8f4d-1dd770dd9e85 tempest-VolumesCloneTest-717382768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-43aab58e-1627-4757-b866-befe78e02d7b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:56 devstack sudo[86976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-43aab58e-1627-4757-b866-befe78e02d7b
Apr 09 12:46:56 devstack sudo[86976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:56 devstack sudo[86968]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d8e38472-2021-449c-a478-10e62b6c0125 1073741824" returned: 0 in 0.551s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d8e38472-2021-449c-a478-10e62b6c0125 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:56 devstack sudo[86978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d8e38472-2021-449c-a478-10e62b6c0125
Apr 09 12:46:56 devstack sudo[86978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:57 devstack sudo[86976]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-baccc909-81cd-4650-8f4d-1dd770dd9e85 tempest-VolumesCloneTest-717382768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-43aab58e-1627-4757-b866-befe78e02d7b" returned: 0 in 0.472s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:57 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-baccc909-81cd-4650-8f4d-1dd770dd9e85 tempest-VolumesCloneTest-717382768 None] Lock "cinder-quobyte-43aab58e-1627-4757-b866-befe78e02d7b" released by "delete_volume" :: held 1.167s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:46:57 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-baccc909-81cd-4650-8f4d-1dd770dd9e85 tempest-VolumesCloneTest-717382768 None] Created reservations ['be575fe0-9f34-41cc-a45b-a34e22a52826', '6a1f1957-232c-406c-8fc0-0702388d0c87', '5a8e05ed-2c9b-434a-b240-bea9d357ce19', 'ba21f0bc-cce0-4d48-9603-b1d8c5af723a'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:46:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-baccc909-81cd-4650-8f4d-1dd770dd9e85 tempest-VolumesCloneTest-717382768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:46:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-baccc909-81cd-4650-8f4d-1dd770dd9e85 tempest-VolumesCloneTest-717382768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:46:57 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-baccc909-81cd-4650-8f4d-1dd770dd9e85 tempest-VolumesCloneTest-717382768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:46:57 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-baccc909-81cd-4650-8f4d-1dd770dd9e85 tempest-VolumesCloneTest-717382768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:46:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-baccc909-81cd-4650-8f4d-1dd770dd9e85 tempest-VolumesCloneTest-717382768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:46:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-baccc909-81cd-4650-8f4d-1dd770dd9e85 tempest-VolumesCloneTest-717382768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:57 devstack sudo[86982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:46:57 devstack sudo[86978]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:57 devstack sudo[86982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d8e38472-2021-449c-a478-10e62b6c0125" returned: 0 in 0.527s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:57 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:46:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:46:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-a7018793-a83b-4745-846c-1c66ce931235 tempest-ServersNegativeTestJSON-40084337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.321s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:46:57 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-a7018793-a83b-4745-846c-1c66ce931235 tempest-ServersNegativeTestJSON-40084337 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:46:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1580687944',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c2109ed-8a0b-409c-8738-4acbfc46060e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a63233b0edc243cea3351ecfca4abe6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:46:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:46:53Z,use_quota=True,user_id='fee0b59388354d319636c889f9506d3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:46:57 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-a7018793-a83b-4745-846c-1c66ce931235 tempest-ServersNegativeTestJSON-40084337 None] Creating volume 4c2109ed-8a0b-409c-8738-4acbfc46060e {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:46:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-a7018793-a83b-4745-846c-1c66ce931235 tempest-ServersNegativeTestJSON-40084337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:46:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-a7018793-a83b-4745-846c-1c66ce931235 tempest-ServersNegativeTestJSON-40084337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:46:57 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-a7018793-a83b-4745-846c-1c66ce931235 tempest-ServersNegativeTestJSON-40084337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:46:57 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-a7018793-a83b-4745-846c-1c66ce931235 tempest-ServersNegativeTestJSON-40084337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:46:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-a7018793-a83b-4745-846c-1c66ce931235 tempest-ServersNegativeTestJSON-40084337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:46:57 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-a7018793-a83b-4745-846c-1c66ce931235 tempest-ServersNegativeTestJSON-40084337 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:46:57 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-a7018793-a83b-4745-846c-1c66ce931235 tempest-ServersNegativeTestJSON-40084337 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:46:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-a7018793-a83b-4745-846c-1c66ce931235 tempest-ServersNegativeTestJSON-40084337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-4c2109ed-8a0b-409c-8738-4acbfc46060e 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:57 devstack sudo[86984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-4c2109ed-8a0b-409c-8738-4acbfc46060e 1073741824
Apr 09 12:46:57 devstack sudo[86984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:57 devstack cinder-volume[82760]: DEBUG cinder.volume.volume_utils [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] Attempting download of 11bf303b-adca-49d8-8d80-d4a3c72e719a ((None, [{'url': 'file:///opt/stack/data/glance/images/11bf303b-adca-49d8-8d80-d4a3c72e719a', 'metadata': {}}])) to volume d8e38472-2021-449c-a478-10e62b6c0125. {{(pid=82760) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 09 12:46:57 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[4099be53-9313-496e-a0dc-547708c3e686]: (4, 'raw') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:46:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11bf303b-adca-49d8-8d80-d4a3c72e719a_x7i6hgnd {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:57 devstack sudo[86986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11bf303b-adca-49d8-8d80-d4a3c72e719a_x7i6hgnd
Apr 09 12:46:57 devstack sudo[86986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:57 devstack sudo[86982]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-baccc909-81cd-4650-8f4d-1dd770dd9e85 tempest-VolumesCloneTest-717382768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.490s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:57 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-baccc909-81cd-4650-8f4d-1dd770dd9e85 tempest-VolumesCloneTest-717382768 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:46:57 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-baccc909-81cd-4650-8f4d-1dd770dd9e85 tempest-VolumesCloneTest-717382768 None] Deleted volume successfully.
Apr 09 12:46:57 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-baccc909-81cd-4650-8f4d-1dd770dd9e85 tempest-VolumesCloneTest-717382768 None] Lock "cinder-43aab58e-1627-4757-b866-befe78e02d7b-delete_volume" released by "delete_volume" :: held 1.818s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:46:57 devstack sudo[86984]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-a7018793-a83b-4745-846c-1c66ce931235 tempest-ServersNegativeTestJSON-40084337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-4c2109ed-8a0b-409c-8738-4acbfc46060e 1073741824" returned: 0 in 0.596s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:57 devstack sudo[86986]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-a7018793-a83b-4745-846c-1c66ce931235 tempest-ServersNegativeTestJSON-40084337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-4c2109ed-8a0b-409c-8738-4acbfc46060e {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11bf303b-adca-49d8-8d80-d4a3c72e719a_x7i6hgnd" returned: 0 in 0.564s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11bf303b-adca-49d8-8d80-d4a3c72e719a_x7i6hgnd {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:57 devstack sudo[86994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-4c2109ed-8a0b-409c-8738-4acbfc46060e
Apr 09 12:46:57 devstack sudo[86994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:57 devstack sudo[86995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11bf303b-adca-49d8-8d80-d4a3c72e719a_x7i6hgnd
Apr 09 12:46:57 devstack sudo[86995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:58 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-b1229226-8bc1-4171-8f34-0ce7fa84bace tempest-VolumesCloneTest-717382768 None] Acquiring lock "cinder-bce01497-1325-4ce9-a4f4-c9213b0b90a1-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:46:58 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-b1229226-8bc1-4171-8f34-0ce7fa84bace tempest-VolumesCloneTest-717382768 None] Lock "cinder-bce01497-1325-4ce9-a4f4-c9213b0b90a1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:46:58 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-b1229226-8bc1-4171-8f34-0ce7fa84bace tempest-VolumesCloneTest-717382768 None] Acquiring lock "cinder-quobyte-bce01497-1325-4ce9-a4f4-c9213b0b90a1" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:46:58 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-b1229226-8bc1-4171-8f34-0ce7fa84bace tempest-VolumesCloneTest-717382768 None] Lock "cinder-quobyte-bce01497-1325-4ce9-a4f4-c9213b0b90a1" acquired by "delete_volume" :: waited 0.014s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:46:58 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[a483d39d-2b60-4284-a745-ebdbf04e7dbf]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:46:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b1229226-8bc1-4171-8f34-0ce7fa84bace tempest-VolumesCloneTest-717382768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:58 devstack sudo[86994]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:58 devstack sudo[86999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1
Apr 09 12:46:58 devstack sudo[86999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-a7018793-a83b-4745-846c-1c66ce931235 tempest-ServersNegativeTestJSON-40084337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-4c2109ed-8a0b-409c-8738-4acbfc46060e" returned: 0 in 0.527s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:58 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-a7018793-a83b-4745-846c-1c66ce931235 tempest-ServersNegativeTestJSON-40084337 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:46:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-a7018793-a83b-4745-846c-1c66ce931235 tempest-ServersNegativeTestJSON-40084337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:46:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-5c613e05-6e5c-45b8-96cf-c3f4ca71cdd1 tempest-SnapshotMetadataTestJSON-905008483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.956s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:46:58 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-a7018793-a83b-4745-846c-1c66ce931235 tempest-ServersNegativeTestJSON-40084337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e872fd3-a272-49a1-8ffd-8f25deaa1844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c2109ed-8a0b-409c-8738-4acbfc46060e', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:58 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-a7018793-a83b-4745-846c-1c66ce931235 tempest-ServersNegativeTestJSON-40084337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff21c46d-9c7f-46f2-b890-4bc5731cc2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:46:58 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-5c613e05-6e5c-45b8-96cf-c3f4ca71cdd1 tempest-SnapshotMetadataTestJSON-905008483 None] Creating offline snapshot 695d95b0-0b86-4655-913a-f60919d0c072 of volume 999a8d5e-5f61-4a76-9389-d8c0a3d13932 {{(pid=82760) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 12:46:58 devstack sudo[86995]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11bf303b-adca-49d8-8d80-d4a3c72e719a_x7i6hgnd" returned: 1 in 0.560s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11bf303b-adca-49d8-8d80-d4a3c72e719a_x7i6hgnd' failed. Not Retrying. {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 09 12:46:58 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-a7018793-a83b-4745-846c-1c66ce931235 tempest-ServersNegativeTestJSON-40084337 None] Volume volume-4c2109ed-8a0b-409c-8738-4acbfc46060e (4c2109ed-8a0b-409c-8738-4acbfc46060e): created successfully
Apr 09 12:46:58 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-a7018793-a83b-4745-846c-1c66ce931235 tempest-ServersNegativeTestJSON-40084337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff21c46d-9c7f-46f2-b890-4bc5731cc2a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:46:58 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-a7018793-a83b-4745-846c-1c66ce931235 tempest-ServersNegativeTestJSON-40084337 None] Flow 'volume_create_manager' (0e1f3e06-11bb-4687-8a23-eb9563ba593b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:46:58 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca522cb-0700-4bdc-b9dc-41a1b066b23b]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:46:58 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c18273-1038-4032-94c5-f7ba76210749]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:46:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11bf303b-adca-49d8-8d80-d4a3c72e719a_19pjcatldevstack@QuobyteHD {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-5c613e05-6e5c-45b8-96cf-c3f4ca71cdd1 tempest-SnapshotMetadataTestJSON-905008483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-999a8d5e-5f61-4a76-9389-d8c0a3d13932 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:58 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-a7018793-a83b-4745-846c-1c66ce931235 tempest-ServersNegativeTestJSON-40084337 None] Created volume successfully.
Apr 09 12:46:58 devstack sudo[87004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11bf303b-adca-49d8-8d80-d4a3c72e719a_19pjcatldevstack@QuobyteHD
Apr 09 12:46:58 devstack sudo[87004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:58 devstack sudo[87005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-999a8d5e-5f61-4a76-9389-d8c0a3d13932
Apr 09 12:46:58 devstack sudo[87005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:58 devstack sudo[86999]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b1229226-8bc1-4171-8f34-0ce7fa84bace tempest-VolumesCloneTest-717382768 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1" returned: 0 in 0.600s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b1229226-8bc1-4171-8f34-0ce7fa84bace tempest-VolumesCloneTest-717382768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:58 devstack sudo[87014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1
Apr 09 12:46:58 devstack sudo[87014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:58 devstack sudo[87004]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11bf303b-adca-49d8-8d80-d4a3c72e719a_19pjcatldevstack@QuobyteHD" returned: 0 in 0.498s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:58 devstack cinder-volume[82760]: DEBUG cinder.image.image_utils [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] 11bf303b-adca-49d8-8d80-d4a3c72e719a was qcow2, converting to raw {{(pid=82760) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 09 12:46:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_11bf303b-adca-49d8-8d80-d4a3c72e719a_19pjcatldevstack@QuobyteHD /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d8e38472-2021-449c-a478-10e62b6c0125 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:58 devstack sudo[87019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_11bf303b-adca-49d8-8d80-d4a3c72e719a_19pjcatldevstack@QuobyteHD /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d8e38472-2021-449c-a478-10e62b6c0125
Apr 09 12:46:58 devstack sudo[87019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:59 devstack sudo[87005]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:59 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-5c613e05-6e5c-45b8-96cf-c3f4ca71cdd1 tempest-SnapshotMetadataTestJSON-905008483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-999a8d5e-5f61-4a76-9389-d8c0a3d13932" returned: 0 in 0.587s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:59 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-5c613e05-6e5c-45b8-96cf-c3f4ca71cdd1 tempest-SnapshotMetadataTestJSON-905008483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-999a8d5e-5f61-4a76-9389-d8c0a3d13932,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-999a8d5e-5f61-4a76-9389-d8c0a3d13932.695d95b0-0b86-4655-913a-f60919d0c072 1G {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:59 devstack sudo[87021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-999a8d5e-5f61-4a76-9389-d8c0a3d13932,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-999a8d5e-5f61-4a76-9389-d8c0a3d13932.695d95b0-0b86-4655-913a-f60919d0c072 1G
Apr 09 12:46:59 devstack sudo[87021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:59 devstack sudo[87014]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:59 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b1229226-8bc1-4171-8f34-0ce7fa84bace tempest-VolumesCloneTest-717382768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bce01497-1325-4ce9-a4f4-c9213b0b90a1" returned: 0 in 0.701s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:59 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-b1229226-8bc1-4171-8f34-0ce7fa84bace tempest-VolumesCloneTest-717382768 None] Lock "cinder-quobyte-bce01497-1325-4ce9-a4f4-c9213b0b90a1" released by "delete_volume" :: held 1.364s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:46:59 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-b1229226-8bc1-4171-8f34-0ce7fa84bace tempest-VolumesCloneTest-717382768 None] Created reservations ['1f8b2f07-3ecc-462f-946c-8ada706e2cba', '9908c567-5ae6-404d-8493-2af828c43f79', '1a80ddfb-6d65-4906-b042-afff2c43e1e9', '7816b5a8-6ad2-478a-b3fe-e5efd6559c55'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:46:59 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b1229226-8bc1-4171-8f34-0ce7fa84bace tempest-VolumesCloneTest-717382768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:46:59 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b1229226-8bc1-4171-8f34-0ce7fa84bace tempest-VolumesCloneTest-717382768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:46:59 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-b1229226-8bc1-4171-8f34-0ce7fa84bace tempest-VolumesCloneTest-717382768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:46:59 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-b1229226-8bc1-4171-8f34-0ce7fa84bace tempest-VolumesCloneTest-717382768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:46:59 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b1229226-8bc1-4171-8f34-0ce7fa84bace tempest-VolumesCloneTest-717382768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:46:59 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b1229226-8bc1-4171-8f34-0ce7fa84bace tempest-VolumesCloneTest-717382768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:59 devstack sudo[87042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:46:59 devstack sudo[87042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:46:59 devstack sudo[87021]: pam_unix(sudo:session): session closed for user root
Apr 09 12:46:59 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-5c613e05-6e5c-45b8-96cf-c3f4ca71cdd1 tempest-SnapshotMetadataTestJSON-905008483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-999a8d5e-5f61-4a76-9389-d8c0a3d13932,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-999a8d5e-5f61-4a76-9389-d8c0a3d13932.695d95b0-0b86-4655-913a-f60919d0c072 1G" returned: 0 in 0.834s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:46:59 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-5c613e05-6e5c-45b8-96cf-c3f4ca71cdd1 tempest-SnapshotMetadataTestJSON-905008483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-999a8d5e-5f61-4a76-9389-d8c0a3d13932 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-999a8d5e-5f61-4a76-9389-d8c0a3d13932.695d95b0-0b86-4655-913a-f60919d0c072 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:46:59 devstack sudo[87044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-999a8d5e-5f61-4a76-9389-d8c0a3d13932 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-999a8d5e-5f61-4a76-9389-d8c0a3d13932.695d95b0-0b86-4655-913a-f60919d0c072
Apr 09 12:46:59 devstack sudo[87044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:00 devstack sudo[87019]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_11bf303b-adca-49d8-8d80-d4a3c72e719a_19pjcatldevstack@QuobyteHD /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d8e38472-2021-449c-a478-10e62b6c0125" returned: 0 in 1.328s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:00 devstack cinder-volume[82760]: DEBUG cinder.image.image_utils [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_11bf303b-adca-49d8-8d80-d4a3c72e719a_19pjcatldevstack@QuobyteHD, size 112.00 MB, duration 1.33 sec, destination /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d8e38472-2021-449c-a478-10e62b6c0125 {{(pid=82760) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 12:47:00 devstack cinder-volume[82760]: INFO cinder.image.image_utils [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] Converted 112.00 MB image at 84.23 MB/s
Apr 09 12:47:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d8e38472-2021-449c-a478-10e62b6c0125 1G {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:00 devstack sudo[87049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d8e38472-2021-449c-a478-10e62b6c0125 1G
Apr 09 12:47:00 devstack sudo[87049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:00 devstack sudo[87042]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b1229226-8bc1-4171-8f34-0ce7fa84bace tempest-VolumesCloneTest-717382768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.644s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:00 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-b1229226-8bc1-4171-8f34-0ce7fa84bace tempest-VolumesCloneTest-717382768 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:47:00 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-b1229226-8bc1-4171-8f34-0ce7fa84bace tempest-VolumesCloneTest-717382768 None] Deleted volume successfully.
Apr 09 12:47:00 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-b1229226-8bc1-4171-8f34-0ce7fa84bace tempest-VolumesCloneTest-717382768 None] Lock "cinder-bce01497-1325-4ce9-a4f4-c9213b0b90a1-delete_volume" released by "delete_volume" :: held 2.224s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:47:00 devstack sudo[87044]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-5c613e05-6e5c-45b8-96cf-c3f4ca71cdd1 tempest-SnapshotMetadataTestJSON-905008483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-999a8d5e-5f61-4a76-9389-d8c0a3d13932 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-999a8d5e-5f61-4a76-9389-d8c0a3d13932.695d95b0-0b86-4655-913a-f60919d0c072" returned: 0 in 0.648s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:00 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-5c613e05-6e5c-45b8-96cf-c3f4ca71cdd1 tempest-SnapshotMetadataTestJSON-905008483 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-999a8d5e-5f61-4a76-9389-d8c0a3d13932.695d95b0-0b86-4655-913a-f60919d0c072 is being set with open permissions: ugo+rw
Apr 09 12:47:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-5c613e05-6e5c-45b8-96cf-c3f4ca71cdd1 tempest-SnapshotMetadataTestJSON-905008483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-999a8d5e-5f61-4a76-9389-d8c0a3d13932.695d95b0-0b86-4655-913a-f60919d0c072 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:00 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-25399886-ef13-43b3-92ee-8e8c0ff050de tempest-ServersNegativeTestJSON-40084337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:47:00 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-25399886-ef13-43b3-92ee-8e8c0ff050de tempest-ServersNegativeTestJSON-40084337 None] Flow 'volume_create_manager' (55d17810-2a7e-4907-9083-980ec68ca283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:47:00 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-25399886-ef13-43b3-92ee-8e8c0ff050de tempest-ServersNegativeTestJSON-40084337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a833722e-35b7-49ba-90db-e767be971a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:00 devstack sudo[87054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-999a8d5e-5f61-4a76-9389-d8c0a3d13932.695d95b0-0b86-4655-913a-f60919d0c072
Apr 09 12:47:00 devstack sudo[87054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:00 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-25399886-ef13-43b3-92ee-8e8c0ff050de tempest-ServersNegativeTestJSON-40084337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a833722e-35b7-49ba-90db-e767be971a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1753717733',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4977ba9e-7fa1-4b45-94d4-47ae28322930,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a63233b0edc243cea3351ecfca4abe6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:47:00Z,use_quota=True,user_id='fee0b59388354d319636c889f9506d3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:00 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-25399886-ef13-43b3-92ee-8e8c0ff050de tempest-ServersNegativeTestJSON-40084337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (690963c4-b500-4514-9f2b-19cf5c8589d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:00 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-25399886-ef13-43b3-92ee-8e8c0ff050de tempest-ServersNegativeTestJSON-40084337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (690963c4-b500-4514-9f2b-19cf5c8589d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:00 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-25399886-ef13-43b3-92ee-8e8c0ff050de tempest-ServersNegativeTestJSON-40084337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9987cc2e-6602-47e4-a7ca-bb701b12f864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:00 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-25399886-ef13-43b3-92ee-8e8c0ff050de tempest-ServersNegativeTestJSON-40084337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9987cc2e-6602-47e4-a7ca-bb701b12f864) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4977ba9e-7fa1-4b45-94d4-47ae28322930', 'volume_name': 'volume-4977ba9e-7fa1-4b45-94d4-47ae28322930', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:00 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-25399886-ef13-43b3-92ee-8e8c0ff050de tempest-ServersNegativeTestJSON-40084337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d354992-08ae-4fe4-aa6c-1791f2e2b246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:00 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-25399886-ef13-43b3-92ee-8e8c0ff050de tempest-ServersNegativeTestJSON-40084337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d354992-08ae-4fe4-aa6c-1791f2e2b246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:00 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-25399886-ef13-43b3-92ee-8e8c0ff050de tempest-ServersNegativeTestJSON-40084337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f516402-cbac-417e-a35b-fbefe3367e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:00 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-25399886-ef13-43b3-92ee-8e8c0ff050de tempest-ServersNegativeTestJSON-40084337 None] Volume 4977ba9e-7fa1-4b45-94d4-47ae28322930: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4977ba9e-7fa1-4b45-94d4-47ae28322930', 'volume_size': 1}
Apr 09 12:47:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-25399886-ef13-43b3-92ee-8e8c0ff050de tempest-ServersNegativeTestJSON-40084337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:00 devstack sudo[87049]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d8e38472-2021-449c-a478-10e62b6c0125 1G" returned: 0 in 0.687s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:00 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7e41dd-6697-4e5e-af98-a255c38661d2]: (4, 'raw') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:47:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d8e38472-2021-449c-a478-10e62b6c0125 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:01 devstack sudo[87060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d8e38472-2021-449c-a478-10e62b6c0125
Apr 09 12:47:01 devstack sudo[87060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:01 devstack sudo[87054]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-5c613e05-6e5c-45b8-96cf-c3f4ca71cdd1 tempest-SnapshotMetadataTestJSON-905008483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-999a8d5e-5f61-4a76-9389-d8c0a3d13932.695d95b0-0b86-4655-913a-f60919d0c072" returned: 0 in 0.584s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-5c613e05-6e5c-45b8-96cf-c3f4ca71cdd1 tempest-SnapshotMetadataTestJSON-905008483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-999a8d5e-5f61-4a76-9389-d8c0a3d13932.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:01 devstack sudo[87062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-999a8d5e-5f61-4a76-9389-d8c0a3d13932.info
Apr 09 12:47:01 devstack sudo[87062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:01 devstack sudo[87060]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d8e38472-2021-449c-a478-10e62b6c0125" returned: 0 in 0.609s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d8e38472-2021-449c-a478-10e62b6c0125 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:01 devstack sudo[87067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d8e38472-2021-449c-a478-10e62b6c0125
Apr 09 12:47:01 devstack sudo[87067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:01 devstack sudo[87062]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-5c613e05-6e5c-45b8-96cf-c3f4ca71cdd1 tempest-SnapshotMetadataTestJSON-905008483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-999a8d5e-5f61-4a76-9389-d8c0a3d13932.info" returned: 0 in 0.613s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:01 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-5c613e05-6e5c-45b8-96cf-c3f4ca71cdd1 tempest-SnapshotMetadataTestJSON-905008483 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-999a8d5e-5f61-4a76-9389-d8c0a3d13932.info is being set with open permissions: ugo+rw
Apr 09 12:47:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-5c613e05-6e5c-45b8-96cf-c3f4ca71cdd1 tempest-SnapshotMetadataTestJSON-905008483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-999a8d5e-5f61-4a76-9389-d8c0a3d13932.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:01 devstack sudo[87069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-999a8d5e-5f61-4a76-9389-d8c0a3d13932.info
Apr 09 12:47:01 devstack sudo[87069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:02 devstack sudo[87069]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-5c613e05-6e5c-45b8-96cf-c3f4ca71cdd1 tempest-SnapshotMetadataTestJSON-905008483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-999a8d5e-5f61-4a76-9389-d8c0a3d13932.info" returned: 0 in 0.432s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-5c613e05-6e5c-45b8-96cf-c3f4ca71cdd1 tempest-SnapshotMetadataTestJSON-905008483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.815s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-25399886-ef13-43b3-92ee-8e8c0ff050de tempest-ServersNegativeTestJSON-40084337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.601s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:02 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-25399886-ef13-43b3-92ee-8e8c0ff050de tempest-ServersNegativeTestJSON-40084337 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1753717733',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4977ba9e-7fa1-4b45-94d4-47ae28322930,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a63233b0edc243cea3351ecfca4abe6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:47:00Z,use_quota=True,user_id='fee0b59388354d319636c889f9506d3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:47:02 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-25399886-ef13-43b3-92ee-8e8c0ff050de tempest-ServersNegativeTestJSON-40084337 None] Creating volume 4977ba9e-7fa1-4b45-94d4-47ae28322930 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:47:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-25399886-ef13-43b3-92ee-8e8c0ff050de tempest-ServersNegativeTestJSON-40084337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-25399886-ef13-43b3-92ee-8e8c0ff050de tempest-ServersNegativeTestJSON-40084337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:02 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-25399886-ef13-43b3-92ee-8e8c0ff050de tempest-ServersNegativeTestJSON-40084337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:47:02 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-25399886-ef13-43b3-92ee-8e8c0ff050de tempest-ServersNegativeTestJSON-40084337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:47:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-25399886-ef13-43b3-92ee-8e8c0ff050de tempest-ServersNegativeTestJSON-40084337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:02 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-25399886-ef13-43b3-92ee-8e8c0ff050de tempest-ServersNegativeTestJSON-40084337 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:47:02 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-25399886-ef13-43b3-92ee-8e8c0ff050de tempest-ServersNegativeTestJSON-40084337 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:47:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-25399886-ef13-43b3-92ee-8e8c0ff050de tempest-ServersNegativeTestJSON-40084337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-4977ba9e-7fa1-4b45-94d4-47ae28322930 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:02 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-5c613e05-6e5c-45b8-96cf-c3f4ca71cdd1 tempest-SnapshotMetadataTestJSON-905008483 None] Create snapshot completed successfully
Apr 09 12:47:02 devstack sudo[87067]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:02 devstack sudo[87075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-4977ba9e-7fa1-4b45-94d4-47ae28322930 1073741824
Apr 09 12:47:02 devstack sudo[87075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d8e38472-2021-449c-a478-10e62b6c0125" returned: 1 in 0.644s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d8e38472-2021-449c-a478-10e62b6c0125' failed. Not Retrying. {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 09 12:47:02 devstack cinder-volume[82760]: DEBUG cinder.volume.volume_utils [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] Downloaded image 11bf303b-adca-49d8-8d80-d4a3c72e719a ((None, [{'url': 'file:///opt/stack/data/glance/images/11bf303b-adca-49d8-8d80-d4a3c72e719a', 'metadata': {}}])) to volume d8e38472-2021-449c-a478-10e62b6c0125 successfully. {{(pid=82760) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 09 12:47:02 devstack cinder-volume[82760]: DEBUG cinder.image.image_utils [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] Temporary image 11bf303b-adca-49d8-8d80-d4a3c72e719a for user ff4b15843a57475aa5b81d21f7687421 is deleted. {{(pid=82760) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 09 12:47:02 devstack cinder-volume[82760]: DEBUG cinder.volume.volume_utils [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] Marking volume d8e38472-2021-449c-a478-10e62b6c0125 as bootable. {{(pid=82760) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 09 12:47:02 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] Copying metadata from image 11bf303b-adca-49d8-8d80-d4a3c72e719a to d8e38472-2021-449c-a478-10e62b6c0125. {{(pid=82760) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 09 12:47:02 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] Creating volume glance metadata for volume d8e38472-2021-449c-a478-10e62b6c0125 backed by image 11bf303b-adca-49d8-8d80-d4a3c72e719a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '11bf303b-adca-49d8-8d80-d4a3c72e719a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82760) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 09 12:47:02 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de4708ab-d691-4e9a-85e0-53721023e556) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8e38472-2021-449c-a478-10e62b6c0125', 'volume_size': 1, 'image_id': '11bf303b-adca-49d8-8d80-d4a3c72e719a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11bf303b-adca-49d8-8d80-d4a3c72e719a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c43b4928ecdf4421ad23e5f918ea33fe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '11bf303b-adca-49d8-8d80-d4a3c72e719a', 'created_at': datetime.datetime(2026, 4, 9, 10, 38, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 10, 38, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11bf303b-adca-49d8-8d80-d4a3c72e719a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f378da88430>}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:02 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f797e74-fd73-4633-8f86-da69f544f83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:02 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] Volume volume-d8e38472-2021-449c-a478-10e62b6c0125 (d8e38472-2021-449c-a478-10e62b6c0125): created successfully
Apr 09 12:47:02 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f797e74-fd73-4633-8f86-da69f544f83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:02 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] Flow 'volume_create_manager' (c66e5ef4-d955-42c7-81c4-4102dc6b73c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:47:02 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-e6f38e76-d4af-441f-997b-9ede56851b31 tempest-VolumesImageMetadata-2038162607 None] Created volume successfully.
Apr 09 12:47:02 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5fbb0c2-e5bf-457f-bf38-9cc9cee11d48 tempest-VolumesCloneNegativeTest-1232253563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:47:02 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f5fbb0c2-e5bf-457f-bf38-9cc9cee11d48 tempest-VolumesCloneNegativeTest-1232253563 None] Flow 'volume_create_manager' (7ec71dd0-ae85-4b39-8bdf-621f91029ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:47:02 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f5fbb0c2-e5bf-457f-bf38-9cc9cee11d48 tempest-VolumesCloneNegativeTest-1232253563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (244e2637-d57c-4011-992a-93a13676d8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:02 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f5fbb0c2-e5bf-457f-bf38-9cc9cee11d48 tempest-VolumesCloneNegativeTest-1232253563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (244e2637-d57c-4011-992a-93a13676d8d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:47:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1940452656',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87f08b20-e4ce-4834-bdbd-35a37cd08e16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5631c15d3cd1494e9906fa1c31fc3837',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:47:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:47:02Z,use_quota=True,user_id='45a4f0825c6e41beb5914dfd9ebabe85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:02 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f5fbb0c2-e5bf-457f-bf38-9cc9cee11d48 tempest-VolumesCloneNegativeTest-1232253563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5df61670-f0c8-4b44-bb05-3773d17bd0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:02 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f5fbb0c2-e5bf-457f-bf38-9cc9cee11d48 tempest-VolumesCloneNegativeTest-1232253563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5df61670-f0c8-4b44-bb05-3773d17bd0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:02 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f5fbb0c2-e5bf-457f-bf38-9cc9cee11d48 tempest-VolumesCloneNegativeTest-1232253563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32bcc36f-2a86-4592-92ca-3e56a5bff160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:02 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f5fbb0c2-e5bf-457f-bf38-9cc9cee11d48 tempest-VolumesCloneNegativeTest-1232253563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32bcc36f-2a86-4592-92ca-3e56a5bff160) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87f08b20-e4ce-4834-bdbd-35a37cd08e16', 'volume_name': 'volume-87f08b20-e4ce-4834-bdbd-35a37cd08e16', 'volume_size': 2}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:02 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f5fbb0c2-e5bf-457f-bf38-9cc9cee11d48 tempest-VolumesCloneNegativeTest-1232253563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f2b23ea-831d-4634-94b4-42201b5fd4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:02 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f5fbb0c2-e5bf-457f-bf38-9cc9cee11d48 tempest-VolumesCloneNegativeTest-1232253563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f2b23ea-831d-4634-94b4-42201b5fd4b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:02 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f5fbb0c2-e5bf-457f-bf38-9cc9cee11d48 tempest-VolumesCloneNegativeTest-1232253563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e796d77-cfc5-4193-95f8-b4b1f161f10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:02 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-f5fbb0c2-e5bf-457f-bf38-9cc9cee11d48 tempest-VolumesCloneNegativeTest-1232253563 None] Volume 87f08b20-e4ce-4834-bdbd-35a37cd08e16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87f08b20-e4ce-4834-bdbd-35a37cd08e16', 'volume_size': 2}
Apr 09 12:47:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f5fbb0c2-e5bf-457f-bf38-9cc9cee11d48 tempest-VolumesCloneNegativeTest-1232253563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:02 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-2c548a48-b92d-497a-9ad0-e6d2abbd3f2f tempest-VolumesImageMetadata-2038162607 None] Acquiring lock "cinder-d8e38472-2021-449c-a478-10e62b6c0125-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:47:02 devstack sudo[87075]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:02 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-2c548a48-b92d-497a-9ad0-e6d2abbd3f2f tempest-VolumesImageMetadata-2038162607 None] Lock "cinder-d8e38472-2021-449c-a478-10e62b6c0125-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:47:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-25399886-ef13-43b3-92ee-8e8c0ff050de tempest-ServersNegativeTestJSON-40084337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-4977ba9e-7fa1-4b45-94d4-47ae28322930 1073741824" returned: 0 in 0.669s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:02 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-2c548a48-b92d-497a-9ad0-e6d2abbd3f2f tempest-VolumesImageMetadata-2038162607 None] Acquiring lock "cinder-quobyte-d8e38472-2021-449c-a478-10e62b6c0125" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:47:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-25399886-ef13-43b3-92ee-8e8c0ff050de tempest-ServersNegativeTestJSON-40084337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-4977ba9e-7fa1-4b45-94d4-47ae28322930 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:02 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-2c548a48-b92d-497a-9ad0-e6d2abbd3f2f tempest-VolumesImageMetadata-2038162607 None] Lock "cinder-quobyte-d8e38472-2021-449c-a478-10e62b6c0125" acquired by "delete_volume" :: waited 0.030s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:47:02 devstack sudo[87081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-4977ba9e-7fa1-4b45-94d4-47ae28322930
Apr 09 12:47:02 devstack sudo[87081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:02 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[85918feb-1072-42c3-8aa2-4dae601f06fa]: (4, 'raw') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:47:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2c548a48-b92d-497a-9ad0-e6d2abbd3f2f tempest-VolumesImageMetadata-2038162607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d8e38472-2021-449c-a478-10e62b6c0125 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:03 devstack sudo[87083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d8e38472-2021-449c-a478-10e62b6c0125
Apr 09 12:47:03 devstack sudo[87083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:03 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-acc90409-7a88-4ef1-9868-00f97febdeae tempest-SnapshotMetadataTestJSON-905008483 None] Acquiring lock "cinder-695d95b0-0b86-4655-913a-f60919d0c072-delete_snapshot" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:47:03 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-acc90409-7a88-4ef1-9868-00f97febdeae tempest-SnapshotMetadataTestJSON-905008483 None] Lock "cinder-695d95b0-0b86-4655-913a-f60919d0c072-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:47:03 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-acc90409-7a88-4ef1-9868-00f97febdeae tempest-SnapshotMetadataTestJSON-905008483 None] Acquiring lock "cinder-quobyte-999a8d5e-5f61-4a76-9389-d8c0a3d13932" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:47:03 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-acc90409-7a88-4ef1-9868-00f97febdeae tempest-SnapshotMetadataTestJSON-905008483 None] Lock "cinder-quobyte-999a8d5e-5f61-4a76-9389-d8c0a3d13932" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:47:03 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-acc90409-7a88-4ef1-9868-00f97febdeae tempest-SnapshotMetadataTestJSON-905008483 None] Acquiring lock "cinder-quobyte-695d95b0-0b86-4655-913a-f60919d0c072" by "_delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:47:03 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-acc90409-7a88-4ef1-9868-00f97febdeae tempest-SnapshotMetadataTestJSON-905008483 None] Lock "cinder-quobyte-695d95b0-0b86-4655-913a-f60919d0c072" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:47:03 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-acc90409-7a88-4ef1-9868-00f97febdeae tempest-SnapshotMetadataTestJSON-905008483 None] Deleting offline snapshot 695d95b0-0b86-4655-913a-f60919d0c072 of volume 999a8d5e-5f61-4a76-9389-d8c0a3d13932 {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 12:47:03 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-acc90409-7a88-4ef1-9868-00f97febdeae tempest-SnapshotMetadataTestJSON-905008483 None] snapshot_file for this snap is: volume-999a8d5e-5f61-4a76-9389-d8c0a3d13932.695d95b0-0b86-4655-913a-f60919d0c072 {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 12:47:03 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4cf762-b9dd-4c71-a594-6f3300811598]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:47:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-acc90409-7a88-4ef1-9868-00f97febdeae tempest-SnapshotMetadataTestJSON-905008483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-999a8d5e-5f61-4a76-9389-d8c0a3d13932.695d95b0-0b86-4655-913a-f60919d0c072 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:03 devstack sudo[87086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-999a8d5e-5f61-4a76-9389-d8c0a3d13932.695d95b0-0b86-4655-913a-f60919d0c072
Apr 09 12:47:03 devstack sudo[87086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:03 devstack sudo[87081]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-25399886-ef13-43b3-92ee-8e8c0ff050de tempest-ServersNegativeTestJSON-40084337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-4977ba9e-7fa1-4b45-94d4-47ae28322930" returned: 0 in 0.534s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:03 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-25399886-ef13-43b3-92ee-8e8c0ff050de tempest-ServersNegativeTestJSON-40084337 None] <== create_volume: return (1244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:47:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-25399886-ef13-43b3-92ee-8e8c0ff050de tempest-ServersNegativeTestJSON-40084337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.248s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f5fbb0c2-e5bf-457f-bf38-9cc9cee11d48 tempest-VolumesCloneNegativeTest-1232253563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.857s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:03 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f5fbb0c2-e5bf-457f-bf38-9cc9cee11d48 tempest-VolumesCloneNegativeTest-1232253563 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:47:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1940452656',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87f08b20-e4ce-4834-bdbd-35a37cd08e16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5631c15d3cd1494e9906fa1c31fc3837',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:47:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:47:02Z,use_quota=True,user_id='45a4f0825c6e41beb5914dfd9ebabe85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:47:03 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-f5fbb0c2-e5bf-457f-bf38-9cc9cee11d48 tempest-VolumesCloneNegativeTest-1232253563 None] Creating volume 87f08b20-e4ce-4834-bdbd-35a37cd08e16 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:47:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f5fbb0c2-e5bf-457f-bf38-9cc9cee11d48 tempest-VolumesCloneNegativeTest-1232253563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f5fbb0c2-e5bf-457f-bf38-9cc9cee11d48 tempest-VolumesCloneNegativeTest-1232253563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:03 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f5fbb0c2-e5bf-457f-bf38-9cc9cee11d48 tempest-VolumesCloneNegativeTest-1232253563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:47:03 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f5fbb0c2-e5bf-457f-bf38-9cc9cee11d48 tempest-VolumesCloneNegativeTest-1232253563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:47:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f5fbb0c2-e5bf-457f-bf38-9cc9cee11d48 tempest-VolumesCloneNegativeTest-1232253563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:03 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f5fbb0c2-e5bf-457f-bf38-9cc9cee11d48 tempest-VolumesCloneNegativeTest-1232253563 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:47:03 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-f5fbb0c2-e5bf-457f-bf38-9cc9cee11d48 tempest-VolumesCloneNegativeTest-1232253563 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:47:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f5fbb0c2-e5bf-457f-bf38-9cc9cee11d48 tempest-VolumesCloneNegativeTest-1232253563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-87f08b20-e4ce-4834-bdbd-35a37cd08e16 2147483648 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:03 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-25399886-ef13-43b3-92ee-8e8c0ff050de tempest-ServersNegativeTestJSON-40084337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f516402-cbac-417e-a35b-fbefe3367e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4977ba9e-7fa1-4b45-94d4-47ae28322930', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:03 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-25399886-ef13-43b3-92ee-8e8c0ff050de tempest-ServersNegativeTestJSON-40084337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46276b7b-f669-4049-a2e1-18403d89a0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:03 devstack sudo[87090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-87f08b20-e4ce-4834-bdbd-35a37cd08e16 2147483648
Apr 09 12:47:03 devstack sudo[87090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:03 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-25399886-ef13-43b3-92ee-8e8c0ff050de tempest-ServersNegativeTestJSON-40084337 None] Volume volume-4977ba9e-7fa1-4b45-94d4-47ae28322930 (4977ba9e-7fa1-4b45-94d4-47ae28322930): created successfully
Apr 09 12:47:03 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-25399886-ef13-43b3-92ee-8e8c0ff050de tempest-ServersNegativeTestJSON-40084337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46276b7b-f669-4049-a2e1-18403d89a0b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:03 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-25399886-ef13-43b3-92ee-8e8c0ff050de tempest-ServersNegativeTestJSON-40084337 None] Flow 'volume_create_manager' (55d17810-2a7e-4907-9083-980ec68ca283) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:47:03 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-25399886-ef13-43b3-92ee-8e8c0ff050de tempest-ServersNegativeTestJSON-40084337 None] Created volume successfully.
Apr 09 12:47:03 devstack sudo[87083]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2c548a48-b92d-497a-9ad0-e6d2abbd3f2f tempest-VolumesImageMetadata-2038162607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d8e38472-2021-449c-a478-10e62b6c0125" returned: 0 in 0.565s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2c548a48-b92d-497a-9ad0-e6d2abbd3f2f tempest-VolumesImageMetadata-2038162607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d8e38472-2021-449c-a478-10e62b6c0125 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:03 devstack sudo[87092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d8e38472-2021-449c-a478-10e62b6c0125
Apr 09 12:47:03 devstack sudo[87092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:04 devstack sudo[87086]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-acc90409-7a88-4ef1-9868-00f97febdeae tempest-SnapshotMetadataTestJSON-905008483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-999a8d5e-5f61-4a76-9389-d8c0a3d13932.695d95b0-0b86-4655-913a-f60919d0c072" returned: 0 in 0.676s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:04 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-acc90409-7a88-4ef1-9868-00f97febdeae tempest-SnapshotMetadataTestJSON-905008483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-999a8d5e-5f61-4a76-9389-d8c0a3d13932(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:47:04 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-6b591207-271a-4123-83df-1a925eccb2ef tempest-ServersNegativeTestJSON-40084337 None] Acquiring lock "cinder-4977ba9e-7fa1-4b45-94d4-47ae28322930-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:47:04 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ac6e0b-7452-43e3-a705-62ccbc3d2237]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:47:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-acc90409-7a88-4ef1-9868-00f97febdeae tempest-SnapshotMetadataTestJSON-905008483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-999a8d5e-5f61-4a76-9389-d8c0a3d13932 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:04 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-6b591207-271a-4123-83df-1a925eccb2ef tempest-ServersNegativeTestJSON-40084337 None] Lock "cinder-4977ba9e-7fa1-4b45-94d4-47ae28322930-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:47:04 devstack sudo[87092]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2c548a48-b92d-497a-9ad0-e6d2abbd3f2f tempest-VolumesImageMetadata-2038162607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d8e38472-2021-449c-a478-10e62b6c0125" returned: 1 in 0.568s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2c548a48-b92d-497a-9ad0-e6d2abbd3f2f tempest-VolumesImageMetadata-2038162607 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d8e38472-2021-449c-a478-10e62b6c0125' failed. Not Retrying. {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 09 12:47:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2c548a48-b92d-497a-9ad0-e6d2abbd3f2f tempest-VolumesImageMetadata-2038162607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d8e38472-2021-449c-a478-10e62b6c0125 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:04 devstack sudo[87104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d8e38472-2021-449c-a478-10e62b6c0125
Apr 09 12:47:04 devstack sudo[87104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:04 devstack sudo[87090]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f5fbb0c2-e5bf-457f-bf38-9cc9cee11d48 tempest-VolumesCloneNegativeTest-1232253563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-87f08b20-e4ce-4834-bdbd-35a37cd08e16 2147483648" returned: 0 in 0.675s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:04 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-6b591207-271a-4123-83df-1a925eccb2ef tempest-ServersNegativeTestJSON-40084337 None] Acquiring lock "cinder-quobyte-4977ba9e-7fa1-4b45-94d4-47ae28322930" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:47:04 devstack sudo[87103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-999a8d5e-5f61-4a76-9389-d8c0a3d13932
Apr 09 12:47:04 devstack sudo[87103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:04 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-6b591207-271a-4123-83df-1a925eccb2ef tempest-ServersNegativeTestJSON-40084337 None] Lock "cinder-quobyte-4977ba9e-7fa1-4b45-94d4-47ae28322930" acquired by "delete_volume" :: waited 0.015s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:47:04 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f4de14-9f49-4cd7-a58f-2041ae7fa97b]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:47:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6b591207-271a-4123-83df-1a925eccb2ef tempest-ServersNegativeTestJSON-40084337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-4977ba9e-7fa1-4b45-94d4-47ae28322930 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f5fbb0c2-e5bf-457f-bf38-9cc9cee11d48 tempest-VolumesCloneNegativeTest-1232253563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-87f08b20-e4ce-4834-bdbd-35a37cd08e16 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:04 devstack sudo[87108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-87f08b20-e4ce-4834-bdbd-35a37cd08e16
Apr 09 12:47:04 devstack sudo[87108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:04 devstack sudo[87107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-4977ba9e-7fa1-4b45-94d4-47ae28322930
Apr 09 12:47:04 devstack sudo[87107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:04 devstack sudo[87104]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2c548a48-b92d-497a-9ad0-e6d2abbd3f2f tempest-VolumesImageMetadata-2038162607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d8e38472-2021-449c-a478-10e62b6c0125" returned: 0 in 0.422s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:04 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-2c548a48-b92d-497a-9ad0-e6d2abbd3f2f tempest-VolumesImageMetadata-2038162607 None] Lock "cinder-quobyte-d8e38472-2021-449c-a478-10e62b6c0125" released by "delete_volume" :: held 1.618s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:47:04 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-2c548a48-b92d-497a-9ad0-e6d2abbd3f2f tempest-VolumesImageMetadata-2038162607 None] Created reservations ['80bad292-19c0-4a0f-bb86-893ac0b718a1', '53afe90f-dd60-4d3a-a6ca-67acd31838f1', '9c12876c-cfc6-4ff7-a9f3-39ba1f21731d', '9a0ad624-d9d4-4d09-9409-d90979de9968'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:47:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-2c548a48-b92d-497a-9ad0-e6d2abbd3f2f tempest-VolumesImageMetadata-2038162607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-2c548a48-b92d-497a-9ad0-e6d2abbd3f2f tempest-VolumesImageMetadata-2038162607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:04 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-2c548a48-b92d-497a-9ad0-e6d2abbd3f2f tempest-VolumesImageMetadata-2038162607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:47:04 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-2c548a48-b92d-497a-9ad0-e6d2abbd3f2f tempest-VolumesImageMetadata-2038162607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:47:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-2c548a48-b92d-497a-9ad0-e6d2abbd3f2f tempest-VolumesImageMetadata-2038162607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2c548a48-b92d-497a-9ad0-e6d2abbd3f2f tempest-VolumesImageMetadata-2038162607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:04 devstack sudo[87103]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-acc90409-7a88-4ef1-9868-00f97febdeae tempest-SnapshotMetadataTestJSON-905008483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-999a8d5e-5f61-4a76-9389-d8c0a3d13932" returned: 0 in 0.601s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-acc90409-7a88-4ef1-9868-00f97febdeae tempest-SnapshotMetadataTestJSON-905008483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-999a8d5e-5f61-4a76-9389-d8c0a3d13932.695d95b0-0b86-4655-913a-f60919d0c072 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:04 devstack sudo[87119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:47:04 devstack sudo[87119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:04 devstack sudo[87121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-999a8d5e-5f61-4a76-9389-d8c0a3d13932.695d95b0-0b86-4655-913a-f60919d0c072
Apr 09 12:47:04 devstack sudo[87121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:04 devstack sudo[87108]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f5fbb0c2-e5bf-457f-bf38-9cc9cee11d48 tempest-VolumesCloneNegativeTest-1232253563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-87f08b20-e4ce-4834-bdbd-35a37cd08e16" returned: 0 in 0.512s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:04 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f5fbb0c2-e5bf-457f-bf38-9cc9cee11d48 tempest-VolumesCloneNegativeTest-1232253563 None] <== create_volume: return (1255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:47:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f5fbb0c2-e5bf-457f-bf38-9cc9cee11d48 tempest-VolumesCloneNegativeTest-1232253563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:04 devstack sudo[87107]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6b591207-271a-4123-83df-1a925eccb2ef tempest-ServersNegativeTestJSON-40084337 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-4977ba9e-7fa1-4b45-94d4-47ae28322930" returned: 0 in 0.537s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6b591207-271a-4123-83df-1a925eccb2ef tempest-ServersNegativeTestJSON-40084337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-4977ba9e-7fa1-4b45-94d4-47ae28322930 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:04 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f5fbb0c2-e5bf-457f-bf38-9cc9cee11d48 tempest-VolumesCloneNegativeTest-1232253563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e796d77-cfc5-4193-95f8-b4b1f161f10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87f08b20-e4ce-4834-bdbd-35a37cd08e16', 'volume_size': 2}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:04 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f5fbb0c2-e5bf-457f-bf38-9cc9cee11d48 tempest-VolumesCloneNegativeTest-1232253563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (743feabf-7859-49eb-86dd-00001603d67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:04 devstack sudo[87123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-4977ba9e-7fa1-4b45-94d4-47ae28322930
Apr 09 12:47:04 devstack sudo[87123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:04 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-f5fbb0c2-e5bf-457f-bf38-9cc9cee11d48 tempest-VolumesCloneNegativeTest-1232253563 None] Volume volume-87f08b20-e4ce-4834-bdbd-35a37cd08e16 (87f08b20-e4ce-4834-bdbd-35a37cd08e16): created successfully
Apr 09 12:47:04 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f5fbb0c2-e5bf-457f-bf38-9cc9cee11d48 tempest-VolumesCloneNegativeTest-1232253563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (743feabf-7859-49eb-86dd-00001603d67d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:04 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f5fbb0c2-e5bf-457f-bf38-9cc9cee11d48 tempest-VolumesCloneNegativeTest-1232253563 None] Flow 'volume_create_manager' (7ec71dd0-ae85-4b39-8bdf-621f91029ede) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:47:04 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-f5fbb0c2-e5bf-457f-bf38-9cc9cee11d48 tempest-VolumesCloneNegativeTest-1232253563 None] Created volume successfully.
Apr 09 12:47:05 devstack sudo[87119]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2c548a48-b92d-497a-9ad0-e6d2abbd3f2f tempest-VolumesImageMetadata-2038162607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.438s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:05 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-2c548a48-b92d-497a-9ad0-e6d2abbd3f2f tempest-VolumesImageMetadata-2038162607 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:47:05 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-2c548a48-b92d-497a-9ad0-e6d2abbd3f2f tempest-VolumesImageMetadata-2038162607 None] Deleted volume successfully.
Apr 09 12:47:05 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-2c548a48-b92d-497a-9ad0-e6d2abbd3f2f tempest-VolumesImageMetadata-2038162607 None] Lock "cinder-d8e38472-2021-449c-a478-10e62b6c0125-delete_volume" released by "delete_volume" :: held 2.235s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:47:05 devstack sudo[87123]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6b591207-271a-4123-83df-1a925eccb2ef tempest-ServersNegativeTestJSON-40084337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-4977ba9e-7fa1-4b45-94d4-47ae28322930" returned: 0 in 0.495s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:05 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-6b591207-271a-4123-83df-1a925eccb2ef tempest-ServersNegativeTestJSON-40084337 None] Lock "cinder-quobyte-4977ba9e-7fa1-4b45-94d4-47ae28322930" released by "delete_volume" :: held 1.056s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:47:05 devstack sudo[87121]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-acc90409-7a88-4ef1-9868-00f97febdeae tempest-SnapshotMetadataTestJSON-905008483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-999a8d5e-5f61-4a76-9389-d8c0a3d13932.695d95b0-0b86-4655-913a-f60919d0c072" returned: 0 in 0.603s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-acc90409-7a88-4ef1-9868-00f97febdeae tempest-SnapshotMetadataTestJSON-905008483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-999a8d5e-5f61-4a76-9389-d8c0a3d13932.695d95b0-0b86-4655-913a-f60919d0c072 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:05 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-6b591207-271a-4123-83df-1a925eccb2ef tempest-ServersNegativeTestJSON-40084337 None] Created reservations ['9de25689-55f5-49fe-82cb-5caa5658cc61', 'e45c49d1-26c3-4198-8eaa-17138483c4f2', 'd245218f-0268-4655-a442-9f97ea215c96', '8341912d-2b58-46f8-9e53-0d14b25af1c3'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:47:05 devstack sudo[87130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-999a8d5e-5f61-4a76-9389-d8c0a3d13932.695d95b0-0b86-4655-913a-f60919d0c072
Apr 09 12:47:05 devstack sudo[87130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-6b591207-271a-4123-83df-1a925eccb2ef tempest-ServersNegativeTestJSON-40084337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-6b591207-271a-4123-83df-1a925eccb2ef tempest-ServersNegativeTestJSON-40084337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:05 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-6b591207-271a-4123-83df-1a925eccb2ef tempest-ServersNegativeTestJSON-40084337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:47:05 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-6b591207-271a-4123-83df-1a925eccb2ef tempest-ServersNegativeTestJSON-40084337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:47:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-6b591207-271a-4123-83df-1a925eccb2ef tempest-ServersNegativeTestJSON-40084337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6b591207-271a-4123-83df-1a925eccb2ef tempest-ServersNegativeTestJSON-40084337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:05 devstack sudo[87132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:47:05 devstack sudo[87132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:05 devstack sudo[87130]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-acc90409-7a88-4ef1-9868-00f97febdeae tempest-SnapshotMetadataTestJSON-905008483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-999a8d5e-5f61-4a76-9389-d8c0a3d13932.695d95b0-0b86-4655-913a-f60919d0c072" returned: 0 in 0.614s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:05 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ea502c6a-a6c3-411b-8e7d-be9251fa68a2 tempest-VolumesCloneNegativeTest-1232253563 None] Acquiring lock "cinder-87f08b20-e4ce-4834-bdbd-35a37cd08e16-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:47:05 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-acc90409-7a88-4ef1-9868-00f97febdeae tempest-SnapshotMetadataTestJSON-905008483 None] Lock "cinder-quobyte-695d95b0-0b86-4655-913a-f60919d0c072" released by "_delete_snapshot" :: held 2.622s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:47:05 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ea502c6a-a6c3-411b-8e7d-be9251fa68a2 tempest-VolumesCloneNegativeTest-1232253563 None] Lock "cinder-87f08b20-e4ce-4834-bdbd-35a37cd08e16-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:47:05 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-acc90409-7a88-4ef1-9868-00f97febdeae tempest-SnapshotMetadataTestJSON-905008483 None] Lock "cinder-quobyte-999a8d5e-5f61-4a76-9389-d8c0a3d13932" released by "delete_snapshot" :: held 2.649s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:47:05 devstack sudo[87132]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6b591207-271a-4123-83df-1a925eccb2ef tempest-ServersNegativeTestJSON-40084337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.624s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:05 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-6b591207-271a-4123-83df-1a925eccb2ef tempest-ServersNegativeTestJSON-40084337 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:47:06 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-6b591207-271a-4123-83df-1a925eccb2ef tempest-ServersNegativeTestJSON-40084337 None] Deleted volume successfully.
Apr 09 12:47:06 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-acc90409-7a88-4ef1-9868-00f97febdeae tempest-SnapshotMetadataTestJSON-905008483 None] Created reservations ['5a74f646-9994-4cf4-971a-a5981371ea62', '7d19d3e1-fd6d-465d-a3fb-a6a00005ea04', 'e6318e56-438b-4b8b-8f90-f2799d2e4cf9', '8aaf0f63-8bec-4c05-a788-1f81c529396f'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:47:06 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ea502c6a-a6c3-411b-8e7d-be9251fa68a2 tempest-VolumesCloneNegativeTest-1232253563 None] Acquiring lock "cinder-quobyte-87f08b20-e4ce-4834-bdbd-35a37cd08e16" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:47:06 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-6b591207-271a-4123-83df-1a925eccb2ef tempest-ServersNegativeTestJSON-40084337 None] Lock "cinder-4977ba9e-7fa1-4b45-94d4-47ae28322930-delete_volume" released by "delete_volume" :: held 1.977s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:47:06 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ea502c6a-a6c3-411b-8e7d-be9251fa68a2 tempest-VolumesCloneNegativeTest-1232253563 None] Lock "cinder-quobyte-87f08b20-e4ce-4834-bdbd-35a37cd08e16" acquired by "delete_volume" :: waited 0.024s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:47:06 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4c43af-12fd-43ad-b013-b11688da242c]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:47:06 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ea502c6a-a6c3-411b-8e7d-be9251fa68a2 tempest-VolumesCloneNegativeTest-1232253563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-87f08b20-e4ce-4834-bdbd-35a37cd08e16 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:06 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-acc90409-7a88-4ef1-9868-00f97febdeae tempest-SnapshotMetadataTestJSON-905008483 None] Delete snapshot completed successfully.
Apr 09 12:47:06 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-acc90409-7a88-4ef1-9868-00f97febdeae tempest-SnapshotMetadataTestJSON-905008483 None] Lock "cinder-695d95b0-0b86-4655-913a-f60919d0c072-delete_snapshot" released by "delete_snapshot" :: held 2.809s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:47:06 devstack sudo[87137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-87f08b20-e4ce-4834-bdbd-35a37cd08e16
Apr 09 12:47:06 devstack sudo[87137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:06 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-25e9b4ca-d85a-411f-97e0-a4b7a5749540 tempest-ServersNegativeTestJSON-40084337 None] Acquiring lock "cinder-4c2109ed-8a0b-409c-8738-4acbfc46060e-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:47:06 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-25e9b4ca-d85a-411f-97e0-a4b7a5749540 tempest-ServersNegativeTestJSON-40084337 None] Lock "cinder-4c2109ed-8a0b-409c-8738-4acbfc46060e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:47:06 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-25e9b4ca-d85a-411f-97e0-a4b7a5749540 tempest-ServersNegativeTestJSON-40084337 None] Acquiring lock "cinder-quobyte-4c2109ed-8a0b-409c-8738-4acbfc46060e" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:47:06 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-25e9b4ca-d85a-411f-97e0-a4b7a5749540 tempest-ServersNegativeTestJSON-40084337 None] Lock "cinder-quobyte-4c2109ed-8a0b-409c-8738-4acbfc46060e" acquired by "delete_volume" :: waited 0.010s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:47:06 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[a660c411-2e3d-4861-a7e5-90fb7f455c1c]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:47:06 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-25e9b4ca-d85a-411f-97e0-a4b7a5749540 tempest-ServersNegativeTestJSON-40084337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-4c2109ed-8a0b-409c-8738-4acbfc46060e {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:06 devstack sudo[87139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-4c2109ed-8a0b-409c-8738-4acbfc46060e
Apr 09 12:47:06 devstack sudo[87139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:06 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-9f2ab8b6-45d6-416c-8bec-6d7ab8ac89d6 tempest-SnapshotMetadataTestJSON-905008483 None] Acquiring lock "cinder-999a8d5e-5f61-4a76-9389-d8c0a3d13932-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:47:06 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-9f2ab8b6-45d6-416c-8bec-6d7ab8ac89d6 tempest-SnapshotMetadataTestJSON-905008483 None] Lock "cinder-999a8d5e-5f61-4a76-9389-d8c0a3d13932-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:47:06 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-9f2ab8b6-45d6-416c-8bec-6d7ab8ac89d6 tempest-SnapshotMetadataTestJSON-905008483 None] Acquiring lock "cinder-quobyte-999a8d5e-5f61-4a76-9389-d8c0a3d13932" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:47:06 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-9f2ab8b6-45d6-416c-8bec-6d7ab8ac89d6 tempest-SnapshotMetadataTestJSON-905008483 None] Lock "cinder-quobyte-999a8d5e-5f61-4a76-9389-d8c0a3d13932" acquired by "delete_volume" :: waited 0.008s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:47:06 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[f901fc1b-5b1c-4e3e-a722-d18bc41509bc]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:47:06 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9f2ab8b6-45d6-416c-8bec-6d7ab8ac89d6 tempest-SnapshotMetadataTestJSON-905008483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-999a8d5e-5f61-4a76-9389-d8c0a3d13932 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:06 devstack sudo[87143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-999a8d5e-5f61-4a76-9389-d8c0a3d13932
Apr 09 12:47:06 devstack sudo[87143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:06 devstack sudo[87137]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:06 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ea502c6a-a6c3-411b-8e7d-be9251fa68a2 tempest-VolumesCloneNegativeTest-1232253563 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-87f08b20-e4ce-4834-bdbd-35a37cd08e16" returned: 0 in 0.699s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:06 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ea502c6a-a6c3-411b-8e7d-be9251fa68a2 tempest-VolumesCloneNegativeTest-1232253563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-87f08b20-e4ce-4834-bdbd-35a37cd08e16 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:06 devstack sudo[87146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-87f08b20-e4ce-4834-bdbd-35a37cd08e16
Apr 09 12:47:06 devstack sudo[87146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:07 devstack sudo[87139]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:07 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-25e9b4ca-d85a-411f-97e0-a4b7a5749540 tempest-ServersNegativeTestJSON-40084337 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-4c2109ed-8a0b-409c-8738-4acbfc46060e" returned: 0 in 0.673s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:07 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-25e9b4ca-d85a-411f-97e0-a4b7a5749540 tempest-ServersNegativeTestJSON-40084337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-4c2109ed-8a0b-409c-8738-4acbfc46060e {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:07 devstack sudo[87151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-4c2109ed-8a0b-409c-8738-4acbfc46060e
Apr 09 12:47:07 devstack sudo[87151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:07 devstack sudo[87151]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:07 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-25e9b4ca-d85a-411f-97e0-a4b7a5749540 tempest-ServersNegativeTestJSON-40084337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-4c2109ed-8a0b-409c-8738-4acbfc46060e" returned: 0 in 0.549s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:07 devstack sudo[87143]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:07 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9f2ab8b6-45d6-416c-8bec-6d7ab8ac89d6 tempest-SnapshotMetadataTestJSON-905008483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-999a8d5e-5f61-4a76-9389-d8c0a3d13932" returned: 0 in 0.953s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:07 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9f2ab8b6-45d6-416c-8bec-6d7ab8ac89d6 tempest-SnapshotMetadataTestJSON-905008483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-999a8d5e-5f61-4a76-9389-d8c0a3d13932 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:07 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-25e9b4ca-d85a-411f-97e0-a4b7a5749540 tempest-ServersNegativeTestJSON-40084337 None] Lock "cinder-quobyte-4c2109ed-8a0b-409c-8738-4acbfc46060e" released by "delete_volume" :: held 1.270s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:47:07 devstack sudo[87157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-999a8d5e-5f61-4a76-9389-d8c0a3d13932
Apr 09 12:47:07 devstack sudo[87157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:07 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-25e9b4ca-d85a-411f-97e0-a4b7a5749540 tempest-ServersNegativeTestJSON-40084337 None] Created reservations ['610d6c1c-a79b-4965-84f8-a04d2ed9b6cc', '937922fa-3fca-49f0-b14e-a24b87de90d7', '292c0c77-1a62-444f-afa0-894708cd7159', 'f676d49b-fe6f-4c9a-bdbb-447e5d7698c4'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:47:07 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-25e9b4ca-d85a-411f-97e0-a4b7a5749540 tempest-ServersNegativeTestJSON-40084337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:07 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-25e9b4ca-d85a-411f-97e0-a4b7a5749540 tempest-ServersNegativeTestJSON-40084337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:07 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-25e9b4ca-d85a-411f-97e0-a4b7a5749540 tempest-ServersNegativeTestJSON-40084337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:47:07 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-25e9b4ca-d85a-411f-97e0-a4b7a5749540 tempest-ServersNegativeTestJSON-40084337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:47:07 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-25e9b4ca-d85a-411f-97e0-a4b7a5749540 tempest-ServersNegativeTestJSON-40084337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:07 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-25e9b4ca-d85a-411f-97e0-a4b7a5749540 tempest-ServersNegativeTestJSON-40084337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:07 devstack sudo[87160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:47:07 devstack sudo[87160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:07 devstack sudo[87146]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:07 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ea502c6a-a6c3-411b-8e7d-be9251fa68a2 tempest-VolumesCloneNegativeTest-1232253563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-87f08b20-e4ce-4834-bdbd-35a37cd08e16" returned: 0 in 1.112s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:07 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ea502c6a-a6c3-411b-8e7d-be9251fa68a2 tempest-VolumesCloneNegativeTest-1232253563 None] Lock "cinder-quobyte-87f08b20-e4ce-4834-bdbd-35a37cd08e16" released by "delete_volume" :: held 1.841s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:47:07 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-ea502c6a-a6c3-411b-8e7d-be9251fa68a2 tempest-VolumesCloneNegativeTest-1232253563 None] Created reservations ['da1e5e82-90ef-439c-aabe-6298bf2456fa', 'e906da45-c876-4faa-b60f-54498e40fabf', '89c29bd4-5e76-44a3-913f-5c3532732ca5', 'e511035d-062f-4f80-a407-c644c84b92fe'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:47:07 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ea502c6a-a6c3-411b-8e7d-be9251fa68a2 tempest-VolumesCloneNegativeTest-1232253563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:07 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ea502c6a-a6c3-411b-8e7d-be9251fa68a2 tempest-VolumesCloneNegativeTest-1232253563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:07 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-ea502c6a-a6c3-411b-8e7d-be9251fa68a2 tempest-VolumesCloneNegativeTest-1232253563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:47:08 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-ea502c6a-a6c3-411b-8e7d-be9251fa68a2 tempest-VolumesCloneNegativeTest-1232253563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:47:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ea502c6a-a6c3-411b-8e7d-be9251fa68a2 tempest-VolumesCloneNegativeTest-1232253563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ea502c6a-a6c3-411b-8e7d-be9251fa68a2 tempest-VolumesCloneNegativeTest-1232253563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:08 devstack sudo[87162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:47:08 devstack sudo[87162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:08 devstack sudo[87157]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9f2ab8b6-45d6-416c-8bec-6d7ab8ac89d6 tempest-SnapshotMetadataTestJSON-905008483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-999a8d5e-5f61-4a76-9389-d8c0a3d13932" returned: 0 in 0.687s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:08 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-9f2ab8b6-45d6-416c-8bec-6d7ab8ac89d6 tempest-SnapshotMetadataTestJSON-905008483 None] Lock "cinder-quobyte-999a8d5e-5f61-4a76-9389-d8c0a3d13932" released by "delete_volume" :: held 1.679s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:47:08 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-9f2ab8b6-45d6-416c-8bec-6d7ab8ac89d6 tempest-SnapshotMetadataTestJSON-905008483 None] Created reservations ['d4e97e06-427a-485f-abc6-b9434b1e1f8b', '34080386-67d9-4326-8074-e304e2a99fb8', '2028c675-9e50-488d-b305-8c50303683be', 'ce314ce2-2ea8-4eef-8976-eac5aba39cae'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:47:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-9f2ab8b6-45d6-416c-8bec-6d7ab8ac89d6 tempest-SnapshotMetadataTestJSON-905008483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-9f2ab8b6-45d6-416c-8bec-6d7ab8ac89d6 tempest-SnapshotMetadataTestJSON-905008483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:08 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-9f2ab8b6-45d6-416c-8bec-6d7ab8ac89d6 tempest-SnapshotMetadataTestJSON-905008483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:47:08 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-9f2ab8b6-45d6-416c-8bec-6d7ab8ac89d6 tempest-SnapshotMetadataTestJSON-905008483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:47:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-9f2ab8b6-45d6-416c-8bec-6d7ab8ac89d6 tempest-SnapshotMetadataTestJSON-905008483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9f2ab8b6-45d6-416c-8bec-6d7ab8ac89d6 tempest-SnapshotMetadataTestJSON-905008483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:08 devstack sudo[87166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:47:08 devstack sudo[87166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:08 devstack sudo[87160]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-25e9b4ca-d85a-411f-97e0-a4b7a5749540 tempest-ServersNegativeTestJSON-40084337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.837s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:08 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-25e9b4ca-d85a-411f-97e0-a4b7a5749540 tempest-ServersNegativeTestJSON-40084337 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:47:08 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-25e9b4ca-d85a-411f-97e0-a4b7a5749540 tempest-ServersNegativeTestJSON-40084337 None] Deleted volume successfully.
Apr 09 12:47:08 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-25e9b4ca-d85a-411f-97e0-a4b7a5749540 tempest-ServersNegativeTestJSON-40084337 None] Lock "cinder-4c2109ed-8a0b-409c-8738-4acbfc46060e-delete_volume" released by "delete_volume" :: held 2.282s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:47:08 devstack sudo[87162]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ea502c6a-a6c3-411b-8e7d-be9251fa68a2 tempest-VolumesCloneNegativeTest-1232253563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.890s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:08 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-ea502c6a-a6c3-411b-8e7d-be9251fa68a2 tempest-VolumesCloneNegativeTest-1232253563 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:47:08 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-ea502c6a-a6c3-411b-8e7d-be9251fa68a2 tempest-VolumesCloneNegativeTest-1232253563 None] Deleted volume successfully.
Apr 09 12:47:08 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ea502c6a-a6c3-411b-8e7d-be9251fa68a2 tempest-VolumesCloneNegativeTest-1232253563 None] Lock "cinder-87f08b20-e4ce-4834-bdbd-35a37cd08e16-delete_volume" released by "delete_volume" :: held 2.971s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:47:09 devstack sudo[87166]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9f2ab8b6-45d6-416c-8bec-6d7ab8ac89d6 tempest-SnapshotMetadataTestJSON-905008483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.756s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:09 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-9f2ab8b6-45d6-416c-8bec-6d7ab8ac89d6 tempest-SnapshotMetadataTestJSON-905008483 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:47:09 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-9f2ab8b6-45d6-416c-8bec-6d7ab8ac89d6 tempest-SnapshotMetadataTestJSON-905008483 None] Deleted volume successfully.
Apr 09 12:47:09 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-9f2ab8b6-45d6-416c-8bec-6d7ab8ac89d6 tempest-SnapshotMetadataTestJSON-905008483 None] Lock "cinder-999a8d5e-5f61-4a76-9389-d8c0a3d13932-delete_volume" released by "delete_volume" :: held 2.616s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:47:09 devstack cinder-volume[82760]: DEBUG oslo_service.periodic_task [None req-f8337202-8290-4658-916e-19cfa929172e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82760) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 09 12:47:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f8337202-8290-4658-916e-19cfa929172e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f8337202-8290-4658-916e-19cfa929172e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:09 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f8337202-8290-4658-916e-19cfa929172e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:47:09 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f8337202-8290-4658-916e-19cfa929172e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:47:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f8337202-8290-4658-916e-19cfa929172e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f8337202-8290-4658-916e-19cfa929172e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:09 devstack sudo[87172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:47:09 devstack sudo[87172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:10 devstack sudo[87172]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f8337202-8290-4658-916e-19cfa929172e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.658s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:10 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-f8337202-8290-4658-916e-19cfa929172e None None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:47:10 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-65bec50a-1252-4adb-bea6-f76ca98d286e tempest-VolumesMetadataTest-1226458335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:47:10 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-65bec50a-1252-4adb-bea6-f76ca98d286e tempest-VolumesMetadataTest-1226458335 None] Flow 'volume_create_manager' (d2b8a796-b7d4-4ed3-af2e-4c023eb644e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:47:10 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-65bec50a-1252-4adb-bea6-f76ca98d286e tempest-VolumesMetadataTest-1226458335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f9e61af-5087-4d6f-a071-fc988259c97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:10 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-65bec50a-1252-4adb-bea6-f76ca98d286e tempest-VolumesMetadataTest-1226458335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f9e61af-5087-4d6f-a071-fc988259c97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1370094570',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94c60042-7909-44a3-b387-1093536bb830,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5962d8e0eb604c149933803c66107c35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:47:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:47:10Z,use_quota=True,user_id='94c241e45967410c81f83f20b43bb079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:10 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-65bec50a-1252-4adb-bea6-f76ca98d286e tempest-VolumesMetadataTest-1226458335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1f05d16-8c1c-4d1a-8804-db623d0cef3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:10 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-65bec50a-1252-4adb-bea6-f76ca98d286e tempest-VolumesMetadataTest-1226458335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1f05d16-8c1c-4d1a-8804-db623d0cef3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:10 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-65bec50a-1252-4adb-bea6-f76ca98d286e tempest-VolumesMetadataTest-1226458335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89d39d78-d24e-479a-9662-59858ad229fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:10 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-65bec50a-1252-4adb-bea6-f76ca98d286e tempest-VolumesMetadataTest-1226458335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89d39d78-d24e-479a-9662-59858ad229fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94c60042-7909-44a3-b387-1093536bb830', 'volume_name': 'volume-94c60042-7909-44a3-b387-1093536bb830', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:10 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-65bec50a-1252-4adb-bea6-f76ca98d286e tempest-VolumesMetadataTest-1226458335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e93ce1e4-c5c7-4dec-890c-e216887b6095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:10 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-65bec50a-1252-4adb-bea6-f76ca98d286e tempest-VolumesMetadataTest-1226458335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e93ce1e4-c5c7-4dec-890c-e216887b6095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:10 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-65bec50a-1252-4adb-bea6-f76ca98d286e tempest-VolumesMetadataTest-1226458335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85058266-73c2-4fc3-bb9b-f14138a7be8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:10 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-65bec50a-1252-4adb-bea6-f76ca98d286e tempest-VolumesMetadataTest-1226458335 None] Volume 94c60042-7909-44a3-b387-1093536bb830: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94c60042-7909-44a3-b387-1093536bb830', 'volume_size': 1}
Apr 09 12:47:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-65bec50a-1252-4adb-bea6-f76ca98d286e tempest-VolumesMetadataTest-1226458335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-65bec50a-1252-4adb-bea6-f76ca98d286e tempest-VolumesMetadataTest-1226458335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:10 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-65bec50a-1252-4adb-bea6-f76ca98d286e tempest-VolumesMetadataTest-1226458335 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1370094570',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94c60042-7909-44a3-b387-1093536bb830,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5962d8e0eb604c149933803c66107c35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:47:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:47:10Z,use_quota=True,user_id='94c241e45967410c81f83f20b43bb079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:47:10 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-65bec50a-1252-4adb-bea6-f76ca98d286e tempest-VolumesMetadataTest-1226458335 None] Creating volume 94c60042-7909-44a3-b387-1093536bb830 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:47:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-65bec50a-1252-4adb-bea6-f76ca98d286e tempest-VolumesMetadataTest-1226458335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-65bec50a-1252-4adb-bea6-f76ca98d286e tempest-VolumesMetadataTest-1226458335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:10 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-65bec50a-1252-4adb-bea6-f76ca98d286e tempest-VolumesMetadataTest-1226458335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:47:10 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-65bec50a-1252-4adb-bea6-f76ca98d286e tempest-VolumesMetadataTest-1226458335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:47:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-65bec50a-1252-4adb-bea6-f76ca98d286e tempest-VolumesMetadataTest-1226458335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:10 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-65bec50a-1252-4adb-bea6-f76ca98d286e tempest-VolumesMetadataTest-1226458335 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:47:10 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-65bec50a-1252-4adb-bea6-f76ca98d286e tempest-VolumesMetadataTest-1226458335 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:47:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-65bec50a-1252-4adb-bea6-f76ca98d286e tempest-VolumesMetadataTest-1226458335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94c60042-7909-44a3-b387-1093536bb830 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:10 devstack sudo[87199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94c60042-7909-44a3-b387-1093536bb830 1073741824
Apr 09 12:47:10 devstack sudo[87199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:11 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec1037a4-0ace-4a75-a713-3975f1c1a22e tempest-VolumesGetTest-606996561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:47:11 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ec1037a4-0ace-4a75-a713-3975f1c1a22e tempest-VolumesGetTest-606996561 None] Flow 'volume_create_manager' (47ea9aa5-141c-4a61-aa42-08223cb46204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:47:11 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ec1037a4-0ace-4a75-a713-3975f1c1a22e tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceb7fc72-0063-4b2f-b6f5-f44e6ae10c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:11 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ec1037a4-0ace-4a75-a713-3975f1c1a22e tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceb7fc72-0063-4b2f-b6f5-f44e6ae10c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:47:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-382094694',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=130e1b2c-252c-45e7-8096-0768af5b0dd4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b1e2e15da8734d00b19bb36f846ccfc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:47:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:47:11Z,use_quota=True,user_id='f0fe31af3e8c462da1930eb8650f1836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:11 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ec1037a4-0ace-4a75-a713-3975f1c1a22e tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b977866-b4a9-4f1d-9166-5c5aacd928be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:11 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ec1037a4-0ace-4a75-a713-3975f1c1a22e tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b977866-b4a9-4f1d-9166-5c5aacd928be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:11 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ec1037a4-0ace-4a75-a713-3975f1c1a22e tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2cbd31c-3206-42af-8af3-5fe8e8053484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:11 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ec1037a4-0ace-4a75-a713-3975f1c1a22e tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2cbd31c-3206-42af-8af3-5fe8e8053484) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '130e1b2c-252c-45e7-8096-0768af5b0dd4', 'volume_name': 'volume-130e1b2c-252c-45e7-8096-0768af5b0dd4', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:11 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ec1037a4-0ace-4a75-a713-3975f1c1a22e tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eae9368f-330a-4998-a2bd-b9b7b633dbcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:11 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ec1037a4-0ace-4a75-a713-3975f1c1a22e tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eae9368f-330a-4998-a2bd-b9b7b633dbcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:11 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ec1037a4-0ace-4a75-a713-3975f1c1a22e tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1d4561b-afd1-4833-a837-8cf1b9e110b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:11 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-ec1037a4-0ace-4a75-a713-3975f1c1a22e tempest-VolumesGetTest-606996561 None] Volume 130e1b2c-252c-45e7-8096-0768af5b0dd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-130e1b2c-252c-45e7-8096-0768af5b0dd4', 'volume_size': 1}
Apr 09 12:47:11 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ec1037a4-0ace-4a75-a713-3975f1c1a22e tempest-VolumesGetTest-606996561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:11 devstack sudo[87199]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:11 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-65bec50a-1252-4adb-bea6-f76ca98d286e tempest-VolumesMetadataTest-1226458335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94c60042-7909-44a3-b387-1093536bb830 1073741824" returned: 0 in 0.716s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:11 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-65bec50a-1252-4adb-bea6-f76ca98d286e tempest-VolumesMetadataTest-1226458335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94c60042-7909-44a3-b387-1093536bb830 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:11 devstack sudo[87205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94c60042-7909-44a3-b387-1093536bb830
Apr 09 12:47:11 devstack sudo[87205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:11 devstack sudo[87205]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:11 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-65bec50a-1252-4adb-bea6-f76ca98d286e tempest-VolumesMetadataTest-1226458335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94c60042-7909-44a3-b387-1093536bb830" returned: 0 in 0.518s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:11 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-65bec50a-1252-4adb-bea6-f76ca98d286e tempest-VolumesMetadataTest-1226458335 None] <== create_volume: return (1269ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:47:11 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-65bec50a-1252-4adb-bea6-f76ca98d286e tempest-VolumesMetadataTest-1226458335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.271s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:11 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ec1037a4-0ace-4a75-a713-3975f1c1a22e tempest-VolumesGetTest-606996561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.609s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:11 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-ec1037a4-0ace-4a75-a713-3975f1c1a22e tempest-VolumesGetTest-606996561 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:47:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-382094694',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=130e1b2c-252c-45e7-8096-0768af5b0dd4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b1e2e15da8734d00b19bb36f846ccfc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:47:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:47:11Z,use_quota=True,user_id='f0fe31af3e8c462da1930eb8650f1836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:47:11 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-ec1037a4-0ace-4a75-a713-3975f1c1a22e tempest-VolumesGetTest-606996561 None] Creating volume 130e1b2c-252c-45e7-8096-0768af5b0dd4 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:47:11 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ec1037a4-0ace-4a75-a713-3975f1c1a22e tempest-VolumesGetTest-606996561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:11 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ec1037a4-0ace-4a75-a713-3975f1c1a22e tempest-VolumesGetTest-606996561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:11 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-ec1037a4-0ace-4a75-a713-3975f1c1a22e tempest-VolumesGetTest-606996561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:47:11 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-ec1037a4-0ace-4a75-a713-3975f1c1a22e tempest-VolumesGetTest-606996561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:47:11 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ec1037a4-0ace-4a75-a713-3975f1c1a22e tempest-VolumesGetTest-606996561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:11 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-ec1037a4-0ace-4a75-a713-3975f1c1a22e tempest-VolumesGetTest-606996561 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:47:11 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-ec1037a4-0ace-4a75-a713-3975f1c1a22e tempest-VolumesGetTest-606996561 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:47:11 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ec1037a4-0ace-4a75-a713-3975f1c1a22e tempest-VolumesGetTest-606996561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-130e1b2c-252c-45e7-8096-0768af5b0dd4 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:11 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-65bec50a-1252-4adb-bea6-f76ca98d286e tempest-VolumesMetadataTest-1226458335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85058266-73c2-4fc3-bb9b-f14138a7be8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94c60042-7909-44a3-b387-1093536bb830', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:11 devstack sudo[87210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-130e1b2c-252c-45e7-8096-0768af5b0dd4 1073741824
Apr 09 12:47:11 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-65bec50a-1252-4adb-bea6-f76ca98d286e tempest-VolumesMetadataTest-1226458335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10ebbde8-231b-40a3-830c-baecbdc20436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:11 devstack sudo[87210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:11 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-65bec50a-1252-4adb-bea6-f76ca98d286e tempest-VolumesMetadataTest-1226458335 None] Volume volume-94c60042-7909-44a3-b387-1093536bb830 (94c60042-7909-44a3-b387-1093536bb830): created successfully
Apr 09 12:47:11 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-65bec50a-1252-4adb-bea6-f76ca98d286e tempest-VolumesMetadataTest-1226458335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10ebbde8-231b-40a3-830c-baecbdc20436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:11 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-65bec50a-1252-4adb-bea6-f76ca98d286e tempest-VolumesMetadataTest-1226458335 None] Flow 'volume_create_manager' (d2b8a796-b7d4-4ed3-af2e-4c023eb644e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:47:11 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-65bec50a-1252-4adb-bea6-f76ca98d286e tempest-VolumesMetadataTest-1226458335 None] Created volume successfully.
Apr 09 12:47:11 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-2521f1c4-492d-4351-b0a5-97bebe00d113 tempest-AbsoluteLimitsTests-1649084669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:47:11 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-2521f1c4-492d-4351-b0a5-97bebe00d113 tempest-AbsoluteLimitsTests-1649084669 None] Flow 'volume_create_manager' (c126614e-6ba0-480e-98f9-1b14ab3507fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:47:11 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-2521f1c4-492d-4351-b0a5-97bebe00d113 tempest-AbsoluteLimitsTests-1649084669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1da0fb82-a1d6-4795-9eac-2f6df1f892d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:11 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-2521f1c4-492d-4351-b0a5-97bebe00d113 tempest-AbsoluteLimitsTests-1649084669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1da0fb82-a1d6-4795-9eac-2f6df1f892d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:47:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-275007426',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0dd8a8c-c287-4bb3-8391-eea95bfa22d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87088395b33a48179eed399b7693f8c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:47:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:47:12Z,use_quota=True,user_id='3d6e199553a24883b98e8a443887c8f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:11 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-2521f1c4-492d-4351-b0a5-97bebe00d113 tempest-AbsoluteLimitsTests-1649084669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dd9156e-495a-433b-ac25-682af3af2643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:11 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-2521f1c4-492d-4351-b0a5-97bebe00d113 tempest-AbsoluteLimitsTests-1649084669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dd9156e-495a-433b-ac25-682af3af2643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:11 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-2521f1c4-492d-4351-b0a5-97bebe00d113 tempest-AbsoluteLimitsTests-1649084669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c9d01b6-f6ba-42f2-970a-fdface10c2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:12 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-2521f1c4-492d-4351-b0a5-97bebe00d113 tempest-AbsoluteLimitsTests-1649084669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c9d01b6-f6ba-42f2-970a-fdface10c2aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0dd8a8c-c287-4bb3-8391-eea95bfa22d9', 'volume_name': 'volume-a0dd8a8c-c287-4bb3-8391-eea95bfa22d9', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:12 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-2521f1c4-492d-4351-b0a5-97bebe00d113 tempest-AbsoluteLimitsTests-1649084669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c0e4de3-157b-4fd9-941f-503c0455c186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:12 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-2521f1c4-492d-4351-b0a5-97bebe00d113 tempest-AbsoluteLimitsTests-1649084669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c0e4de3-157b-4fd9-941f-503c0455c186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:12 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-2521f1c4-492d-4351-b0a5-97bebe00d113 tempest-AbsoluteLimitsTests-1649084669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4e59691-c4cc-4aea-a8cc-31dce75228b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:12 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-2521f1c4-492d-4351-b0a5-97bebe00d113 tempest-AbsoluteLimitsTests-1649084669 None] Volume a0dd8a8c-c287-4bb3-8391-eea95bfa22d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0dd8a8c-c287-4bb3-8391-eea95bfa22d9', 'volume_size': 1}
Apr 09 12:47:12 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-2521f1c4-492d-4351-b0a5-97bebe00d113 tempest-AbsoluteLimitsTests-1649084669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:12 devstack sudo[87210]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:12 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ec1037a4-0ace-4a75-a713-3975f1c1a22e tempest-VolumesGetTest-606996561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-130e1b2c-252c-45e7-8096-0768af5b0dd4 1073741824" returned: 0 in 0.564s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:12 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ec1037a4-0ace-4a75-a713-3975f1c1a22e tempest-VolumesGetTest-606996561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-130e1b2c-252c-45e7-8096-0768af5b0dd4 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:12 devstack sudo[87215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-130e1b2c-252c-45e7-8096-0768af5b0dd4
Apr 09 12:47:12 devstack sudo[87215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:12 devstack sudo[87215]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:12 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ec1037a4-0ace-4a75-a713-3975f1c1a22e tempest-VolumesGetTest-606996561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-130e1b2c-252c-45e7-8096-0768af5b0dd4" returned: 0 in 0.519s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:12 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-ec1037a4-0ace-4a75-a713-3975f1c1a22e tempest-VolumesGetTest-606996561 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:47:12 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ec1037a4-0ace-4a75-a713-3975f1c1a22e tempest-VolumesGetTest-606996561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:12 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-2521f1c4-492d-4351-b0a5-97bebe00d113 tempest-AbsoluteLimitsTests-1649084669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.856s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:12 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-2521f1c4-492d-4351-b0a5-97bebe00d113 tempest-AbsoluteLimitsTests-1649084669 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:47:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-275007426',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0dd8a8c-c287-4bb3-8391-eea95bfa22d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87088395b33a48179eed399b7693f8c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:47:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:47:12Z,use_quota=True,user_id='3d6e199553a24883b98e8a443887c8f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:47:12 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-2521f1c4-492d-4351-b0a5-97bebe00d113 tempest-AbsoluteLimitsTests-1649084669 None] Creating volume a0dd8a8c-c287-4bb3-8391-eea95bfa22d9 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:47:12 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-2521f1c4-492d-4351-b0a5-97bebe00d113 tempest-AbsoluteLimitsTests-1649084669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:12 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-2521f1c4-492d-4351-b0a5-97bebe00d113 tempest-AbsoluteLimitsTests-1649084669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:12 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-2521f1c4-492d-4351-b0a5-97bebe00d113 tempest-AbsoluteLimitsTests-1649084669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:47:12 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-2521f1c4-492d-4351-b0a5-97bebe00d113 tempest-AbsoluteLimitsTests-1649084669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:47:12 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-2521f1c4-492d-4351-b0a5-97bebe00d113 tempest-AbsoluteLimitsTests-1649084669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:12 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-2521f1c4-492d-4351-b0a5-97bebe00d113 tempest-AbsoluteLimitsTests-1649084669 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:47:12 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-2521f1c4-492d-4351-b0a5-97bebe00d113 tempest-AbsoluteLimitsTests-1649084669 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:47:12 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2521f1c4-492d-4351-b0a5-97bebe00d113 tempest-AbsoluteLimitsTests-1649084669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a0dd8a8c-c287-4bb3-8391-eea95bfa22d9 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:12 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ec1037a4-0ace-4a75-a713-3975f1c1a22e tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1d4561b-afd1-4833-a837-8cf1b9e110b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-130e1b2c-252c-45e7-8096-0768af5b0dd4', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:12 devstack sudo[87219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a0dd8a8c-c287-4bb3-8391-eea95bfa22d9 1073741824
Apr 09 12:47:12 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ec1037a4-0ace-4a75-a713-3975f1c1a22e tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da69dffa-7e4e-416c-af0a-4b62afc7b8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:12 devstack sudo[87219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:12 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-ec1037a4-0ace-4a75-a713-3975f1c1a22e tempest-VolumesGetTest-606996561 None] Volume volume-130e1b2c-252c-45e7-8096-0768af5b0dd4 (130e1b2c-252c-45e7-8096-0768af5b0dd4): created successfully
Apr 09 12:47:12 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ec1037a4-0ace-4a75-a713-3975f1c1a22e tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da69dffa-7e4e-416c-af0a-4b62afc7b8b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:12 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ec1037a4-0ace-4a75-a713-3975f1c1a22e tempest-VolumesGetTest-606996561 None] Flow 'volume_create_manager' (47ea9aa5-141c-4a61-aa42-08223cb46204) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:47:12 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-ec1037a4-0ace-4a75-a713-3975f1c1a22e tempest-VolumesGetTest-606996561 None] Created volume successfully.
Apr 09 12:47:13 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-d4709125-26e2-4473-af45-66f8c984a419 tempest-VolumesMetadataTest-1226458335 None] Acquiring lock "cinder-94c60042-7909-44a3-b387-1093536bb830-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:47:13 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-d4709125-26e2-4473-af45-66f8c984a419 tempest-VolumesMetadataTest-1226458335 None] Lock "cinder-94c60042-7909-44a3-b387-1093536bb830-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:47:13 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-d4709125-26e2-4473-af45-66f8c984a419 tempest-VolumesMetadataTest-1226458335 None] Acquiring lock "cinder-quobyte-94c60042-7909-44a3-b387-1093536bb830" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:47:13 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-d4709125-26e2-4473-af45-66f8c984a419 tempest-VolumesMetadataTest-1226458335 None] Lock "cinder-quobyte-94c60042-7909-44a3-b387-1093536bb830" acquired by "delete_volume" :: waited 0.008s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:47:13 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f7e378-674f-4faa-bbce-1d3736c67354]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:47:13 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d4709125-26e2-4473-af45-66f8c984a419 tempest-VolumesMetadataTest-1226458335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94c60042-7909-44a3-b387-1093536bb830 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:13 devstack sudo[87221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94c60042-7909-44a3-b387-1093536bb830
Apr 09 12:47:13 devstack sudo[87221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:13 devstack sudo[87219]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:13 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2521f1c4-492d-4351-b0a5-97bebe00d113 tempest-AbsoluteLimitsTests-1649084669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a0dd8a8c-c287-4bb3-8391-eea95bfa22d9 1073741824" returned: 0 in 0.612s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:13 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2521f1c4-492d-4351-b0a5-97bebe00d113 tempest-AbsoluteLimitsTests-1649084669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a0dd8a8c-c287-4bb3-8391-eea95bfa22d9 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:13 devstack sudo[87226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a0dd8a8c-c287-4bb3-8391-eea95bfa22d9
Apr 09 12:47:13 devstack sudo[87226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:13 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-47942c41-01e2-4859-8f34-3bf704afe08f tempest-VolumesGetTest-606996561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:47:13 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-47942c41-01e2-4859-8f34-3bf704afe08f tempest-VolumesGetTest-606996561 None] Flow 'volume_create_manager' (37bedad6-545b-4b10-8363-b63cc03268b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:47:13 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-47942c41-01e2-4859-8f34-3bf704afe08f tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0c6130f-fbd4-4ff2-920f-515c786aee11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:13 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-47942c41-01e2-4859-8f34-3bf704afe08f tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0c6130f-fbd4-4ff2-920f-515c786aee11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:47:14Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1129082761',display_name='tempest-VolumesGetTest-Volume-1832388250',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e1ccec9-fbaf-4573-b29b-58b4ba45fe52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1e2e15da8734d00b19bb36f846ccfc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:47:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:47:14Z,use_quota=True,user_id='f0fe31af3e8c462da1930eb8650f1836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:13 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-47942c41-01e2-4859-8f34-3bf704afe08f tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaaa4c74-65cc-4aad-ab43-24be7dce770d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:13 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-47942c41-01e2-4859-8f34-3bf704afe08f tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaaa4c74-65cc-4aad-ab43-24be7dce770d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:13 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-47942c41-01e2-4859-8f34-3bf704afe08f tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43ea8433-7e69-473a-806a-5bdac5da287f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:13 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-47942c41-01e2-4859-8f34-3bf704afe08f tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43ea8433-7e69-473a-806a-5bdac5da287f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e1ccec9-fbaf-4573-b29b-58b4ba45fe52', 'volume_name': 'volume-0e1ccec9-fbaf-4573-b29b-58b4ba45fe52', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:13 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-47942c41-01e2-4859-8f34-3bf704afe08f tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49ee2c6a-42ad-4ea4-a4d7-09d9cff2c463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:13 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-47942c41-01e2-4859-8f34-3bf704afe08f tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49ee2c6a-42ad-4ea4-a4d7-09d9cff2c463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:13 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-47942c41-01e2-4859-8f34-3bf704afe08f tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e42afd4-8369-419b-bfd6-8c90c7ab75b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:13 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-47942c41-01e2-4859-8f34-3bf704afe08f tempest-VolumesGetTest-606996561 None] Volume 0e1ccec9-fbaf-4573-b29b-58b4ba45fe52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e1ccec9-fbaf-4573-b29b-58b4ba45fe52', 'volume_size': 1}
Apr 09 12:47:13 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-47942c41-01e2-4859-8f34-3bf704afe08f tempest-VolumesGetTest-606996561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:13 devstack sudo[87221]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:13 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d4709125-26e2-4473-af45-66f8c984a419 tempest-VolumesMetadataTest-1226458335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94c60042-7909-44a3-b387-1093536bb830" returned: 0 in 0.628s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:13 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d4709125-26e2-4473-af45-66f8c984a419 tempest-VolumesMetadataTest-1226458335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94c60042-7909-44a3-b387-1093536bb830 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:13 devstack sudo[87231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94c60042-7909-44a3-b387-1093536bb830
Apr 09 12:47:13 devstack sudo[87231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:14 devstack sudo[87226]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2521f1c4-492d-4351-b0a5-97bebe00d113 tempest-AbsoluteLimitsTests-1649084669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a0dd8a8c-c287-4bb3-8391-eea95bfa22d9" returned: 0 in 0.498s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:14 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-2521f1c4-492d-4351-b0a5-97bebe00d113 tempest-AbsoluteLimitsTests-1649084669 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:47:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-2521f1c4-492d-4351-b0a5-97bebe00d113 tempest-AbsoluteLimitsTests-1649084669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-47942c41-01e2-4859-8f34-3bf704afe08f tempest-VolumesGetTest-606996561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.301s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:14 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-47942c41-01e2-4859-8f34-3bf704afe08f tempest-VolumesGetTest-606996561 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:47:14Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1129082761',display_name='tempest-VolumesGetTest-Volume-1832388250',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e1ccec9-fbaf-4573-b29b-58b4ba45fe52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1e2e15da8734d00b19bb36f846ccfc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:47:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:47:14Z,use_quota=True,user_id='f0fe31af3e8c462da1930eb8650f1836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:47:14 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-47942c41-01e2-4859-8f34-3bf704afe08f tempest-VolumesGetTest-606996561 None] Creating volume 0e1ccec9-fbaf-4573-b29b-58b4ba45fe52 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:47:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-47942c41-01e2-4859-8f34-3bf704afe08f tempest-VolumesGetTest-606996561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-47942c41-01e2-4859-8f34-3bf704afe08f tempest-VolumesGetTest-606996561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:14 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-47942c41-01e2-4859-8f34-3bf704afe08f tempest-VolumesGetTest-606996561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:47:14 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-47942c41-01e2-4859-8f34-3bf704afe08f tempest-VolumesGetTest-606996561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:47:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-47942c41-01e2-4859-8f34-3bf704afe08f tempest-VolumesGetTest-606996561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:14 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-47942c41-01e2-4859-8f34-3bf704afe08f tempest-VolumesGetTest-606996561 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:47:14 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-47942c41-01e2-4859-8f34-3bf704afe08f tempest-VolumesGetTest-606996561 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:47:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-47942c41-01e2-4859-8f34-3bf704afe08f tempest-VolumesGetTest-606996561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0e1ccec9-fbaf-4573-b29b-58b4ba45fe52 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:14 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-2521f1c4-492d-4351-b0a5-97bebe00d113 tempest-AbsoluteLimitsTests-1649084669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4e59691-c4cc-4aea-a8cc-31dce75228b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0dd8a8c-c287-4bb3-8391-eea95bfa22d9', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:14 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-2521f1c4-492d-4351-b0a5-97bebe00d113 tempest-AbsoluteLimitsTests-1649084669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6fab219-30e1-4ff1-a4d1-d3eb48226504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:14 devstack sudo[87234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0e1ccec9-fbaf-4573-b29b-58b4ba45fe52 1073741824
Apr 09 12:47:14 devstack sudo[87234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:14 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-2521f1c4-492d-4351-b0a5-97bebe00d113 tempest-AbsoluteLimitsTests-1649084669 None] Volume volume-a0dd8a8c-c287-4bb3-8391-eea95bfa22d9 (a0dd8a8c-c287-4bb3-8391-eea95bfa22d9): created successfully
Apr 09 12:47:14 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-2521f1c4-492d-4351-b0a5-97bebe00d113 tempest-AbsoluteLimitsTests-1649084669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6fab219-30e1-4ff1-a4d1-d3eb48226504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:14 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-2521f1c4-492d-4351-b0a5-97bebe00d113 tempest-AbsoluteLimitsTests-1649084669 None] Flow 'volume_create_manager' (c126614e-6ba0-480e-98f9-1b14ab3507fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:47:14 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-2521f1c4-492d-4351-b0a5-97bebe00d113 tempest-AbsoluteLimitsTests-1649084669 None] Created volume successfully.
Apr 09 12:47:14 devstack sudo[87231]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d4709125-26e2-4473-af45-66f8c984a419 tempest-VolumesMetadataTest-1226458335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94c60042-7909-44a3-b387-1093536bb830" returned: 0 in 0.443s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:14 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-d4709125-26e2-4473-af45-66f8c984a419 tempest-VolumesMetadataTest-1226458335 None] Lock "cinder-quobyte-94c60042-7909-44a3-b387-1093536bb830" released by "delete_volume" :: held 1.106s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:47:14 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-d4709125-26e2-4473-af45-66f8c984a419 tempest-VolumesMetadataTest-1226458335 None] Created reservations ['ba510ba7-7bd8-4aad-9822-e68d8c890b75', 'ffdcdf73-4d30-4e84-a284-7de3ff82a6c7', '56fe69cf-8c6e-4a3d-be44-1a9eaa30ef6f', 'd4c5c865-89df-4b5e-a955-bf0261e87ef4'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:47:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d4709125-26e2-4473-af45-66f8c984a419 tempest-VolumesMetadataTest-1226458335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d4709125-26e2-4473-af45-66f8c984a419 tempest-VolumesMetadataTest-1226458335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:14 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-d4709125-26e2-4473-af45-66f8c984a419 tempest-VolumesMetadataTest-1226458335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:47:14 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-d4709125-26e2-4473-af45-66f8c984a419 tempest-VolumesMetadataTest-1226458335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:47:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d4709125-26e2-4473-af45-66f8c984a419 tempest-VolumesMetadataTest-1226458335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d4709125-26e2-4473-af45-66f8c984a419 tempest-VolumesMetadataTest-1226458335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:14 devstack sudo[87237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:47:14 devstack sudo[87237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:14 devstack sudo[87234]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-47942c41-01e2-4859-8f34-3bf704afe08f tempest-VolumesGetTest-606996561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0e1ccec9-fbaf-4573-b29b-58b4ba45fe52 1073741824" returned: 0 in 0.505s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-47942c41-01e2-4859-8f34-3bf704afe08f tempest-VolumesGetTest-606996561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0e1ccec9-fbaf-4573-b29b-58b4ba45fe52 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:14 devstack sudo[87242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0e1ccec9-fbaf-4573-b29b-58b4ba45fe52
Apr 09 12:47:14 devstack sudo[87242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:14 devstack sudo[87237]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d4709125-26e2-4473-af45-66f8c984a419 tempest-VolumesMetadataTest-1226458335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.452s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:14 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-d4709125-26e2-4473-af45-66f8c984a419 tempest-VolumesMetadataTest-1226458335 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:47:14 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-d4709125-26e2-4473-af45-66f8c984a419 tempest-VolumesMetadataTest-1226458335 None] Deleted volume successfully.
Apr 09 12:47:14 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-d4709125-26e2-4473-af45-66f8c984a419 tempest-VolumesMetadataTest-1226458335 None] Lock "cinder-94c60042-7909-44a3-b387-1093536bb830-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:47:14 devstack sudo[87242]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-47942c41-01e2-4859-8f34-3bf704afe08f tempest-VolumesGetTest-606996561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0e1ccec9-fbaf-4573-b29b-58b4ba45fe52" returned: 0 in 0.431s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:14 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-47942c41-01e2-4859-8f34-3bf704afe08f tempest-VolumesGetTest-606996561 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:47:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-47942c41-01e2-4859-8f34-3bf704afe08f tempest-VolumesGetTest-606996561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-47942c41-01e2-4859-8f34-3bf704afe08f tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e42afd4-8369-419b-bfd6-8c90c7ab75b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e1ccec9-fbaf-4573-b29b-58b4ba45fe52', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-47942c41-01e2-4859-8f34-3bf704afe08f tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d496c76-f728-4dc9-848a-96c095ea1a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:15 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-47942c41-01e2-4859-8f34-3bf704afe08f tempest-VolumesGetTest-606996561 None] Volume volume-0e1ccec9-fbaf-4573-b29b-58b4ba45fe52 (0e1ccec9-fbaf-4573-b29b-58b4ba45fe52): created successfully
Apr 09 12:47:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-47942c41-01e2-4859-8f34-3bf704afe08f tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d496c76-f728-4dc9-848a-96c095ea1a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-47942c41-01e2-4859-8f34-3bf704afe08f tempest-VolumesGetTest-606996561 None] Flow 'volume_create_manager' (37bedad6-545b-4b10-8363-b63cc03268b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:47:15 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-47942c41-01e2-4859-8f34-3bf704afe08f tempest-VolumesGetTest-606996561 None] Created volume successfully.
Apr 09 12:47:15 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ccb70772-b267-4efe-a889-2a39553f280f tempest-AbsoluteLimitsTests-1649084669 None] Acquiring lock "cinder-a0dd8a8c-c287-4bb3-8391-eea95bfa22d9-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:47:15 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ccb70772-b267-4efe-a889-2a39553f280f tempest-AbsoluteLimitsTests-1649084669 None] Lock "cinder-a0dd8a8c-c287-4bb3-8391-eea95bfa22d9-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:47:15 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ccb70772-b267-4efe-a889-2a39553f280f tempest-AbsoluteLimitsTests-1649084669 None] Acquiring lock "cinder-quobyte-a0dd8a8c-c287-4bb3-8391-eea95bfa22d9" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:47:15 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ccb70772-b267-4efe-a889-2a39553f280f tempest-AbsoluteLimitsTests-1649084669 None] Lock "cinder-quobyte-a0dd8a8c-c287-4bb3-8391-eea95bfa22d9" acquired by "delete_volume" :: waited 0.016s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:47:15 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[5995e4ff-7830-4920-a552-a1b5439ee4b7]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:47:15 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ccb70772-b267-4efe-a889-2a39553f280f tempest-AbsoluteLimitsTests-1649084669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a0dd8a8c-c287-4bb3-8391-eea95bfa22d9 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:15 devstack sudo[87246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a0dd8a8c-c287-4bb3-8391-eea95bfa22d9
Apr 09 12:47:15 devstack sudo[87246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:15 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-9e4135c7-b1da-4d53-9e2a-d3e947333b25 tempest-VolumesGetTest-606996561 None] Acquiring lock "cinder-0e1ccec9-fbaf-4573-b29b-58b4ba45fe52-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:47:15 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-9e4135c7-b1da-4d53-9e2a-d3e947333b25 tempest-VolumesGetTest-606996561 None] Lock "cinder-0e1ccec9-fbaf-4573-b29b-58b4ba45fe52-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:47:15 devstack sudo[87246]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:15 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ccb70772-b267-4efe-a889-2a39553f280f tempest-AbsoluteLimitsTests-1649084669 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a0dd8a8c-c287-4bb3-8391-eea95bfa22d9" returned: 0 in 0.658s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:15 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ccb70772-b267-4efe-a889-2a39553f280f tempest-AbsoluteLimitsTests-1649084669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a0dd8a8c-c287-4bb3-8391-eea95bfa22d9 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:16 devstack sudo[87251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a0dd8a8c-c287-4bb3-8391-eea95bfa22d9
Apr 09 12:47:16 devstack sudo[87251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:16 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-9e4135c7-b1da-4d53-9e2a-d3e947333b25 tempest-VolumesGetTest-606996561 None] Acquiring lock "cinder-quobyte-0e1ccec9-fbaf-4573-b29b-58b4ba45fe52" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:47:16 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-9e4135c7-b1da-4d53-9e2a-d3e947333b25 tempest-VolumesGetTest-606996561 None] Lock "cinder-quobyte-0e1ccec9-fbaf-4573-b29b-58b4ba45fe52" acquired by "delete_volume" :: waited 0.015s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:47:16 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e86bfe-cfd6-49c0-9928-dbaf7903e075]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:47:16 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9e4135c7-b1da-4d53-9e2a-d3e947333b25 tempest-VolumesGetTest-606996561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0e1ccec9-fbaf-4573-b29b-58b4ba45fe52 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:16 devstack sudo[87253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0e1ccec9-fbaf-4573-b29b-58b4ba45fe52
Apr 09 12:47:16 devstack sudo[87253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:16 devstack sudo[87251]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:16 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ccb70772-b267-4efe-a889-2a39553f280f tempest-AbsoluteLimitsTests-1649084669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a0dd8a8c-c287-4bb3-8391-eea95bfa22d9" returned: 0 in 0.577s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:16 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ccb70772-b267-4efe-a889-2a39553f280f tempest-AbsoluteLimitsTests-1649084669 None] Lock "cinder-quobyte-a0dd8a8c-c287-4bb3-8391-eea95bfa22d9" released by "delete_volume" :: held 1.263s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:47:16 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-ccb70772-b267-4efe-a889-2a39553f280f tempest-AbsoluteLimitsTests-1649084669 None] Created reservations ['fa555370-95f1-4a20-ac48-9bf9c6eb63b8', '959adf4e-15db-45cd-9751-773756c1d545', 'd62b9de1-dfd2-49b9-809b-da0c44b3714b', '26d60535-9cc5-47dc-9594-ac94c3312c96'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:47:16 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ccb70772-b267-4efe-a889-2a39553f280f tempest-AbsoluteLimitsTests-1649084669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:16 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ccb70772-b267-4efe-a889-2a39553f280f tempest-AbsoluteLimitsTests-1649084669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:16 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-ccb70772-b267-4efe-a889-2a39553f280f tempest-AbsoluteLimitsTests-1649084669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:47:16 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-ccb70772-b267-4efe-a889-2a39553f280f tempest-AbsoluteLimitsTests-1649084669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:47:16 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ccb70772-b267-4efe-a889-2a39553f280f tempest-AbsoluteLimitsTests-1649084669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:16 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ccb70772-b267-4efe-a889-2a39553f280f tempest-AbsoluteLimitsTests-1649084669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:16 devstack sudo[87260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:47:16 devstack sudo[87260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:16 devstack sudo[87253]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:16 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9e4135c7-b1da-4d53-9e2a-d3e947333b25 tempest-VolumesGetTest-606996561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0e1ccec9-fbaf-4573-b29b-58b4ba45fe52" returned: 0 in 0.740s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:16 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9e4135c7-b1da-4d53-9e2a-d3e947333b25 tempest-VolumesGetTest-606996561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0e1ccec9-fbaf-4573-b29b-58b4ba45fe52 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:16 devstack sudo[87262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0e1ccec9-fbaf-4573-b29b-58b4ba45fe52
Apr 09 12:47:16 devstack sudo[87262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:17 devstack sudo[87260]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:17 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ccb70772-b267-4efe-a889-2a39553f280f tempest-AbsoluteLimitsTests-1649084669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.617s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:17 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-ccb70772-b267-4efe-a889-2a39553f280f tempest-AbsoluteLimitsTests-1649084669 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:47:17 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-ccb70772-b267-4efe-a889-2a39553f280f tempest-AbsoluteLimitsTests-1649084669 None] Deleted volume successfully.
Apr 09 12:47:17 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ccb70772-b267-4efe-a889-2a39553f280f tempest-AbsoluteLimitsTests-1649084669 None] Lock "cinder-a0dd8a8c-c287-4bb3-8391-eea95bfa22d9-delete_volume" released by "delete_volume" :: held 2.067s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:47:17 devstack sudo[87262]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:17 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9e4135c7-b1da-4d53-9e2a-d3e947333b25 tempest-VolumesGetTest-606996561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0e1ccec9-fbaf-4573-b29b-58b4ba45fe52" returned: 0 in 0.542s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:17 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-9e4135c7-b1da-4d53-9e2a-d3e947333b25 tempest-VolumesGetTest-606996561 None] Lock "cinder-quobyte-0e1ccec9-fbaf-4573-b29b-58b4ba45fe52" released by "delete_volume" :: held 1.313s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:47:17 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-9e4135c7-b1da-4d53-9e2a-d3e947333b25 tempest-VolumesGetTest-606996561 None] Created reservations ['bdfeafc7-602f-45b6-8f05-6d74feb47c97', '379183d7-5c5a-4142-bf44-9e6da01d9a92', '1e06fcb2-6ba3-454c-a7ee-a4d321f6cbf1', '7d41a07f-66e1-43d7-b31c-780de3377983'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:47:17 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-9e4135c7-b1da-4d53-9e2a-d3e947333b25 tempest-VolumesGetTest-606996561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:17 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-9e4135c7-b1da-4d53-9e2a-d3e947333b25 tempest-VolumesGetTest-606996561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:17 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-9e4135c7-b1da-4d53-9e2a-d3e947333b25 tempest-VolumesGetTest-606996561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:47:17 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-9e4135c7-b1da-4d53-9e2a-d3e947333b25 tempest-VolumesGetTest-606996561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:47:17 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-9e4135c7-b1da-4d53-9e2a-d3e947333b25 tempest-VolumesGetTest-606996561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:17 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9e4135c7-b1da-4d53-9e2a-d3e947333b25 tempest-VolumesGetTest-606996561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:17 devstack sudo[87266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:47:17 devstack sudo[87266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:18 devstack sudo[87266]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9e4135c7-b1da-4d53-9e2a-d3e947333b25 tempest-VolumesGetTest-606996561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.585s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:18 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-9e4135c7-b1da-4d53-9e2a-d3e947333b25 tempest-VolumesGetTest-606996561 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:47:18 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-9e4135c7-b1da-4d53-9e2a-d3e947333b25 tempest-VolumesGetTest-606996561 None] Deleted volume successfully.
Apr 09 12:47:18 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-9e4135c7-b1da-4d53-9e2a-d3e947333b25 tempest-VolumesGetTest-606996561 None] Lock "cinder-0e1ccec9-fbaf-4573-b29b-58b4ba45fe52-delete_volume" released by "delete_volume" :: held 2.137s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:47:18 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-baa922b5-ccb7-4652-9cca-dae15f9725cc tempest-VolumesGetTest-606996561 None] Acquiring lock "cinder-130e1b2c-252c-45e7-8096-0768af5b0dd4-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:47:18 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-baa922b5-ccb7-4652-9cca-dae15f9725cc tempest-VolumesGetTest-606996561 None] Lock "cinder-130e1b2c-252c-45e7-8096-0768af5b0dd4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:47:18 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-baa922b5-ccb7-4652-9cca-dae15f9725cc tempest-VolumesGetTest-606996561 None] Acquiring lock "cinder-quobyte-130e1b2c-252c-45e7-8096-0768af5b0dd4" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:47:18 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-baa922b5-ccb7-4652-9cca-dae15f9725cc tempest-VolumesGetTest-606996561 None] Lock "cinder-quobyte-130e1b2c-252c-45e7-8096-0768af5b0dd4" acquired by "delete_volume" :: waited 0.015s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:47:18 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee0d451-f612-46a7-af75-0f07f1444f43]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:47:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-baa922b5-ccb7-4652-9cca-dae15f9725cc tempest-VolumesGetTest-606996561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-130e1b2c-252c-45e7-8096-0768af5b0dd4 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:18 devstack sudo[87270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-130e1b2c-252c-45e7-8096-0768af5b0dd4
Apr 09 12:47:18 devstack sudo[87270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:18 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f2fef40-c217-4a32-b9b9-8b43bf649e78 tempest-VolumesTransfersV357Test-1712159161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:47:18 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8f2fef40-c217-4a32-b9b9-8b43bf649e78 tempest-VolumesTransfersV357Test-1712159161 None] Flow 'volume_create_manager' (86a64b20-eebc-4ccb-8c69-6037b749a81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:47:18 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8f2fef40-c217-4a32-b9b9-8b43bf649e78 tempest-VolumesTransfersV357Test-1712159161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa42b81c-ee79-441f-8ae3-2da24ffb2848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:18 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8f2fef40-c217-4a32-b9b9-8b43bf649e78 tempest-VolumesTransfersV357Test-1712159161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa42b81c-ee79-441f-8ae3-2da24ffb2848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:47:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1102819539',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97ddb9c4-6467-47db-be45-7b5f3cfdc423,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63b787d35ac6405f82e101da910a7b30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:47:19Z,use_quota=True,user_id='22e9ef3e551a4c1594bcb192f494f522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:18 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8f2fef40-c217-4a32-b9b9-8b43bf649e78 tempest-VolumesTransfersV357Test-1712159161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a75d727-8ce6-4453-8ddf-d7535d93c8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:18 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8f2fef40-c217-4a32-b9b9-8b43bf649e78 tempest-VolumesTransfersV357Test-1712159161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a75d727-8ce6-4453-8ddf-d7535d93c8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:18 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8f2fef40-c217-4a32-b9b9-8b43bf649e78 tempest-VolumesTransfersV357Test-1712159161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60f3e97a-7cca-43fb-b2b0-bfbc09abf210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:18 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8f2fef40-c217-4a32-b9b9-8b43bf649e78 tempest-VolumesTransfersV357Test-1712159161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60f3e97a-7cca-43fb-b2b0-bfbc09abf210) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97ddb9c4-6467-47db-be45-7b5f3cfdc423', 'volume_name': 'volume-97ddb9c4-6467-47db-be45-7b5f3cfdc423', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:18 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8f2fef40-c217-4a32-b9b9-8b43bf649e78 tempest-VolumesTransfersV357Test-1712159161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6938fc9c-c4b5-4ccc-a983-9033ad4205b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:18 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8f2fef40-c217-4a32-b9b9-8b43bf649e78 tempest-VolumesTransfersV357Test-1712159161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6938fc9c-c4b5-4ccc-a983-9033ad4205b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:18 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8f2fef40-c217-4a32-b9b9-8b43bf649e78 tempest-VolumesTransfersV357Test-1712159161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dcb0f33-3b7e-4459-86d4-dec61821f847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:18 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-8f2fef40-c217-4a32-b9b9-8b43bf649e78 tempest-VolumesTransfersV357Test-1712159161 None] Volume 97ddb9c4-6467-47db-be45-7b5f3cfdc423: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97ddb9c4-6467-47db-be45-7b5f3cfdc423', 'volume_size': 1}
Apr 09 12:47:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-8f2fef40-c217-4a32-b9b9-8b43bf649e78 tempest-VolumesTransfersV357Test-1712159161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-8f2fef40-c217-4a32-b9b9-8b43bf649e78 tempest-VolumesTransfersV357Test-1712159161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:18 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-8f2fef40-c217-4a32-b9b9-8b43bf649e78 tempest-VolumesTransfersV357Test-1712159161 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:47:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1102819539',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97ddb9c4-6467-47db-be45-7b5f3cfdc423,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63b787d35ac6405f82e101da910a7b30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:47:19Z,use_quota=True,user_id='22e9ef3e551a4c1594bcb192f494f522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:47:18 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-8f2fef40-c217-4a32-b9b9-8b43bf649e78 tempest-VolumesTransfersV357Test-1712159161 None] Creating volume 97ddb9c4-6467-47db-be45-7b5f3cfdc423 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:47:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-8f2fef40-c217-4a32-b9b9-8b43bf649e78 tempest-VolumesTransfersV357Test-1712159161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-8f2fef40-c217-4a32-b9b9-8b43bf649e78 tempest-VolumesTransfersV357Test-1712159161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:18 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-8f2fef40-c217-4a32-b9b9-8b43bf649e78 tempest-VolumesTransfersV357Test-1712159161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:47:18 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-8f2fef40-c217-4a32-b9b9-8b43bf649e78 tempest-VolumesTransfersV357Test-1712159161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:47:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-8f2fef40-c217-4a32-b9b9-8b43bf649e78 tempest-VolumesTransfersV357Test-1712159161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:18 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-8f2fef40-c217-4a32-b9b9-8b43bf649e78 tempest-VolumesTransfersV357Test-1712159161 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:47:18 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-8f2fef40-c217-4a32-b9b9-8b43bf649e78 tempest-VolumesTransfersV357Test-1712159161 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:47:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-8f2fef40-c217-4a32-b9b9-8b43bf649e78 tempest-VolumesTransfersV357Test-1712159161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-97ddb9c4-6467-47db-be45-7b5f3cfdc423 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:18 devstack sudo[87274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-97ddb9c4-6467-47db-be45-7b5f3cfdc423 1073741824
Apr 09 12:47:18 devstack sudo[87274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:19 devstack sudo[87270]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-baa922b5-ccb7-4652-9cca-dae15f9725cc tempest-VolumesGetTest-606996561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-130e1b2c-252c-45e7-8096-0768af5b0dd4" returned: 0 in 0.675s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-baa922b5-ccb7-4652-9cca-dae15f9725cc tempest-VolumesGetTest-606996561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-130e1b2c-252c-45e7-8096-0768af5b0dd4 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:19 devstack sudo[87277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-130e1b2c-252c-45e7-8096-0768af5b0dd4
Apr 09 12:47:19 devstack sudo[87277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:19 devstack sudo[87277]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-baa922b5-ccb7-4652-9cca-dae15f9725cc tempest-VolumesGetTest-606996561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-130e1b2c-252c-45e7-8096-0768af5b0dd4" returned: 0 in 0.584s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:19 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-baa922b5-ccb7-4652-9cca-dae15f9725cc tempest-VolumesGetTest-606996561 None] Lock "cinder-quobyte-130e1b2c-252c-45e7-8096-0768af5b0dd4" released by "delete_volume" :: held 1.302s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:47:19 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-baa922b5-ccb7-4652-9cca-dae15f9725cc tempest-VolumesGetTest-606996561 None] Created reservations ['0b0ce005-49e6-480e-ad89-92d093709cc6', '84a6e368-4040-4210-b660-c9c6374fd449', 'ac2ccd35-a0fa-4bff-badf-f9f8d96af990', 'a44cb5bc-da0f-412b-9127-a27020e831f1'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:47:19 devstack sudo[87274]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-8f2fef40-c217-4a32-b9b9-8b43bf649e78 tempest-VolumesTransfersV357Test-1712159161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-97ddb9c4-6467-47db-be45-7b5f3cfdc423 1073741824" returned: 0 in 0.870s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-8f2fef40-c217-4a32-b9b9-8b43bf649e78 tempest-VolumesTransfersV357Test-1712159161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-97ddb9c4-6467-47db-be45-7b5f3cfdc423 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-baa922b5-ccb7-4652-9cca-dae15f9725cc tempest-VolumesGetTest-606996561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-baa922b5-ccb7-4652-9cca-dae15f9725cc tempest-VolumesGetTest-606996561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:19 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-baa922b5-ccb7-4652-9cca-dae15f9725cc tempest-VolumesGetTest-606996561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:47:19 devstack sudo[87283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-97ddb9c4-6467-47db-be45-7b5f3cfdc423
Apr 09 12:47:19 devstack sudo[87283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:19 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-baa922b5-ccb7-4652-9cca-dae15f9725cc tempest-VolumesGetTest-606996561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:47:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-baa922b5-ccb7-4652-9cca-dae15f9725cc tempest-VolumesGetTest-606996561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-baa922b5-ccb7-4652-9cca-dae15f9725cc tempest-VolumesGetTest-606996561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:19 devstack sudo[87285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:47:19 devstack sudo[87285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:20 devstack sudo[87283]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:20 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-8f2fef40-c217-4a32-b9b9-8b43bf649e78 tempest-VolumesTransfersV357Test-1712159161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-97ddb9c4-6467-47db-be45-7b5f3cfdc423" returned: 0 in 0.510s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:20 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-8f2fef40-c217-4a32-b9b9-8b43bf649e78 tempest-VolumesTransfersV357Test-1712159161 None] <== create_volume: return (1424ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:47:20 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-8f2fef40-c217-4a32-b9b9-8b43bf649e78 tempest-VolumesTransfersV357Test-1712159161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.429s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:20 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8f2fef40-c217-4a32-b9b9-8b43bf649e78 tempest-VolumesTransfersV357Test-1712159161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dcb0f33-3b7e-4459-86d4-dec61821f847) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97ddb9c4-6467-47db-be45-7b5f3cfdc423', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:20 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8f2fef40-c217-4a32-b9b9-8b43bf649e78 tempest-VolumesTransfersV357Test-1712159161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db89f595-3aed-4751-b619-287abe0d6a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:20 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-8f2fef40-c217-4a32-b9b9-8b43bf649e78 tempest-VolumesTransfersV357Test-1712159161 None] Volume volume-97ddb9c4-6467-47db-be45-7b5f3cfdc423 (97ddb9c4-6467-47db-be45-7b5f3cfdc423): created successfully
Apr 09 12:47:20 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8f2fef40-c217-4a32-b9b9-8b43bf649e78 tempest-VolumesTransfersV357Test-1712159161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db89f595-3aed-4751-b619-287abe0d6a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:20 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8f2fef40-c217-4a32-b9b9-8b43bf649e78 tempest-VolumesTransfersV357Test-1712159161 None] Flow 'volume_create_manager' (86a64b20-eebc-4ccb-8c69-6037b749a81c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:47:20 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-8f2fef40-c217-4a32-b9b9-8b43bf649e78 tempest-VolumesTransfersV357Test-1712159161 None] Created volume successfully.
Apr 09 12:47:20 devstack sudo[87285]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:20 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-baa922b5-ccb7-4652-9cca-dae15f9725cc tempest-VolumesGetTest-606996561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.655s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:20 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-baa922b5-ccb7-4652-9cca-dae15f9725cc tempest-VolumesGetTest-606996561 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:47:20 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-baa922b5-ccb7-4652-9cca-dae15f9725cc tempest-VolumesGetTest-606996561 None] Deleted volume successfully.
Apr 09 12:47:20 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-baa922b5-ccb7-4652-9cca-dae15f9725cc tempest-VolumesGetTest-606996561 None] Lock "cinder-130e1b2c-252c-45e7-8096-0768af5b0dd4-delete_volume" released by "delete_volume" :: held 2.195s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:47:20 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-f29486ee-efa5-4824-893d-7f96ec63aa58 tempest-VolumesGetTest-606996561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:47:20 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f29486ee-efa5-4824-893d-7f96ec63aa58 tempest-VolumesGetTest-606996561 None] Flow 'volume_create_manager' (5b55635f-d7bf-4b12-93d0-e78399cc3c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:47:20 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f29486ee-efa5-4824-893d-7f96ec63aa58 tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4d12798-6532-4c90-894f-824a6749a618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:20 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f29486ee-efa5-4824-893d-7f96ec63aa58 tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4d12798-6532-4c90-894f-824a6749a618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1631692047',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94ef36e6-a7db-4e18-861f-6c9b2c132018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1e2e15da8734d00b19bb36f846ccfc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:47:21Z,use_quota=True,user_id='f0fe31af3e8c462da1930eb8650f1836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:20 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f29486ee-efa5-4824-893d-7f96ec63aa58 tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6793e88-9f13-4c5a-8ea5-0e492d5d98bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:20 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f29486ee-efa5-4824-893d-7f96ec63aa58 tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6793e88-9f13-4c5a-8ea5-0e492d5d98bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:20 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f29486ee-efa5-4824-893d-7f96ec63aa58 tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb1b068b-0757-4987-b396-12c763e9ed05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:20 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f29486ee-efa5-4824-893d-7f96ec63aa58 tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb1b068b-0757-4987-b396-12c763e9ed05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94ef36e6-a7db-4e18-861f-6c9b2c132018', 'volume_name': 'volume-94ef36e6-a7db-4e18-861f-6c9b2c132018', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:20 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f29486ee-efa5-4824-893d-7f96ec63aa58 tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c737a05-2002-48d0-b167-810e018db4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:20 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f29486ee-efa5-4824-893d-7f96ec63aa58 tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c737a05-2002-48d0-b167-810e018db4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:20 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f29486ee-efa5-4824-893d-7f96ec63aa58 tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b06afed-84f6-4443-ab91-cc6f6f31f283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:20 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-f29486ee-efa5-4824-893d-7f96ec63aa58 tempest-VolumesGetTest-606996561 None] Volume 94ef36e6-a7db-4e18-861f-6c9b2c132018: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94ef36e6-a7db-4e18-861f-6c9b2c132018', 'volume_size': 1}
Apr 09 12:47:20 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f29486ee-efa5-4824-893d-7f96ec63aa58 tempest-VolumesGetTest-606996561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:20 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f29486ee-efa5-4824-893d-7f96ec63aa58 tempest-VolumesGetTest-606996561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:20 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f29486ee-efa5-4824-893d-7f96ec63aa58 tempest-VolumesGetTest-606996561 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1631692047',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94ef36e6-a7db-4e18-861f-6c9b2c132018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1e2e15da8734d00b19bb36f846ccfc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:47:21Z,use_quota=True,user_id='f0fe31af3e8c462da1930eb8650f1836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:47:20 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-f29486ee-efa5-4824-893d-7f96ec63aa58 tempest-VolumesGetTest-606996561 None] Creating volume 94ef36e6-a7db-4e18-861f-6c9b2c132018 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:47:20 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f29486ee-efa5-4824-893d-7f96ec63aa58 tempest-VolumesGetTest-606996561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:20 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f29486ee-efa5-4824-893d-7f96ec63aa58 tempest-VolumesGetTest-606996561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:20 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f29486ee-efa5-4824-893d-7f96ec63aa58 tempest-VolumesGetTest-606996561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:47:20 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f29486ee-efa5-4824-893d-7f96ec63aa58 tempest-VolumesGetTest-606996561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:47:20 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f29486ee-efa5-4824-893d-7f96ec63aa58 tempest-VolumesGetTest-606996561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:20 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f29486ee-efa5-4824-893d-7f96ec63aa58 tempest-VolumesGetTest-606996561 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:47:20 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-f29486ee-efa5-4824-893d-7f96ec63aa58 tempest-VolumesGetTest-606996561 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:47:20 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f29486ee-efa5-4824-893d-7f96ec63aa58 tempest-VolumesGetTest-606996561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:20 devstack sudo[87289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018 1073741824
Apr 09 12:47:20 devstack sudo[87289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:21 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-72ff419e-0f51-404e-9512-8150f2d87af4 tempest-VolumesTransfersV357Test-1799886038 None] Transfer volume completed successfully.
Apr 09 12:47:21 devstack sudo[87289]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:21 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f29486ee-efa5-4824-893d-7f96ec63aa58 tempest-VolumesGetTest-606996561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018 1073741824" returned: 0 in 0.688s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:21 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f29486ee-efa5-4824-893d-7f96ec63aa58 tempest-VolumesGetTest-606996561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:21 devstack sudo[87296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018
Apr 09 12:47:21 devstack sudo[87296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:22 devstack sudo[87296]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:22 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f29486ee-efa5-4824-893d-7f96ec63aa58 tempest-VolumesGetTest-606996561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018" returned: 0 in 0.584s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:22 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f29486ee-efa5-4824-893d-7f96ec63aa58 tempest-VolumesGetTest-606996561 None] <== create_volume: return (1303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:47:22 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f29486ee-efa5-4824-893d-7f96ec63aa58 tempest-VolumesGetTest-606996561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.305s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:22 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f29486ee-efa5-4824-893d-7f96ec63aa58 tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b06afed-84f6-4443-ab91-cc6f6f31f283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94ef36e6-a7db-4e18-861f-6c9b2c132018', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:22 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f29486ee-efa5-4824-893d-7f96ec63aa58 tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36fa4c32-8148-48ec-80e4-e9362512c6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:22 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-f29486ee-efa5-4824-893d-7f96ec63aa58 tempest-VolumesGetTest-606996561 None] Volume volume-94ef36e6-a7db-4e18-861f-6c9b2c132018 (94ef36e6-a7db-4e18-861f-6c9b2c132018): created successfully
Apr 09 12:47:22 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f29486ee-efa5-4824-893d-7f96ec63aa58 tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36fa4c32-8148-48ec-80e4-e9362512c6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:22 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f29486ee-efa5-4824-893d-7f96ec63aa58 tempest-VolumesGetTest-606996561 None] Flow 'volume_create_manager' (5b55635f-d7bf-4b12-93d0-e78399cc3c0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:47:22 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-f29486ee-efa5-4824-893d-7f96ec63aa58 tempest-VolumesGetTest-606996561 None] Created volume successfully.
Apr 09 12:47:22 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-2f52ee5b-ed55-4439-ade4-06f5c9b7f8fe tempest-VolumesTransfersV357Test-1974738946 None] Acquiring lock "cinder-97ddb9c4-6467-47db-be45-7b5f3cfdc423-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:47:22 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-2f52ee5b-ed55-4439-ade4-06f5c9b7f8fe tempest-VolumesTransfersV357Test-1974738946 None] Lock "cinder-97ddb9c4-6467-47db-be45-7b5f3cfdc423-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:47:22 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-2f52ee5b-ed55-4439-ade4-06f5c9b7f8fe tempest-VolumesTransfersV357Test-1974738946 None] Acquiring lock "cinder-quobyte-97ddb9c4-6467-47db-be45-7b5f3cfdc423" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:47:22 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-2f52ee5b-ed55-4439-ade4-06f5c9b7f8fe tempest-VolumesTransfersV357Test-1974738946 None] Lock "cinder-quobyte-97ddb9c4-6467-47db-be45-7b5f3cfdc423" acquired by "delete_volume" :: waited 0.008s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:47:22 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[07bf2ff5-e0d8-4695-85b8-e8e5f24f9295]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:47:22 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2f52ee5b-ed55-4439-ade4-06f5c9b7f8fe tempest-VolumesTransfersV357Test-1974738946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-97ddb9c4-6467-47db-be45-7b5f3cfdc423 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:22 devstack sudo[87300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-97ddb9c4-6467-47db-be45-7b5f3cfdc423
Apr 09 12:47:22 devstack sudo[87300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:22 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d374acb-133d-4c09-938c-9c4f15733e86 tempest-VolumesTransfersTest-1179101258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:47:22 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-6d374acb-133d-4c09-938c-9c4f15733e86 tempest-VolumesTransfersTest-1179101258 None] Flow 'volume_create_manager' (026ef2b1-e958-48f1-ba5e-2bb6bab1d287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:47:22 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-6d374acb-133d-4c09-938c-9c4f15733e86 tempest-VolumesTransfersTest-1179101258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (312b46c2-6908-48d8-9fca-ac3693c72d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:22 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-6d374acb-133d-4c09-938c-9c4f15733e86 tempest-VolumesTransfersTest-1179101258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (312b46c2-6908-48d8-9fca-ac3693c72d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:47:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1040169644',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=634a18ef-e4c3-4ae9-bf70-4fb3e3936b10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d266467826564c6b9b3dc7b4cff00578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:47:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:47:23Z,use_quota=True,user_id='5d0da29b1b2e43598361bc05ea1f49c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:22 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-6d374acb-133d-4c09-938c-9c4f15733e86 tempest-VolumesTransfersTest-1179101258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61bcffb2-f676-4f03-b4d5-b5b01dfe5f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:22 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-6d374acb-133d-4c09-938c-9c4f15733e86 tempest-VolumesTransfersTest-1179101258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61bcffb2-f676-4f03-b4d5-b5b01dfe5f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:22 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-6d374acb-133d-4c09-938c-9c4f15733e86 tempest-VolumesTransfersTest-1179101258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a8761f0-dc6e-4454-aee6-95001b7de15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:22 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-6d374acb-133d-4c09-938c-9c4f15733e86 tempest-VolumesTransfersTest-1179101258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a8761f0-dc6e-4454-aee6-95001b7de15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '634a18ef-e4c3-4ae9-bf70-4fb3e3936b10', 'volume_name': 'volume-634a18ef-e4c3-4ae9-bf70-4fb3e3936b10', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:22 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-6d374acb-133d-4c09-938c-9c4f15733e86 tempest-VolumesTransfersTest-1179101258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (090b822b-2a7c-4635-af19-5e4d0b774f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:22 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-6d374acb-133d-4c09-938c-9c4f15733e86 tempest-VolumesTransfersTest-1179101258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (090b822b-2a7c-4635-af19-5e4d0b774f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:22 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-6d374acb-133d-4c09-938c-9c4f15733e86 tempest-VolumesTransfersTest-1179101258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (015e9d37-e9e4-4a54-a838-136aceb050ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:22 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-6d374acb-133d-4c09-938c-9c4f15733e86 tempest-VolumesTransfersTest-1179101258 None] Volume 634a18ef-e4c3-4ae9-bf70-4fb3e3936b10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-634a18ef-e4c3-4ae9-bf70-4fb3e3936b10', 'volume_size': 1}
Apr 09 12:47:22 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-6d374acb-133d-4c09-938c-9c4f15733e86 tempest-VolumesTransfersTest-1179101258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:22 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-6d374acb-133d-4c09-938c-9c4f15733e86 tempest-VolumesTransfersTest-1179101258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:22 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-6d374acb-133d-4c09-938c-9c4f15733e86 tempest-VolumesTransfersTest-1179101258 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:47:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1040169644',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=634a18ef-e4c3-4ae9-bf70-4fb3e3936b10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d266467826564c6b9b3dc7b4cff00578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:47:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:47:23Z,use_quota=True,user_id='5d0da29b1b2e43598361bc05ea1f49c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:47:22 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-6d374acb-133d-4c09-938c-9c4f15733e86 tempest-VolumesTransfersTest-1179101258 None] Creating volume 634a18ef-e4c3-4ae9-bf70-4fb3e3936b10 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:47:22 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-6d374acb-133d-4c09-938c-9c4f15733e86 tempest-VolumesTransfersTest-1179101258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:22 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-6d374acb-133d-4c09-938c-9c4f15733e86 tempest-VolumesTransfersTest-1179101258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:22 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-6d374acb-133d-4c09-938c-9c4f15733e86 tempest-VolumesTransfersTest-1179101258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:47:22 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-6d374acb-133d-4c09-938c-9c4f15733e86 tempest-VolumesTransfersTest-1179101258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:47:22 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-6d374acb-133d-4c09-938c-9c4f15733e86 tempest-VolumesTransfersTest-1179101258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:22 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-6d374acb-133d-4c09-938c-9c4f15733e86 tempest-VolumesTransfersTest-1179101258 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:47:22 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-6d374acb-133d-4c09-938c-9c4f15733e86 tempest-VolumesTransfersTest-1179101258 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:47:22 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6d374acb-133d-4c09-938c-9c4f15733e86 tempest-VolumesTransfersTest-1179101258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-634a18ef-e4c3-4ae9-bf70-4fb3e3936b10 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:22 devstack sudo[87302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-634a18ef-e4c3-4ae9-bf70-4fb3e3936b10 1073741824
Apr 09 12:47:22 devstack sudo[87302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:22 devstack sudo[87300]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:22 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2f52ee5b-ed55-4439-ade4-06f5c9b7f8fe tempest-VolumesTransfersV357Test-1974738946 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-97ddb9c4-6467-47db-be45-7b5f3cfdc423" returned: 0 in 0.541s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:22 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2f52ee5b-ed55-4439-ade4-06f5c9b7f8fe tempest-VolumesTransfersV357Test-1974738946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-97ddb9c4-6467-47db-be45-7b5f3cfdc423 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:23 devstack sudo[87313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-97ddb9c4-6467-47db-be45-7b5f3cfdc423
Apr 09 12:47:23 devstack sudo[87313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:23 devstack sudo[87302]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:23 devstack sudo[87313]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2f52ee5b-ed55-4439-ade4-06f5c9b7f8fe tempest-VolumesTransfersV357Test-1974738946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-97ddb9c4-6467-47db-be45-7b5f3cfdc423" returned: 0 in 0.476s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6d374acb-133d-4c09-938c-9c4f15733e86 tempest-VolumesTransfersTest-1179101258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-634a18ef-e4c3-4ae9-bf70-4fb3e3936b10 1073741824" returned: 0 in 0.779s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:23 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:47:23 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-2f52ee5b-ed55-4439-ade4-06f5c9b7f8fe tempest-VolumesTransfersV357Test-1974738946 None] Lock "cinder-quobyte-97ddb9c4-6467-47db-be45-7b5f3cfdc423" released by "delete_volume" :: held 1.073s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:47:23 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] Flow 'volume_create_manager' (af638dff-d9a6-479a-affe-5e4465d9c141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:47:23 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fded843-47bc-4e81-a0a7-e35843391c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6d374acb-133d-4c09-938c-9c4f15733e86 tempest-VolumesTransfersTest-1179101258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-634a18ef-e4c3-4ae9-bf70-4fb3e3936b10 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:23 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fded843-47bc-4e81-a0a7-e35843391c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:47:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2142190605',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f79006d-9280-46f5-a521-3163d2b1f462,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b1e2e15da8734d00b19bb36f846ccfc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:47:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=94ef36e6-a7db-4e18-861f-6c9b2c132018,status='creating',terminated_at=None,updated_at=2026-04-09T10:47:23Z,use_quota=True,user_id='f0fe31af3e8c462da1930eb8650f1836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:23 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (354e855f-fd65-43b0-89ba-964b6428e048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:23 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (354e855f-fd65-43b0-89ba-964b6428e048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:23 devstack sudo[87319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-634a18ef-e4c3-4ae9-bf70-4fb3e3936b10
Apr 09 12:47:23 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd998594-1aef-4b22-809b-a0e18fb35302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:23 devstack sudo[87319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:23 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd998594-1aef-4b22-809b-a0e18fb35302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '3f79006d-9280-46f5-a521-3163d2b1f462', 'volume_name': 'volume-3f79006d-9280-46f5-a521-3163d2b1f462', 'volume_size': 1, 'source_volid': '94ef36e6-a7db-4e18-861f-6c9b2c132018', 'source_volstatus': 'available'}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:23 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0fa1ea9-d68d-47c5-a15f-875ef1f9fdb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:23 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0fa1ea9-d68d-47c5-a15f-875ef1f9fdb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:23 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39778605-558a-414d-b69a-076d9ce3ac6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:23 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] Volume 3f79006d-9280-46f5-a521-3163d2b1f462: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-3f79006d-9280-46f5-a521-3163d2b1f462', 'volume_size': 1, 'source_volid': '94ef36e6-a7db-4e18-861f-6c9b2c132018', 'source_volstatus': 'available'}
Apr 09 12:47:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:23 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-2f52ee5b-ed55-4439-ade4-06f5c9b7f8fe tempest-VolumesTransfersV357Test-1974738946 None] Created reservations ['96775228-9a94-48b9-b7b3-877d49879b1f', '6f4a3174-2e6f-4da5-9580-aa9742943988', 'a1b3e150-5edc-44f2-b896-5751472b6f66', 'b3642081-3574-43a0-b1c4-b8087790e5bf'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:47:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-2f52ee5b-ed55-4439-ade4-06f5c9b7f8fe tempest-VolumesTransfersV357Test-1974738946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-2f52ee5b-ed55-4439-ade4-06f5c9b7f8fe tempest-VolumesTransfersV357Test-1974738946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:23 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-2f52ee5b-ed55-4439-ade4-06f5c9b7f8fe tempest-VolumesTransfersV357Test-1974738946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:47:23 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-2f52ee5b-ed55-4439-ade4-06f5c9b7f8fe tempest-VolumesTransfersV357Test-1974738946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:47:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-2f52ee5b-ed55-4439-ade4-06f5c9b7f8fe tempest-VolumesTransfersV357Test-1974738946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2f52ee5b-ed55-4439-ade4-06f5c9b7f8fe tempest-VolumesTransfersV357Test-1974738946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:23 devstack sudo[87321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:47:23 devstack sudo[87321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:24 devstack sudo[87319]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6d374acb-133d-4c09-938c-9c4f15733e86 tempest-VolumesTransfersTest-1179101258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-634a18ef-e4c3-4ae9-bf70-4fb3e3936b10" returned: 0 in 0.522s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:24 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-6d374acb-133d-4c09-938c-9c4f15733e86 tempest-VolumesTransfersTest-1179101258 None] <== create_volume: return (1389ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:47:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-6d374acb-133d-4c09-938c-9c4f15733e86 tempest-VolumesTransfersTest-1179101258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.391s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.452s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:24 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] Cloning volume 94ef36e6-a7db-4e18-861f-6c9b2c132018 to volume 3f79006d-9280-46f5-a521-3163d2b1f462
Apr 09 12:47:24 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-6d374acb-133d-4c09-938c-9c4f15733e86 tempest-VolumesTransfersTest-1179101258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (015e9d37-e9e4-4a54-a838-136aceb050ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-634a18ef-e4c3-4ae9-bf70-4fb3e3936b10', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:24 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-6d374acb-133d-4c09-938c-9c4f15733e86 tempest-VolumesTransfersTest-1179101258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7052442c-fa8f-4791-b372-48e8d6f63867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:24 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-6d374acb-133d-4c09-938c-9c4f15733e86 tempest-VolumesTransfersTest-1179101258 None] Volume volume-634a18ef-e4c3-4ae9-bf70-4fb3e3936b10 (634a18ef-e4c3-4ae9-bf70-4fb3e3936b10): created successfully
Apr 09 12:47:24 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-6d374acb-133d-4c09-938c-9c4f15733e86 tempest-VolumesTransfersTest-1179101258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7052442c-fa8f-4791-b372-48e8d6f63867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:24 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-6d374acb-133d-4c09-938c-9c4f15733e86 tempest-VolumesTransfersTest-1179101258 None] Flow 'volume_create_manager' (026ef2b1-e958-48f1-ba5e-2bb6bab1d287) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:47:24 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] Creating offline snapshot 901aa445-40b0-40ca-a1d3-c8c4a9c0193a of volume 94ef36e6-a7db-4e18-861f-6c9b2c132018 {{(pid=82760) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 12:47:24 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-6d374acb-133d-4c09-938c-9c4f15733e86 tempest-VolumesTransfersTest-1179101258 None] Created volume successfully.
Apr 09 12:47:24 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeefbad6-daed-4ea1-9916-fd5b3d990528]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:47:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:24 devstack sudo[87321]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2f52ee5b-ed55-4439-ade4-06f5c9b7f8fe tempest-VolumesTransfersV357Test-1974738946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.499s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:24 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-2f52ee5b-ed55-4439-ade4-06f5c9b7f8fe tempest-VolumesTransfersV357Test-1974738946 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:47:24 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-2f52ee5b-ed55-4439-ade4-06f5c9b7f8fe tempest-VolumesTransfersV357Test-1974738946 None] Deleted volume successfully.
Apr 09 12:47:24 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-2f52ee5b-ed55-4439-ade4-06f5c9b7f8fe tempest-VolumesTransfersV357Test-1974738946 None] Lock "cinder-97ddb9c4-6467-47db-be45-7b5f3cfdc423-delete_volume" released by "delete_volume" :: held 1.845s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:47:24 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0009e34-09f4-4baf-928a-dfa829465d63 tempest-SnapshotsActionsTest-1850511053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:47:24 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c0009e34-09f4-4baf-928a-dfa829465d63 tempest-SnapshotsActionsTest-1850511053 None] Flow 'volume_create_manager' (85f7d32b-480c-4805-8afa-f893db080822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:47:24 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c0009e34-09f4-4baf-928a-dfa829465d63 tempest-SnapshotsActionsTest-1850511053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2fd03c6-43b9-4819-9fd5-4e5e6d8d0fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:24 devstack sudo[87325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018
Apr 09 12:47:24 devstack sudo[87325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:24 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c0009e34-09f4-4baf-928a-dfa829465d63 tempest-SnapshotsActionsTest-1850511053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2fd03c6-43b9-4819-9fd5-4e5e6d8d0fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1638376052',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1c57785-89aa-474f-9b0a-229da9fff2ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59cd7ca6d46247388c9f3dde8b199515',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:47:24Z,use_quota=True,user_id='32b8e3b19e774ac8927012ea186a0a5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:24 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c0009e34-09f4-4baf-928a-dfa829465d63 tempest-SnapshotsActionsTest-1850511053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (653a3d20-85b8-4740-91aa-8c4cd13a71c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:24 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c0009e34-09f4-4baf-928a-dfa829465d63 tempest-SnapshotsActionsTest-1850511053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (653a3d20-85b8-4740-91aa-8c4cd13a71c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:24 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c0009e34-09f4-4baf-928a-dfa829465d63 tempest-SnapshotsActionsTest-1850511053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e693d5a-6fe1-43f3-84ba-cc5a85645f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:24 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c0009e34-09f4-4baf-928a-dfa829465d63 tempest-SnapshotsActionsTest-1850511053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e693d5a-6fe1-43f3-84ba-cc5a85645f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1c57785-89aa-474f-9b0a-229da9fff2ee', 'volume_name': 'volume-f1c57785-89aa-474f-9b0a-229da9fff2ee', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:24 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c0009e34-09f4-4baf-928a-dfa829465d63 tempest-SnapshotsActionsTest-1850511053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (647ed19b-4db4-4f26-9f10-6d9316252bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:24 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c0009e34-09f4-4baf-928a-dfa829465d63 tempest-SnapshotsActionsTest-1850511053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (647ed19b-4db4-4f26-9f10-6d9316252bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:24 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c0009e34-09f4-4baf-928a-dfa829465d63 tempest-SnapshotsActionsTest-1850511053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e108f236-b40e-4902-9890-97e6e6a766c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:24 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-c0009e34-09f4-4baf-928a-dfa829465d63 tempest-SnapshotsActionsTest-1850511053 None] Volume f1c57785-89aa-474f-9b0a-229da9fff2ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1c57785-89aa-474f-9b0a-229da9fff2ee', 'volume_size': 1}
Apr 09 12:47:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c0009e34-09f4-4baf-928a-dfa829465d63 tempest-SnapshotsActionsTest-1850511053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:24 devstack sudo[87325]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018" returned: 0 in 0.512s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018.901aa445-40b0-40ca-a1d3-c8c4a9c0193a 1G {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:24 devstack sudo[87330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018.901aa445-40b0-40ca-a1d3-c8c4a9c0193a 1G
Apr 09 12:47:24 devstack sudo[87330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:24 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-c805146a-4ee0-41e0-a811-33dcfb503a0c tempest-VolumesTransfersV357Test-1712159161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:47:24 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c805146a-4ee0-41e0-a811-33dcfb503a0c tempest-VolumesTransfersV357Test-1712159161 None] Flow 'volume_create_manager' (79ad58b6-ff92-4b9b-9cca-805c1c0e1efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:47:24 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c805146a-4ee0-41e0-a811-33dcfb503a0c tempest-VolumesTransfersV357Test-1712159161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34de0825-2059-41af-b3dc-6c5061d0c824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:24 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c805146a-4ee0-41e0-a811-33dcfb503a0c tempest-VolumesTransfersV357Test-1712159161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34de0825-2059-41af-b3dc-6c5061d0c824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:47:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1849569697',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2dde54b-f93e-4de4-8e7e-410feebef132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63b787d35ac6405f82e101da910a7b30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:47:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:47:25Z,use_quota=True,user_id='22e9ef3e551a4c1594bcb192f494f522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:24 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c805146a-4ee0-41e0-a811-33dcfb503a0c tempest-VolumesTransfersV357Test-1712159161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b38fe3c-d54e-495b-8268-f8c654704e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:24 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c805146a-4ee0-41e0-a811-33dcfb503a0c tempest-VolumesTransfersV357Test-1712159161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b38fe3c-d54e-495b-8268-f8c654704e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:24 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c805146a-4ee0-41e0-a811-33dcfb503a0c tempest-VolumesTransfersV357Test-1712159161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09e03db4-649e-47fe-b25e-aea69bb4ff0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:24 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c805146a-4ee0-41e0-a811-33dcfb503a0c tempest-VolumesTransfersV357Test-1712159161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09e03db4-649e-47fe-b25e-aea69bb4ff0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2dde54b-f93e-4de4-8e7e-410feebef132', 'volume_name': 'volume-b2dde54b-f93e-4de4-8e7e-410feebef132', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:24 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c805146a-4ee0-41e0-a811-33dcfb503a0c tempest-VolumesTransfersV357Test-1712159161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (957a032f-f4ab-4a22-9018-729613bee5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:24 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c805146a-4ee0-41e0-a811-33dcfb503a0c tempest-VolumesTransfersV357Test-1712159161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (957a032f-f4ab-4a22-9018-729613bee5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:24 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c805146a-4ee0-41e0-a811-33dcfb503a0c tempest-VolumesTransfersV357Test-1712159161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ebd3e63-3248-4ff2-81b8-f64e0982f8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:24 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-c805146a-4ee0-41e0-a811-33dcfb503a0c tempest-VolumesTransfersV357Test-1712159161 None] Volume b2dde54b-f93e-4de4-8e7e-410feebef132: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2dde54b-f93e-4de4-8e7e-410feebef132', 'volume_size': 1}
Apr 09 12:47:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c805146a-4ee0-41e0-a811-33dcfb503a0c tempest-VolumesTransfersV357Test-1712159161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:25 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-a98cabda-ebb8-40f4-9a39-0eccbc24d895 tempest-VolumesTransfersTest-269016305 None] Transfer volume completed successfully.
Apr 09 12:47:25 devstack sudo[87330]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018.901aa445-40b0-40ca-a1d3-c8c4a9c0193a 1G" returned: 0 in 0.552s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94ef36e6-a7db-4e18-861f-6c9b2c132018 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018.901aa445-40b0-40ca-a1d3-c8c4a9c0193a {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:25 devstack sudo[87335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94ef36e6-a7db-4e18-861f-6c9b2c132018 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018.901aa445-40b0-40ca-a1d3-c8c4a9c0193a
Apr 09 12:47:25 devstack sudo[87335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:25 devstack sudo[87335]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94ef36e6-a7db-4e18-861f-6c9b2c132018 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018.901aa445-40b0-40ca-a1d3-c8c4a9c0193a" returned: 0 in 0.416s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:25 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018.901aa445-40b0-40ca-a1d3-c8c4a9c0193a is being set with open permissions: ugo+rw
Apr 09 12:47:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018.901aa445-40b0-40ca-a1d3-c8c4a9c0193a {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:25 devstack sudo[87340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018.901aa445-40b0-40ca-a1d3-c8c4a9c0193a
Apr 09 12:47:25 devstack sudo[87340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:26 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-18edbbd9-e351-4df8-8701-d32865561888 tempest-VolumesTransfersTest-40606047 None] Acquiring lock "cinder-634a18ef-e4c3-4ae9-bf70-4fb3e3936b10-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:47:26 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-18edbbd9-e351-4df8-8701-d32865561888 tempest-VolumesTransfersTest-40606047 None] Lock "cinder-634a18ef-e4c3-4ae9-bf70-4fb3e3936b10-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:47:26 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-18edbbd9-e351-4df8-8701-d32865561888 tempest-VolumesTransfersTest-40606047 None] Acquiring lock "cinder-quobyte-634a18ef-e4c3-4ae9-bf70-4fb3e3936b10" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:47:26 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-18edbbd9-e351-4df8-8701-d32865561888 tempest-VolumesTransfersTest-40606047 None] Lock "cinder-quobyte-634a18ef-e4c3-4ae9-bf70-4fb3e3936b10" acquired by "delete_volume" :: waited 0.006s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:47:26 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8532213-080e-491a-bf1a-b91637704b1c]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:47:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-18edbbd9-e351-4df8-8701-d32865561888 tempest-VolumesTransfersTest-40606047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-634a18ef-e4c3-4ae9-bf70-4fb3e3936b10 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:26 devstack sudo[87340]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018.901aa445-40b0-40ca-a1d3-c8c4a9c0193a" returned: 0 in 0.456s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:26 devstack sudo[87343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-634a18ef-e4c3-4ae9-bf70-4fb3e3936b10
Apr 09 12:47:26 devstack sudo[87344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018.info
Apr 09 12:47:26 devstack sudo[87343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:26 devstack sudo[87344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:26 devstack sudo[87344]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018.info" returned: 0 in 0.439s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:26 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018.info is being set with open permissions: ugo+rw
Apr 09 12:47:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:26 devstack sudo[87343]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-18edbbd9-e351-4df8-8701-d32865561888 tempest-VolumesTransfersTest-40606047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-634a18ef-e4c3-4ae9-bf70-4fb3e3936b10" returned: 0 in 0.499s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-18edbbd9-e351-4df8-8701-d32865561888 tempest-VolumesTransfersTest-40606047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-634a18ef-e4c3-4ae9-bf70-4fb3e3936b10 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:26 devstack sudo[87351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018.info
Apr 09 12:47:26 devstack sudo[87351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:26 devstack sudo[87352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-634a18ef-e4c3-4ae9-bf70-4fb3e3936b10
Apr 09 12:47:26 devstack sudo[87352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:27 devstack sudo[87352]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-18edbbd9-e351-4df8-8701-d32865561888 tempest-VolumesTransfersTest-40606047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-634a18ef-e4c3-4ae9-bf70-4fb3e3936b10" returned: 0 in 0.435s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:27 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-18edbbd9-e351-4df8-8701-d32865561888 tempest-VolumesTransfersTest-40606047 None] Lock "cinder-quobyte-634a18ef-e4c3-4ae9-bf70-4fb3e3936b10" released by "delete_volume" :: held 0.968s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:47:27 devstack sudo[87351]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018.info" returned: 0 in 0.469s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:27 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] Acquiring lock "cinder-quobyte-3f79006d-9280-46f5-a521-3163d2b1f462" by "_copy_volume_from_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:47:27 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] Lock "cinder-quobyte-3f79006d-9280-46f5-a521-3163d2b1f462" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:47:27 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] snapshot: 901aa445-40b0-40ca-a1d3-c8c4a9c0193a, volume: 3f79006d-9280-46f5-a521-3163d2b1f462,  {{(pid=82760) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 09 12:47:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:27 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:47:27 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:47:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:27 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3c0f46-d6cf-4407-9a01-d3132a895d4c]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:47:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018.901aa445-40b0-40ca-a1d3-c8c4a9c0193a {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:27 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-18edbbd9-e351-4df8-8701-d32865561888 tempest-VolumesTransfersTest-40606047 None] Created reservations ['2fea83db-1f5b-478a-b0e1-1f5730ec1e89', '35ed12e0-daa4-4e30-8d14-2def4987a16e', 'bf1d302f-ab65-44d4-875b-d438f040c58e', '7aa18dd3-62dc-474a-b01e-500008a80c44'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:47:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-18edbbd9-e351-4df8-8701-d32865561888 tempest-VolumesTransfersTest-40606047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-18edbbd9-e351-4df8-8701-d32865561888 tempest-VolumesTransfersTest-40606047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:27 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-18edbbd9-e351-4df8-8701-d32865561888 tempest-VolumesTransfersTest-40606047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:47:27 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-18edbbd9-e351-4df8-8701-d32865561888 tempest-VolumesTransfersTest-40606047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:47:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-18edbbd9-e351-4df8-8701-d32865561888 tempest-VolumesTransfersTest-40606047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-18edbbd9-e351-4df8-8701-d32865561888 tempest-VolumesTransfersTest-40606047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:27 devstack sudo[87357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018.901aa445-40b0-40ca-a1d3-c8c4a9c0193a
Apr 09 12:47:27 devstack sudo[87357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:27 devstack sudo[87358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:47:27 devstack sudo[87358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:27 devstack sudo[87358]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-18edbbd9-e351-4df8-8701-d32865561888 tempest-VolumesTransfersTest-40606047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.404s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:27 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-18edbbd9-e351-4df8-8701-d32865561888 tempest-VolumesTransfersTest-40606047 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:47:27 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-18edbbd9-e351-4df8-8701-d32865561888 tempest-VolumesTransfersTest-40606047 None] Deleted volume successfully.
Apr 09 12:47:27 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-18edbbd9-e351-4df8-8701-d32865561888 tempest-VolumesTransfersTest-40606047 None] Lock "cinder-634a18ef-e4c3-4ae9-bf70-4fb3e3936b10-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:47:27 devstack sudo[87357]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018.901aa445-40b0-40ca-a1d3-c8c4a9c0193a" returned: 0 in 0.518s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:27 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94ef36e6-a7db-4e18-861f-6c9b2c132018(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:47:27 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018 {{(pid=82760) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 09 12:47:27 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] Creating direct copy from snapshot {{(pid=82760) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 09 12:47:27 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[a285a987-929c-4f44-8544-c98d9615c3f3]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:47:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:27 devstack sudo[87365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018
Apr 09 12:47:27 devstack sudo[87365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:28 devstack sudo[87365]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:28 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018" returned: 0 in 0.469s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:28 devstack cinder-volume[82760]: DEBUG cinder.utils [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] Path /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3f79006d-9280-46f5-a521-3163d2b1f462 not found in is_blk_device check {{(pid=82760) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 09 12:47:28 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3f79006d-9280-46f5-a521-3163d2b1f462 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:28 devstack sudo[87370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3f79006d-9280-46f5-a521-3163d2b1f462
Apr 09 12:47:28 devstack sudo[87370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:28 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-09b6a130-68b7-4747-879a-09c0c7ccbce4 tempest-VolumesTransfersTest-1179101258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:47:28 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-09b6a130-68b7-4747-879a-09c0c7ccbce4 tempest-VolumesTransfersTest-1179101258 None] Flow 'volume_create_manager' (b73eb253-4d6f-4992-bb06-6425d5b5654a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:47:28 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-09b6a130-68b7-4747-879a-09c0c7ccbce4 tempest-VolumesTransfersTest-1179101258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a099980d-3b30-444a-a3f1-82c63fd7a6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:28 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-09b6a130-68b7-4747-879a-09c0c7ccbce4 tempest-VolumesTransfersTest-1179101258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a099980d-3b30-444a-a3f1-82c63fd7a6af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1522369423',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a290e367-4b39-4032-85a5-4b83f4dd2f3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d266467826564c6b9b3dc7b4cff00578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:47:28Z,use_quota=True,user_id='5d0da29b1b2e43598361bc05ea1f49c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:28 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-09b6a130-68b7-4747-879a-09c0c7ccbce4 tempest-VolumesTransfersTest-1179101258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63030452-b789-46a1-8fa4-5846fd047aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:28 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-09b6a130-68b7-4747-879a-09c0c7ccbce4 tempest-VolumesTransfersTest-1179101258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63030452-b789-46a1-8fa4-5846fd047aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:28 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-09b6a130-68b7-4747-879a-09c0c7ccbce4 tempest-VolumesTransfersTest-1179101258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (773cf0da-91b7-4f56-abcd-cfb465c6a1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:28 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-09b6a130-68b7-4747-879a-09c0c7ccbce4 tempest-VolumesTransfersTest-1179101258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (773cf0da-91b7-4f56-abcd-cfb465c6a1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a290e367-4b39-4032-85a5-4b83f4dd2f3c', 'volume_name': 'volume-a290e367-4b39-4032-85a5-4b83f4dd2f3c', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:28 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-09b6a130-68b7-4747-879a-09c0c7ccbce4 tempest-VolumesTransfersTest-1179101258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c19049a8-4692-497a-bbae-f34892f59f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:28 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-09b6a130-68b7-4747-879a-09c0c7ccbce4 tempest-VolumesTransfersTest-1179101258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c19049a8-4692-497a-bbae-f34892f59f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:28 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-09b6a130-68b7-4747-879a-09c0c7ccbce4 tempest-VolumesTransfersTest-1179101258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (991d4a6a-36ce-402e-a52e-03ecdd7b4d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:28 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-09b6a130-68b7-4747-879a-09c0c7ccbce4 tempest-VolumesTransfersTest-1179101258 None] Volume a290e367-4b39-4032-85a5-4b83f4dd2f3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a290e367-4b39-4032-85a5-4b83f4dd2f3c', 'volume_size': 1}
Apr 09 12:47:28 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-09b6a130-68b7-4747-879a-09c0c7ccbce4 tempest-VolumesTransfersTest-1179101258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:30 devstack sudo[87370]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:30 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3f79006d-9280-46f5-a521-3163d2b1f462" returned: 0 in 2.162s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:30 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce89fa0-64f0-4616-8363-1b3c60b7708b]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:47:30 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:30 devstack sudo[87382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018
Apr 09 12:47:30 devstack sudo[87382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:30 devstack sudo[87382]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:30 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018" returned: 0 in 0.560s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:30 devstack cinder-volume[82760]: DEBUG cinder.image.image_utils [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] Image conversion details: src /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018, size 1024.00 MB, duration 2.16 sec, destination /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3f79006d-9280-46f5-a521-3163d2b1f462 {{(pid=82760) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 12:47:30 devstack cinder-volume[82760]: INFO cinder.image.image_utils [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] Converted 1024.00 MB image at 473.51 MB/s
Apr 09 12:47:30 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3f79006d-9280-46f5-a521-3163d2b1f462 is being set with open permissions: ugo+rw
Apr 09 12:47:30 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3f79006d-9280-46f5-a521-3163d2b1f462 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:30 devstack sudo[87387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3f79006d-9280-46f5-a521-3163d2b1f462
Apr 09 12:47:30 devstack sudo[87387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:31 devstack sudo[87387]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:31 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3f79006d-9280-46f5-a521-3163d2b1f462" returned: 0 in 0.402s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:31 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] Lock "cinder-quobyte-3f79006d-9280-46f5-a521-3163d2b1f462" released by "_copy_volume_from_snapshot" :: held 4.166s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:47:31 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] Acquiring lock "cinder-quobyte-901aa445-40b0-40ca-a1d3-c8c4a9c0193a" by "_delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:47:31 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] Lock "cinder-quobyte-901aa445-40b0-40ca-a1d3-c8c4a9c0193a" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:47:31 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] Deleting offline snapshot 901aa445-40b0-40ca-a1d3-c8c4a9c0193a of volume 94ef36e6-a7db-4e18-861f-6c9b2c132018 {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 12:47:31 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] snapshot_file for this snap is: volume-94ef36e6-a7db-4e18-861f-6c9b2c132018.901aa445-40b0-40ca-a1d3-c8c4a9c0193a {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 12:47:31 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[45089ac2-c19f-4518-bcea-df4c20328199]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:47:31 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018.901aa445-40b0-40ca-a1d3-c8c4a9c0193a {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:31 devstack sudo[87390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018.901aa445-40b0-40ca-a1d3-c8c4a9c0193a
Apr 09 12:47:31 devstack sudo[87390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:31 devstack sudo[87390]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:31 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018.901aa445-40b0-40ca-a1d3-c8c4a9c0193a" returned: 0 in 0.491s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:31 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94ef36e6-a7db-4e18-861f-6c9b2c132018(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:47:31 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da55026-d8f7-43ee-987c-6435f3c8fc91]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:47:31 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:31 devstack sudo[87395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018
Apr 09 12:47:31 devstack sudo[87395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:32 devstack sudo[87395]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018" returned: 0 in 0.459s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018.901aa445-40b0-40ca-a1d3-c8c4a9c0193a {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:32 devstack sudo[87400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018.901aa445-40b0-40ca-a1d3-c8c4a9c0193a
Apr 09 12:47:32 devstack sudo[87400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:32 devstack sudo[87400]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018.901aa445-40b0-40ca-a1d3-c8c4a9c0193a" returned: 0 in 0.451s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018.901aa445-40b0-40ca-a1d3-c8c4a9c0193a {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:32 devstack sudo[87406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018.901aa445-40b0-40ca-a1d3-c8c4a9c0193a
Apr 09 12:47:32 devstack sudo[87406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:33 devstack sudo[87406]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:33 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018.901aa445-40b0-40ca-a1d3-c8c4a9c0193a" returned: 0 in 0.402s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:33 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] Lock "cinder-quobyte-901aa445-40b0-40ca-a1d3-c8c4a9c0193a" released by "_delete_snapshot" :: held 1.852s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:47:33 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.033s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:33 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c0009e34-09f4-4baf-928a-dfa829465d63 tempest-SnapshotsActionsTest-1850511053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.821s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:33 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-c0009e34-09f4-4baf-928a-dfa829465d63 tempest-SnapshotsActionsTest-1850511053 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1638376052',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1c57785-89aa-474f-9b0a-229da9fff2ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59cd7ca6d46247388c9f3dde8b199515',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:47:24Z,use_quota=True,user_id='32b8e3b19e774ac8927012ea186a0a5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:47:33 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-c0009e34-09f4-4baf-928a-dfa829465d63 tempest-SnapshotsActionsTest-1850511053 None] Creating volume f1c57785-89aa-474f-9b0a-229da9fff2ee {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:47:33 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c0009e34-09f4-4baf-928a-dfa829465d63 tempest-SnapshotsActionsTest-1850511053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:33 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c0009e34-09f4-4baf-928a-dfa829465d63 tempest-SnapshotsActionsTest-1850511053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:33 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-c0009e34-09f4-4baf-928a-dfa829465d63 tempest-SnapshotsActionsTest-1850511053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:47:33 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-c0009e34-09f4-4baf-928a-dfa829465d63 tempest-SnapshotsActionsTest-1850511053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:47:33 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c0009e34-09f4-4baf-928a-dfa829465d63 tempest-SnapshotsActionsTest-1850511053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:33 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-c0009e34-09f4-4baf-928a-dfa829465d63 tempest-SnapshotsActionsTest-1850511053 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:47:33 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-c0009e34-09f4-4baf-928a-dfa829465d63 tempest-SnapshotsActionsTest-1850511053 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:47:33 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c0009e34-09f4-4baf-928a-dfa829465d63 tempest-SnapshotsActionsTest-1850511053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:33 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39778605-558a-414d-b69a-076d9ce3ac6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f79006d-9280-46f5-a521-3163d2b1f462', 'volume_size': 1, 'source_volid': '94ef36e6-a7db-4e18-861f-6c9b2c132018', 'source_volstatus': 'available'}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:33 devstack sudo[87409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee 1073741824
Apr 09 12:47:33 devstack sudo[87409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:33 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b73a3d28-df11-4c98-aaee-879a35a89e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:33 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] Volume volume-3f79006d-9280-46f5-a521-3163d2b1f462 (3f79006d-9280-46f5-a521-3163d2b1f462): created successfully
Apr 09 12:47:33 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b73a3d28-df11-4c98-aaee-879a35a89e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:33 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] Flow 'volume_create_manager' (af638dff-d9a6-479a-affe-5e4465d9c141) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:47:33 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-21bed0ea-4610-43ac-ae62-bfe6cb62c2bd tempest-VolumesGetTest-606996561 None] Created volume successfully.
Apr 09 12:47:33 devstack sudo[87409]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:33 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c0009e34-09f4-4baf-928a-dfa829465d63 tempest-SnapshotsActionsTest-1850511053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee 1073741824" returned: 0 in 0.529s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:33 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c0009e34-09f4-4baf-928a-dfa829465d63 tempest-SnapshotsActionsTest-1850511053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:33 devstack sudo[87414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee
Apr 09 12:47:33 devstack sudo[87414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:34 devstack sudo[87414]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:34 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c0009e34-09f4-4baf-928a-dfa829465d63 tempest-SnapshotsActionsTest-1850511053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee" returned: 0 in 0.416s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:34 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-c0009e34-09f4-4baf-928a-dfa829465d63 tempest-SnapshotsActionsTest-1850511053 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:47:34 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c0009e34-09f4-4baf-928a-dfa829465d63 tempest-SnapshotsActionsTest-1850511053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:34 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c805146a-4ee0-41e0-a811-33dcfb503a0c tempest-VolumesTransfersV357Test-1712159161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.166s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:34 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-c805146a-4ee0-41e0-a811-33dcfb503a0c tempest-VolumesTransfersV357Test-1712159161 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:47:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1849569697',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2dde54b-f93e-4de4-8e7e-410feebef132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63b787d35ac6405f82e101da910a7b30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:47:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:47:25Z,use_quota=True,user_id='22e9ef3e551a4c1594bcb192f494f522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:47:34 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-c805146a-4ee0-41e0-a811-33dcfb503a0c tempest-VolumesTransfersV357Test-1712159161 None] Creating volume b2dde54b-f93e-4de4-8e7e-410feebef132 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:47:34 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c805146a-4ee0-41e0-a811-33dcfb503a0c tempest-VolumesTransfersV357Test-1712159161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:34 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c805146a-4ee0-41e0-a811-33dcfb503a0c tempest-VolumesTransfersV357Test-1712159161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:34 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-c805146a-4ee0-41e0-a811-33dcfb503a0c tempest-VolumesTransfersV357Test-1712159161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:47:34 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-c805146a-4ee0-41e0-a811-33dcfb503a0c tempest-VolumesTransfersV357Test-1712159161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:47:34 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c805146a-4ee0-41e0-a811-33dcfb503a0c tempest-VolumesTransfersV357Test-1712159161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:34 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-c805146a-4ee0-41e0-a811-33dcfb503a0c tempest-VolumesTransfersV357Test-1712159161 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:47:34 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-c805146a-4ee0-41e0-a811-33dcfb503a0c tempest-VolumesTransfersV357Test-1712159161 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:47:34 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c805146a-4ee0-41e0-a811-33dcfb503a0c tempest-VolumesTransfersV357Test-1712159161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-b2dde54b-f93e-4de4-8e7e-410feebef132 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:34 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c0009e34-09f4-4baf-928a-dfa829465d63 tempest-SnapshotsActionsTest-1850511053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e108f236-b40e-4902-9890-97e6e6a766c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1c57785-89aa-474f-9b0a-229da9fff2ee', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:34 devstack sudo[87417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-b2dde54b-f93e-4de4-8e7e-410feebef132 1073741824
Apr 09 12:47:34 devstack sudo[87417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:34 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c0009e34-09f4-4baf-928a-dfa829465d63 tempest-SnapshotsActionsTest-1850511053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (167cd7f1-de98-4a1f-845c-7e5fa263c223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:34 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-c0009e34-09f4-4baf-928a-dfa829465d63 tempest-SnapshotsActionsTest-1850511053 None] Volume volume-f1c57785-89aa-474f-9b0a-229da9fff2ee (f1c57785-89aa-474f-9b0a-229da9fff2ee): created successfully
Apr 09 12:47:34 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c0009e34-09f4-4baf-928a-dfa829465d63 tempest-SnapshotsActionsTest-1850511053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (167cd7f1-de98-4a1f-845c-7e5fa263c223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:34 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c0009e34-09f4-4baf-928a-dfa829465d63 tempest-SnapshotsActionsTest-1850511053 None] Flow 'volume_create_manager' (85f7d32b-480c-4805-8afa-f893db080822) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:47:34 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-c0009e34-09f4-4baf-928a-dfa829465d63 tempest-SnapshotsActionsTest-1850511053 None] Created volume successfully.
Apr 09 12:47:34 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-c09f0dba-0293-4c9b-9a30-6df811aadcfd tempest-VolumesGetTest-606996561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:47:34 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c09f0dba-0293-4c9b-9a30-6df811aadcfd tempest-VolumesGetTest-606996561 None] Flow 'volume_create_manager' (a89e54e4-b891-4fa2-bcc7-d936ae227ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:47:34 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c09f0dba-0293-4c9b-9a30-6df811aadcfd tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a834d0f4-e85e-4495-9a34-d98c111d0ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:34 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c09f0dba-0293-4c9b-9a30-6df811aadcfd tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a834d0f4-e85e-4495-9a34-d98c111d0ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:47:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1181860537',display_name='tempest-VolumesGetTest-Volume-872830345',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ed5f534-1e3a-4828-94e8-b6e05f6749cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1e2e15da8734d00b19bb36f846ccfc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:47:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:47:35Z,use_quota=True,user_id='f0fe31af3e8c462da1930eb8650f1836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:34 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c09f0dba-0293-4c9b-9a30-6df811aadcfd tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03aef056-a6f9-4dc9-8402-a8869f480adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:34 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c09f0dba-0293-4c9b-9a30-6df811aadcfd tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03aef056-a6f9-4dc9-8402-a8869f480adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:34 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c09f0dba-0293-4c9b-9a30-6df811aadcfd tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0435acc5-890d-4b0b-8b87-ff1ba4efa096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:34 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c09f0dba-0293-4c9b-9a30-6df811aadcfd tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0435acc5-890d-4b0b-8b87-ff1ba4efa096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ed5f534-1e3a-4828-94e8-b6e05f6749cb', 'volume_name': 'volume-1ed5f534-1e3a-4828-94e8-b6e05f6749cb', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:34 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c09f0dba-0293-4c9b-9a30-6df811aadcfd tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7678614e-1955-4d16-b3a5-2c809ae631f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:34 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c09f0dba-0293-4c9b-9a30-6df811aadcfd tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7678614e-1955-4d16-b3a5-2c809ae631f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:34 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c09f0dba-0293-4c9b-9a30-6df811aadcfd tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93868f96-6f66-44b6-9102-2e55cd08a2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:34 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-c09f0dba-0293-4c9b-9a30-6df811aadcfd tempest-VolumesGetTest-606996561 None] Volume 1ed5f534-1e3a-4828-94e8-b6e05f6749cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ed5f534-1e3a-4828-94e8-b6e05f6749cb', 'volume_size': 1}
Apr 09 12:47:34 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c09f0dba-0293-4c9b-9a30-6df811aadcfd tempest-VolumesGetTest-606996561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:34 devstack sudo[87417]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:34 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c805146a-4ee0-41e0-a811-33dcfb503a0c tempest-VolumesTransfersV357Test-1712159161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-b2dde54b-f93e-4de4-8e7e-410feebef132 1073741824" returned: 0 in 0.589s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:34 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c805146a-4ee0-41e0-a811-33dcfb503a0c tempest-VolumesTransfersV357Test-1712159161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-b2dde54b-f93e-4de4-8e7e-410feebef132 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:34 devstack sudo[87422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-b2dde54b-f93e-4de4-8e7e-410feebef132
Apr 09 12:47:34 devstack sudo[87422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:34 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ba366b07-2903-4f99-af28-e16fdb210ed9 tempest-SnapshotsActionsTest-1850511053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:35 devstack sudo[87422]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c805146a-4ee0-41e0-a811-33dcfb503a0c tempest-VolumesTransfersV357Test-1712159161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-b2dde54b-f93e-4de4-8e7e-410feebef132" returned: 0 in 0.460s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:35 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-c805146a-4ee0-41e0-a811-33dcfb503a0c tempest-VolumesTransfersV357Test-1712159161 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:47:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c805146a-4ee0-41e0-a811-33dcfb503a0c tempest-VolumesTransfersV357Test-1712159161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-09b6a130-68b7-4747-879a-09c0c7ccbce4 tempest-VolumesTransfersTest-1179101258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.657s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:35 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-09b6a130-68b7-4747-879a-09c0c7ccbce4 tempest-VolumesTransfersTest-1179101258 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1522369423',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a290e367-4b39-4032-85a5-4b83f4dd2f3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d266467826564c6b9b3dc7b4cff00578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:47:28Z,use_quota=True,user_id='5d0da29b1b2e43598361bc05ea1f49c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:47:35 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-09b6a130-68b7-4747-879a-09c0c7ccbce4 tempest-VolumesTransfersTest-1179101258 None] Creating volume a290e367-4b39-4032-85a5-4b83f4dd2f3c {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:47:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-09b6a130-68b7-4747-879a-09c0c7ccbce4 tempest-VolumesTransfersTest-1179101258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-09b6a130-68b7-4747-879a-09c0c7ccbce4 tempest-VolumesTransfersTest-1179101258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:35 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-09b6a130-68b7-4747-879a-09c0c7ccbce4 tempest-VolumesTransfersTest-1179101258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:47:35 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-09b6a130-68b7-4747-879a-09c0c7ccbce4 tempest-VolumesTransfersTest-1179101258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:47:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-09b6a130-68b7-4747-879a-09c0c7ccbce4 tempest-VolumesTransfersTest-1179101258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:35 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-09b6a130-68b7-4747-879a-09c0c7ccbce4 tempest-VolumesTransfersTest-1179101258 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:47:35 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-09b6a130-68b7-4747-879a-09c0c7ccbce4 tempest-VolumesTransfersTest-1179101258 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:47:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-09b6a130-68b7-4747-879a-09c0c7ccbce4 tempest-VolumesTransfersTest-1179101258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a290e367-4b39-4032-85a5-4b83f4dd2f3c 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:35 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c805146a-4ee0-41e0-a811-33dcfb503a0c tempest-VolumesTransfersV357Test-1712159161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ebd3e63-3248-4ff2-81b8-f64e0982f8d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2dde54b-f93e-4de4-8e7e-410feebef132', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:35 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c805146a-4ee0-41e0-a811-33dcfb503a0c tempest-VolumesTransfersV357Test-1712159161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eba29bd-2b2c-46e6-8c1d-1f499606b9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:35 devstack sudo[87425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a290e367-4b39-4032-85a5-4b83f4dd2f3c 1073741824
Apr 09 12:47:35 devstack sudo[87425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:35 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-c805146a-4ee0-41e0-a811-33dcfb503a0c tempest-VolumesTransfersV357Test-1712159161 None] Volume volume-b2dde54b-f93e-4de4-8e7e-410feebef132 (b2dde54b-f93e-4de4-8e7e-410feebef132): created successfully
Apr 09 12:47:35 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c805146a-4ee0-41e0-a811-33dcfb503a0c tempest-VolumesTransfersV357Test-1712159161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eba29bd-2b2c-46e6-8c1d-1f499606b9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:35 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c805146a-4ee0-41e0-a811-33dcfb503a0c tempest-VolumesTransfersV357Test-1712159161 None] Flow 'volume_create_manager' (79ad58b6-ff92-4b9b-9cca-805c1c0e1efa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:47:35 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-c805146a-4ee0-41e0-a811-33dcfb503a0c tempest-VolumesTransfersV357Test-1712159161 None] Created volume successfully.
Apr 09 12:47:35 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-acbc0880-d424-4ec7-a040-fbeffb766dd7 tempest-VolumesTransfersV357Test-1974738946 None] Acquiring lock "cinder-b2dde54b-f93e-4de4-8e7e-410feebef132-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:47:35 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-acbc0880-d424-4ec7-a040-fbeffb766dd7 tempest-VolumesTransfersV357Test-1974738946 None] Lock "cinder-b2dde54b-f93e-4de4-8e7e-410feebef132-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:47:35 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-acbc0880-d424-4ec7-a040-fbeffb766dd7 tempest-VolumesTransfersV357Test-1974738946 None] Acquiring lock "cinder-quobyte-b2dde54b-f93e-4de4-8e7e-410feebef132" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:47:35 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-acbc0880-d424-4ec7-a040-fbeffb766dd7 tempest-VolumesTransfersV357Test-1974738946 None] Lock "cinder-quobyte-b2dde54b-f93e-4de4-8e7e-410feebef132" acquired by "delete_volume" :: waited 0.008s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:47:35 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05daaec-1f54-45ac-a906-f54d4781dc08]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:47:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-acbc0880-d424-4ec7-a040-fbeffb766dd7 tempest-VolumesTransfersV357Test-1974738946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-b2dde54b-f93e-4de4-8e7e-410feebef132 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:35 devstack sudo[87425]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-09b6a130-68b7-4747-879a-09c0c7ccbce4 tempest-VolumesTransfersTest-1179101258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a290e367-4b39-4032-85a5-4b83f4dd2f3c 1073741824" returned: 0 in 0.622s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-09b6a130-68b7-4747-879a-09c0c7ccbce4 tempest-VolumesTransfersTest-1179101258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a290e367-4b39-4032-85a5-4b83f4dd2f3c {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:35 devstack sudo[87430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-b2dde54b-f93e-4de4-8e7e-410feebef132
Apr 09 12:47:35 devstack sudo[87430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:35 devstack sudo[87431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a290e367-4b39-4032-85a5-4b83f4dd2f3c
Apr 09 12:47:35 devstack sudo[87431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:36 devstack sudo[87430]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:36 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-acbc0880-d424-4ec7-a040-fbeffb766dd7 tempest-VolumesTransfersV357Test-1974738946 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-b2dde54b-f93e-4de4-8e7e-410feebef132" returned: 0 in 0.509s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:36 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-acbc0880-d424-4ec7-a040-fbeffb766dd7 tempest-VolumesTransfersV357Test-1974738946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-b2dde54b-f93e-4de4-8e7e-410feebef132 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:36 devstack sudo[87438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-b2dde54b-f93e-4de4-8e7e-410feebef132
Apr 09 12:47:36 devstack sudo[87438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:36 devstack sudo[87431]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:36 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-09b6a130-68b7-4747-879a-09c0c7ccbce4 tempest-VolumesTransfersTest-1179101258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a290e367-4b39-4032-85a5-4b83f4dd2f3c" returned: 0 in 0.485s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:36 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-09b6a130-68b7-4747-879a-09c0c7ccbce4 tempest-VolumesTransfersTest-1179101258 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:47:36 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-09b6a130-68b7-4747-879a-09c0c7ccbce4 tempest-VolumesTransfersTest-1179101258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:36 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c09f0dba-0293-4c9b-9a30-6df811aadcfd tempest-VolumesGetTest-606996561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.683s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:36 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-c09f0dba-0293-4c9b-9a30-6df811aadcfd tempest-VolumesGetTest-606996561 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:47:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1181860537',display_name='tempest-VolumesGetTest-Volume-872830345',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ed5f534-1e3a-4828-94e8-b6e05f6749cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1e2e15da8734d00b19bb36f846ccfc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:47:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:47:35Z,use_quota=True,user_id='f0fe31af3e8c462da1930eb8650f1836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:47:36 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-c09f0dba-0293-4c9b-9a30-6df811aadcfd tempest-VolumesGetTest-606996561 None] Creating volume 1ed5f534-1e3a-4828-94e8-b6e05f6749cb {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:47:36 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c09f0dba-0293-4c9b-9a30-6df811aadcfd tempest-VolumesGetTest-606996561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:36 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c09f0dba-0293-4c9b-9a30-6df811aadcfd tempest-VolumesGetTest-606996561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:36 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-c09f0dba-0293-4c9b-9a30-6df811aadcfd tempest-VolumesGetTest-606996561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:47:36 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-c09f0dba-0293-4c9b-9a30-6df811aadcfd tempest-VolumesGetTest-606996561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:47:36 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c09f0dba-0293-4c9b-9a30-6df811aadcfd tempest-VolumesGetTest-606996561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:36 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-c09f0dba-0293-4c9b-9a30-6df811aadcfd tempest-VolumesGetTest-606996561 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:47:36 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-c09f0dba-0293-4c9b-9a30-6df811aadcfd tempest-VolumesGetTest-606996561 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:47:36 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c09f0dba-0293-4c9b-9a30-6df811aadcfd tempest-VolumesGetTest-606996561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1ed5f534-1e3a-4828-94e8-b6e05f6749cb 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:36 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-09b6a130-68b7-4747-879a-09c0c7ccbce4 tempest-VolumesTransfersTest-1179101258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (991d4a6a-36ce-402e-a52e-03ecdd7b4d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a290e367-4b39-4032-85a5-4b83f4dd2f3c', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:36 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-09b6a130-68b7-4747-879a-09c0c7ccbce4 tempest-VolumesTransfersTest-1179101258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea314977-1b13-42a1-b1c6-b1f55c1b4800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:36 devstack sudo[87440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1ed5f534-1e3a-4828-94e8-b6e05f6749cb 1073741824
Apr 09 12:47:36 devstack sudo[87440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:36 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-09b6a130-68b7-4747-879a-09c0c7ccbce4 tempest-VolumesTransfersTest-1179101258 None] Volume volume-a290e367-4b39-4032-85a5-4b83f4dd2f3c (a290e367-4b39-4032-85a5-4b83f4dd2f3c): created successfully
Apr 09 12:47:36 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-09b6a130-68b7-4747-879a-09c0c7ccbce4 tempest-VolumesTransfersTest-1179101258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea314977-1b13-42a1-b1c6-b1f55c1b4800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:36 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-09b6a130-68b7-4747-879a-09c0c7ccbce4 tempest-VolumesTransfersTest-1179101258 None] Flow 'volume_create_manager' (b73eb253-4d6f-4992-bb06-6425d5b5654a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:47:36 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-09b6a130-68b7-4747-879a-09c0c7ccbce4 tempest-VolumesTransfersTest-1179101258 None] Created volume successfully.
Apr 09 12:47:36 devstack sudo[87438]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:36 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-acbc0880-d424-4ec7-a040-fbeffb766dd7 tempest-VolumesTransfersV357Test-1974738946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-b2dde54b-f93e-4de4-8e7e-410feebef132" returned: 0 in 0.442s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:36 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-acbc0880-d424-4ec7-a040-fbeffb766dd7 tempest-VolumesTransfersV357Test-1974738946 None] Lock "cinder-quobyte-b2dde54b-f93e-4de4-8e7e-410feebef132" released by "delete_volume" :: held 0.975s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:47:36 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-acbc0880-d424-4ec7-a040-fbeffb766dd7 tempest-VolumesTransfersV357Test-1974738946 None] Created reservations ['b7168950-990c-46a9-95ef-341fd7ea5399', 'ee7721fb-b166-4b27-8594-f6227238de45', '28826cae-eada-4904-9895-fdcf28678394', 'a8795977-96a5-44cc-a27a-21ee69a0bc00'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:47:36 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-acbc0880-d424-4ec7-a040-fbeffb766dd7 tempest-VolumesTransfersV357Test-1974738946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:36 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-acbc0880-d424-4ec7-a040-fbeffb766dd7 tempest-VolumesTransfersV357Test-1974738946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:36 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-acbc0880-d424-4ec7-a040-fbeffb766dd7 tempest-VolumesTransfersV357Test-1974738946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:47:36 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-acbc0880-d424-4ec7-a040-fbeffb766dd7 tempest-VolumesTransfersV357Test-1974738946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:47:36 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-acbc0880-d424-4ec7-a040-fbeffb766dd7 tempest-VolumesTransfersV357Test-1974738946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:36 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-acbc0880-d424-4ec7-a040-fbeffb766dd7 tempest-VolumesTransfersV357Test-1974738946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:36 devstack sudo[87440]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:36 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c09f0dba-0293-4c9b-9a30-6df811aadcfd tempest-VolumesGetTest-606996561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1ed5f534-1e3a-4828-94e8-b6e05f6749cb 1073741824" returned: 0 in 0.541s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:36 devstack sudo[87446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:47:36 devstack sudo[87446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:36 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c09f0dba-0293-4c9b-9a30-6df811aadcfd tempest-VolumesGetTest-606996561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1ed5f534-1e3a-4828-94e8-b6e05f6749cb {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:36 devstack sudo[87448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1ed5f534-1e3a-4828-94e8-b6e05f6749cb
Apr 09 12:47:36 devstack sudo[87448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:37 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-61067bd1-1066-4ee0-8b36-04a7fcb8e057 tempest-VolumesTransfersTest-40606047 None] Acquiring lock "cinder-a290e367-4b39-4032-85a5-4b83f4dd2f3c-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:47:37 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-61067bd1-1066-4ee0-8b36-04a7fcb8e057 tempest-VolumesTransfersTest-40606047 None] Lock "cinder-a290e367-4b39-4032-85a5-4b83f4dd2f3c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:47:37 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-61067bd1-1066-4ee0-8b36-04a7fcb8e057 tempest-VolumesTransfersTest-40606047 None] Acquiring lock "cinder-quobyte-a290e367-4b39-4032-85a5-4b83f4dd2f3c" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:47:37 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-61067bd1-1066-4ee0-8b36-04a7fcb8e057 tempest-VolumesTransfersTest-40606047 None] Lock "cinder-quobyte-a290e367-4b39-4032-85a5-4b83f4dd2f3c" acquired by "delete_volume" :: waited 0.009s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:47:37 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[33694f37-2c49-481b-8fc0-c3304649daec]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:47:37 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-61067bd1-1066-4ee0-8b36-04a7fcb8e057 tempest-VolumesTransfersTest-40606047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a290e367-4b39-4032-85a5-4b83f4dd2f3c {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:37 devstack sudo[87446]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:37 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-acbc0880-d424-4ec7-a040-fbeffb766dd7 tempest-VolumesTransfersV357Test-1974738946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.476s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:37 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-acbc0880-d424-4ec7-a040-fbeffb766dd7 tempest-VolumesTransfersV357Test-1974738946 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:47:37 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-acbc0880-d424-4ec7-a040-fbeffb766dd7 tempest-VolumesTransfersV357Test-1974738946 None] Deleted volume successfully.
Apr 09 12:47:37 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-acbc0880-d424-4ec7-a040-fbeffb766dd7 tempest-VolumesTransfersV357Test-1974738946 None] Lock "cinder-b2dde54b-f93e-4de4-8e7e-410feebef132-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:47:37 devstack sudo[87451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a290e367-4b39-4032-85a5-4b83f4dd2f3c
Apr 09 12:47:37 devstack sudo[87451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:37 devstack sudo[87448]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:37 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c09f0dba-0293-4c9b-9a30-6df811aadcfd tempest-VolumesGetTest-606996561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1ed5f534-1e3a-4828-94e8-b6e05f6749cb" returned: 0 in 0.523s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:37 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-c09f0dba-0293-4c9b-9a30-6df811aadcfd tempest-VolumesGetTest-606996561 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:47:37 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c09f0dba-0293-4c9b-9a30-6df811aadcfd tempest-VolumesGetTest-606996561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:37 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ba366b07-2903-4f99-af28-e16fdb210ed9 tempest-SnapshotsActionsTest-1850511053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.445s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:37 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-ba366b07-2903-4f99-af28-e16fdb210ed9 tempest-SnapshotsActionsTest-1850511053 None] Creating offline snapshot 25dc9abb-fdd9-46fa-946e-01ab2ab92d5b of volume f1c57785-89aa-474f-9b0a-229da9fff2ee {{(pid=82760) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 12:47:37 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c09f0dba-0293-4c9b-9a30-6df811aadcfd tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93868f96-6f66-44b6-9102-2e55cd08a2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ed5f534-1e3a-4828-94e8-b6e05f6749cb', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:37 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c09f0dba-0293-4c9b-9a30-6df811aadcfd tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ff3093b-b61c-488d-b8de-96350762f039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:37 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03434e7-560f-40ae-ab8b-bdeb2a75727b]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:47:37 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ba366b07-2903-4f99-af28-e16fdb210ed9 tempest-SnapshotsActionsTest-1850511053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:37 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-c09f0dba-0293-4c9b-9a30-6df811aadcfd tempest-VolumesGetTest-606996561 None] Volume volume-1ed5f534-1e3a-4828-94e8-b6e05f6749cb (1ed5f534-1e3a-4828-94e8-b6e05f6749cb): created successfully
Apr 09 12:47:37 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c09f0dba-0293-4c9b-9a30-6df811aadcfd tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ff3093b-b61c-488d-b8de-96350762f039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:37 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c09f0dba-0293-4c9b-9a30-6df811aadcfd tempest-VolumesGetTest-606996561 None] Flow 'volume_create_manager' (a89e54e4-b891-4fa2-bcc7-d936ae227ab7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:47:37 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-c09f0dba-0293-4c9b-9a30-6df811aadcfd tempest-VolumesGetTest-606996561 None] Created volume successfully.
Apr 09 12:47:37 devstack sudo[87454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee
Apr 09 12:47:37 devstack sudo[87454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:37 devstack sudo[87451]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:37 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-61067bd1-1066-4ee0-8b36-04a7fcb8e057 tempest-VolumesTransfersTest-40606047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a290e367-4b39-4032-85a5-4b83f4dd2f3c" returned: 0 in 0.557s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:37 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-61067bd1-1066-4ee0-8b36-04a7fcb8e057 tempest-VolumesTransfersTest-40606047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a290e367-4b39-4032-85a5-4b83f4dd2f3c {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:37 devstack sudo[87459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a290e367-4b39-4032-85a5-4b83f4dd2f3c
Apr 09 12:47:37 devstack sudo[87459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:37 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-a7fd3c9a-6ae0-4a0d-961c-b8ca4c467f29 tempest-VolumesGetTest-606996561 None] Acquiring lock "cinder-1ed5f534-1e3a-4828-94e8-b6e05f6749cb-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:47:37 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-a7fd3c9a-6ae0-4a0d-961c-b8ca4c467f29 tempest-VolumesGetTest-606996561 None] Lock "cinder-1ed5f534-1e3a-4828-94e8-b6e05f6749cb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:47:37 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-a7fd3c9a-6ae0-4a0d-961c-b8ca4c467f29 tempest-VolumesGetTest-606996561 None] Acquiring lock "cinder-quobyte-1ed5f534-1e3a-4828-94e8-b6e05f6749cb" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:47:37 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-a7fd3c9a-6ae0-4a0d-961c-b8ca4c467f29 tempest-VolumesGetTest-606996561 None] Lock "cinder-quobyte-1ed5f534-1e3a-4828-94e8-b6e05f6749cb" acquired by "delete_volume" :: waited 0.010s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:47:37 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed9d8ab-549c-4969-9106-056d3c0b6d45]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:47:37 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-a7fd3c9a-6ae0-4a0d-961c-b8ca4c467f29 tempest-VolumesGetTest-606996561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1ed5f534-1e3a-4828-94e8-b6e05f6749cb {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:38 devstack sudo[87454]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ba366b07-2903-4f99-af28-e16fdb210ed9 tempest-SnapshotsActionsTest-1850511053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee" returned: 0 in 0.604s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ba366b07-2903-4f99-af28-e16fdb210ed9 tempest-SnapshotsActionsTest-1850511053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b 1G {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:38 devstack sudo[87464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1ed5f534-1e3a-4828-94e8-b6e05f6749cb
Apr 09 12:47:38 devstack sudo[87464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:38 devstack sudo[87465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b 1G
Apr 09 12:47:38 devstack sudo[87465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:38 devstack sudo[87459]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-61067bd1-1066-4ee0-8b36-04a7fcb8e057 tempest-VolumesTransfersTest-40606047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a290e367-4b39-4032-85a5-4b83f4dd2f3c" returned: 0 in 0.605s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:38 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-61067bd1-1066-4ee0-8b36-04a7fcb8e057 tempest-VolumesTransfersTest-40606047 None] Lock "cinder-quobyte-a290e367-4b39-4032-85a5-4b83f4dd2f3c" released by "delete_volume" :: held 1.191s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:47:38 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-61067bd1-1066-4ee0-8b36-04a7fcb8e057 tempest-VolumesTransfersTest-40606047 None] Created reservations ['8543d0ad-343d-4f1a-8546-e5d3db2b375a', 'ba2dc66a-e353-4ad7-a2e8-dc36adea6798', 'a7c823d0-c953-4131-90f4-596044d3ce9d', '8c228922-efbc-4f92-b765-a525c3a704c2'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:47:38 devstack sudo[87464]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-a7fd3c9a-6ae0-4a0d-961c-b8ca4c467f29 tempest-VolumesGetTest-606996561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1ed5f534-1e3a-4828-94e8-b6e05f6749cb" returned: 0 in 0.547s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-a7fd3c9a-6ae0-4a0d-961c-b8ca4c467f29 tempest-VolumesGetTest-606996561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1ed5f534-1e3a-4828-94e8-b6e05f6749cb {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:38 devstack sudo[87474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1ed5f534-1e3a-4828-94e8-b6e05f6749cb
Apr 09 12:47:38 devstack sudo[87474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-61067bd1-1066-4ee0-8b36-04a7fcb8e057 tempest-VolumesTransfersTest-40606047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-61067bd1-1066-4ee0-8b36-04a7fcb8e057 tempest-VolumesTransfersTest-40606047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:38 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-61067bd1-1066-4ee0-8b36-04a7fcb8e057 tempest-VolumesTransfersTest-40606047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:47:38 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-61067bd1-1066-4ee0-8b36-04a7fcb8e057 tempest-VolumesTransfersTest-40606047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:47:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-61067bd1-1066-4ee0-8b36-04a7fcb8e057 tempest-VolumesTransfersTest-40606047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-61067bd1-1066-4ee0-8b36-04a7fcb8e057 tempest-VolumesTransfersTest-40606047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:38 devstack sudo[87477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:47:38 devstack sudo[87477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:38 devstack sudo[87465]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ba366b07-2903-4f99-af28-e16fdb210ed9 tempest-SnapshotsActionsTest-1850511053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b 1G" returned: 0 in 0.720s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ba366b07-2903-4f99-af28-e16fdb210ed9 tempest-SnapshotsActionsTest-1850511053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1c57785-89aa-474f-9b0a-229da9fff2ee -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:38 devstack sudo[87479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1c57785-89aa-474f-9b0a-229da9fff2ee -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b
Apr 09 12:47:38 devstack sudo[87479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:39 devstack sudo[87474]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-a7fd3c9a-6ae0-4a0d-961c-b8ca4c467f29 tempest-VolumesGetTest-606996561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1ed5f534-1e3a-4828-94e8-b6e05f6749cb" returned: 0 in 0.563s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:39 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-a7fd3c9a-6ae0-4a0d-961c-b8ca4c467f29 tempest-VolumesGetTest-606996561 None] Lock "cinder-quobyte-1ed5f534-1e3a-4828-94e8-b6e05f6749cb" released by "delete_volume" :: held 1.148s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:47:39 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-a7fd3c9a-6ae0-4a0d-961c-b8ca4c467f29 tempest-VolumesGetTest-606996561 None] Created reservations ['aca7356c-1cd4-4b02-88de-983aa2f885f0', '621618cd-f8ec-4651-800f-fee405210676', 'df7e372e-65db-4dd0-9868-78bb6b4e49e4', 'b852a4ff-655c-49bc-a10a-63db1cff543d'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:47:39 devstack sudo[87477]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-61067bd1-1066-4ee0-8b36-04a7fcb8e057 tempest-VolumesTransfersTest-40606047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.571s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:39 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-61067bd1-1066-4ee0-8b36-04a7fcb8e057 tempest-VolumesTransfersTest-40606047 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:47:39 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-61067bd1-1066-4ee0-8b36-04a7fcb8e057 tempest-VolumesTransfersTest-40606047 None] Deleted volume successfully.
Apr 09 12:47:39 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-61067bd1-1066-4ee0-8b36-04a7fcb8e057 tempest-VolumesTransfersTest-40606047 None] Lock "cinder-a290e367-4b39-4032-85a5-4b83f4dd2f3c-delete_volume" released by "delete_volume" :: held 1.996s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:47:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-a7fd3c9a-6ae0-4a0d-961c-b8ca4c467f29 tempest-VolumesGetTest-606996561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-a7fd3c9a-6ae0-4a0d-961c-b8ca4c467f29 tempest-VolumesGetTest-606996561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:39 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-a7fd3c9a-6ae0-4a0d-961c-b8ca4c467f29 tempest-VolumesGetTest-606996561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:47:39 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-a7fd3c9a-6ae0-4a0d-961c-b8ca4c467f29 tempest-VolumesGetTest-606996561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:47:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-a7fd3c9a-6ae0-4a0d-961c-b8ca4c467f29 tempest-VolumesGetTest-606996561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-a7fd3c9a-6ae0-4a0d-961c-b8ca4c467f29 tempest-VolumesGetTest-606996561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:39 devstack sudo[87486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:47:39 devstack sudo[87486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:39 devstack sudo[87479]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ba366b07-2903-4f99-af28-e16fdb210ed9 tempest-SnapshotsActionsTest-1850511053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1c57785-89aa-474f-9b0a-229da9fff2ee -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b" returned: 0 in 0.551s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:39 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-ba366b07-2903-4f99-af28-e16fdb210ed9 tempest-SnapshotsActionsTest-1850511053 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b is being set with open permissions: ugo+rw
Apr 09 12:47:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ba366b07-2903-4f99-af28-e16fdb210ed9 tempest-SnapshotsActionsTest-1850511053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:39 devstack sudo[87488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b
Apr 09 12:47:39 devstack sudo[87488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:39 devstack sudo[87488]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ba366b07-2903-4f99-af28-e16fdb210ed9 tempest-SnapshotsActionsTest-1850511053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b" returned: 0 in 0.593s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:39 devstack cinder-volume[82760]: DEBUG dbcounter [-] [82760] Writing DB stats cinder:UPDATE=193,cinder:DELETE=17,cinder:SELECT=146,cinder:INSERT=49 {{(pid=82760) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 12:47:39 devstack cinder-volume[82760]: DEBUG dbcounter [-] [82760] Writing DB stats cinder:SELECT=137,cinder:INSERT=55,cinder:UPDATE=197,cinder:DELETE=18 {{(pid=82760) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 12:47:39 devstack sudo[87486]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-a7fd3c9a-6ae0-4a0d-961c-b8ca4c467f29 tempest-VolumesGetTest-606996561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.698s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:39 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-a7fd3c9a-6ae0-4a0d-961c-b8ca4c467f29 tempest-VolumesGetTest-606996561 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:47:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ba366b07-2903-4f99-af28-e16fdb210ed9 tempest-SnapshotsActionsTest-1850511053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:39 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-a7fd3c9a-6ae0-4a0d-961c-b8ca4c467f29 tempest-VolumesGetTest-606996561 None] Deleted volume successfully.
Apr 09 12:47:39 devstack sudo[87526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.info
Apr 09 12:47:39 devstack sudo[87526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:39 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-a7fd3c9a-6ae0-4a0d-961c-b8ca4c467f29 tempest-VolumesGetTest-606996561 None] Lock "cinder-1ed5f534-1e3a-4828-94e8-b6e05f6749cb-delete_volume" released by "delete_volume" :: held 2.081s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:47:40 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-a60792ba-cfca-4e50-9475-465b43a3eca1 tempest-VolumesGetTest-606996561 None] Acquiring lock "cinder-3f79006d-9280-46f5-a521-3163d2b1f462-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:47:40 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-a60792ba-cfca-4e50-9475-465b43a3eca1 tempest-VolumesGetTest-606996561 None] Lock "cinder-3f79006d-9280-46f5-a521-3163d2b1f462-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:47:40 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-a60792ba-cfca-4e50-9475-465b43a3eca1 tempest-VolumesGetTest-606996561 None] Acquiring lock "cinder-quobyte-3f79006d-9280-46f5-a521-3163d2b1f462" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:47:40 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-a60792ba-cfca-4e50-9475-465b43a3eca1 tempest-VolumesGetTest-606996561 None] Lock "cinder-quobyte-3f79006d-9280-46f5-a521-3163d2b1f462" acquired by "delete_volume" :: waited 0.012s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:47:40 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e888408-fe6f-48c7-b87b-a86ea32c4abe]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:47:40 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-a60792ba-cfca-4e50-9475-465b43a3eca1 tempest-VolumesGetTest-606996561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3f79006d-9280-46f5-a521-3163d2b1f462 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:40 devstack sudo[87528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3f79006d-9280-46f5-a521-3163d2b1f462
Apr 09 12:47:40 devstack sudo[87528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:40 devstack sudo[87526]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:40 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ba366b07-2903-4f99-af28-e16fdb210ed9 tempest-SnapshotsActionsTest-1850511053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.info" returned: 0 in 0.610s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:40 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-ba366b07-2903-4f99-af28-e16fdb210ed9 tempest-SnapshotsActionsTest-1850511053 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.info is being set with open permissions: ugo+rw
Apr 09 12:47:40 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ba366b07-2903-4f99-af28-e16fdb210ed9 tempest-SnapshotsActionsTest-1850511053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:40 devstack sudo[87531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.info
Apr 09 12:47:40 devstack sudo[87531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:40 devstack sudo[87528]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:40 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-a60792ba-cfca-4e50-9475-465b43a3eca1 tempest-VolumesGetTest-606996561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3f79006d-9280-46f5-a521-3163d2b1f462" returned: 0 in 0.646s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:40 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-a60792ba-cfca-4e50-9475-465b43a3eca1 tempest-VolumesGetTest-606996561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3f79006d-9280-46f5-a521-3163d2b1f462 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:40 devstack sudo[87536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3f79006d-9280-46f5-a521-3163d2b1f462
Apr 09 12:47:40 devstack sudo[87536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:41 devstack sudo[87531]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:41 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ba366b07-2903-4f99-af28-e16fdb210ed9 tempest-SnapshotsActionsTest-1850511053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.info" returned: 0 in 0.657s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:41 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ba366b07-2903-4f99-af28-e16fdb210ed9 tempest-SnapshotsActionsTest-1850511053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.824s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:41 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-ba366b07-2903-4f99-af28-e16fdb210ed9 tempest-SnapshotsActionsTest-1850511053 None] Create snapshot completed successfully
Apr 09 12:47:41 devstack sudo[87536]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:41 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-a60792ba-cfca-4e50-9475-465b43a3eca1 tempest-VolumesGetTest-606996561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3f79006d-9280-46f5-a521-3163d2b1f462" returned: 0 in 0.564s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:41 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-a60792ba-cfca-4e50-9475-465b43a3eca1 tempest-VolumesGetTest-606996561 None] Lock "cinder-quobyte-3f79006d-9280-46f5-a521-3163d2b1f462" released by "delete_volume" :: held 1.247s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:47:41 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-a60792ba-cfca-4e50-9475-465b43a3eca1 tempest-VolumesGetTest-606996561 None] Created reservations ['bd8b3ae0-a707-40f6-b40b-1d804d6d1885', '41128af9-9a79-4e7a-a729-9da8e80c374e', '4393ed4b-d8bd-4db6-b7cc-76f52437bd5c', 'dd0d466b-91ac-4f34-97fa-3ea5525353c5'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:47:41 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-a60792ba-cfca-4e50-9475-465b43a3eca1 tempest-VolumesGetTest-606996561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:41 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-a60792ba-cfca-4e50-9475-465b43a3eca1 tempest-VolumesGetTest-606996561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:41 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-a60792ba-cfca-4e50-9475-465b43a3eca1 tempest-VolumesGetTest-606996561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:47:41 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-a60792ba-cfca-4e50-9475-465b43a3eca1 tempest-VolumesGetTest-606996561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:47:41 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-a60792ba-cfca-4e50-9475-465b43a3eca1 tempest-VolumesGetTest-606996561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:41 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-a60792ba-cfca-4e50-9475-465b43a3eca1 tempest-VolumesGetTest-606996561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:41 devstack sudo[87540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:47:41 devstack sudo[87540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:42 devstack sudo[87540]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:42 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-a60792ba-cfca-4e50-9475-465b43a3eca1 tempest-VolumesGetTest-606996561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.498s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:42 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-a60792ba-cfca-4e50-9475-465b43a3eca1 tempest-VolumesGetTest-606996561 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:47:42 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-a60792ba-cfca-4e50-9475-465b43a3eca1 tempest-VolumesGetTest-606996561 None] Deleted volume successfully.
Apr 09 12:47:42 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-a60792ba-cfca-4e50-9475-465b43a3eca1 tempest-VolumesGetTest-606996561 None] Lock "cinder-3f79006d-9280-46f5-a521-3163d2b1f462-delete_volume" released by "delete_volume" :: held 1.912s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:47:42 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-65eb364e-0a1c-4e31-9653-4f6a9c26aa14 tempest-VolumesGetTest-606996561 None] Acquiring lock "cinder-94ef36e6-a7db-4e18-861f-6c9b2c132018-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:47:42 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-65eb364e-0a1c-4e31-9653-4f6a9c26aa14 tempest-VolumesGetTest-606996561 None] Lock "cinder-94ef36e6-a7db-4e18-861f-6c9b2c132018-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:47:42 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-65eb364e-0a1c-4e31-9653-4f6a9c26aa14 tempest-VolumesGetTest-606996561 None] Acquiring lock "cinder-quobyte-94ef36e6-a7db-4e18-861f-6c9b2c132018" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:47:42 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-65eb364e-0a1c-4e31-9653-4f6a9c26aa14 tempest-VolumesGetTest-606996561 None] Lock "cinder-quobyte-94ef36e6-a7db-4e18-861f-6c9b2c132018" acquired by "delete_volume" :: waited 0.020s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:47:42 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[37fea0d8-aad8-4d06-aad3-2e0970794de1]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:47:42 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-65eb364e-0a1c-4e31-9653-4f6a9c26aa14 tempest-VolumesGetTest-606996561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:42 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-206e9680-a7c3-474f-8ebe-48deda3698d6 tempest-VolumeDependencyTests-476558810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:47:42 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-206e9680-a7c3-474f-8ebe-48deda3698d6 tempest-VolumeDependencyTests-476558810 None] Flow 'volume_create_manager' (b25ba364-b570-4bc9-b95f-5021087475d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:47:42 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-206e9680-a7c3-474f-8ebe-48deda3698d6 tempest-VolumeDependencyTests-476558810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95d9ba9e-1979-47fb-a7cf-a468a02a9c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:42 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-206e9680-a7c3-474f-8ebe-48deda3698d6 tempest-VolumeDependencyTests-476558810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95d9ba9e-1979-47fb-a7cf-a468a02a9c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1684748243',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d6deda8-96f0-4924-bcf0-3829657d33e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28f5a0458de448a0bde2c150376bc42e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:47:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:47:43Z,use_quota=True,user_id='a04a77cece624a4e9632672086c90ef5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:42 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-206e9680-a7c3-474f-8ebe-48deda3698d6 tempest-VolumeDependencyTests-476558810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0f803da-723c-40f7-aa4a-291d7d6ee69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:42 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-206e9680-a7c3-474f-8ebe-48deda3698d6 tempest-VolumeDependencyTests-476558810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0f803da-723c-40f7-aa4a-291d7d6ee69b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:42 devstack sudo[87544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018
Apr 09 12:47:42 devstack sudo[87544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:42 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-206e9680-a7c3-474f-8ebe-48deda3698d6 tempest-VolumeDependencyTests-476558810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f402ff1-b269-4abe-9874-d2c53b318448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:42 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-206e9680-a7c3-474f-8ebe-48deda3698d6 tempest-VolumeDependencyTests-476558810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f402ff1-b269-4abe-9874-d2c53b318448) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d6deda8-96f0-4924-bcf0-3829657d33e9', 'volume_name': 'volume-0d6deda8-96f0-4924-bcf0-3829657d33e9', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:42 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-206e9680-a7c3-474f-8ebe-48deda3698d6 tempest-VolumeDependencyTests-476558810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a57775cb-e838-4eb3-b0d0-c195da6535ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:42 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-206e9680-a7c3-474f-8ebe-48deda3698d6 tempest-VolumeDependencyTests-476558810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a57775cb-e838-4eb3-b0d0-c195da6535ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:42 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-206e9680-a7c3-474f-8ebe-48deda3698d6 tempest-VolumeDependencyTests-476558810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cebe03c1-fefc-4b1c-9f6b-69ab8aa3f79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:42 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-206e9680-a7c3-474f-8ebe-48deda3698d6 tempest-VolumeDependencyTests-476558810 None] Volume 0d6deda8-96f0-4924-bcf0-3829657d33e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d6deda8-96f0-4924-bcf0-3829657d33e9', 'volume_size': 1}
Apr 09 12:47:42 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-206e9680-a7c3-474f-8ebe-48deda3698d6 tempest-VolumeDependencyTests-476558810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:42 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-206e9680-a7c3-474f-8ebe-48deda3698d6 tempest-VolumeDependencyTests-476558810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:42 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-206e9680-a7c3-474f-8ebe-48deda3698d6 tempest-VolumeDependencyTests-476558810 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1684748243',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d6deda8-96f0-4924-bcf0-3829657d33e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28f5a0458de448a0bde2c150376bc42e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:47:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:47:43Z,use_quota=True,user_id='a04a77cece624a4e9632672086c90ef5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:47:42 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-206e9680-a7c3-474f-8ebe-48deda3698d6 tempest-VolumeDependencyTests-476558810 None] Creating volume 0d6deda8-96f0-4924-bcf0-3829657d33e9 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:47:42 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-206e9680-a7c3-474f-8ebe-48deda3698d6 tempest-VolumeDependencyTests-476558810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:42 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-206e9680-a7c3-474f-8ebe-48deda3698d6 tempest-VolumeDependencyTests-476558810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:42 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-206e9680-a7c3-474f-8ebe-48deda3698d6 tempest-VolumeDependencyTests-476558810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:47:42 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-206e9680-a7c3-474f-8ebe-48deda3698d6 tempest-VolumeDependencyTests-476558810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:47:42 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-206e9680-a7c3-474f-8ebe-48deda3698d6 tempest-VolumeDependencyTests-476558810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:42 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-206e9680-a7c3-474f-8ebe-48deda3698d6 tempest-VolumeDependencyTests-476558810 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:47:42 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-206e9680-a7c3-474f-8ebe-48deda3698d6 tempest-VolumeDependencyTests-476558810 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:47:42 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-206e9680-a7c3-474f-8ebe-48deda3698d6 tempest-VolumeDependencyTests-476558810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:42 devstack sudo[87546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9 1073741824
Apr 09 12:47:42 devstack sudo[87546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:42 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-2fa74d09-a26d-4fff-9569-18862f675bc1 tempest-SnapshotsActionsTest-1850511053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:43 devstack sudo[87544]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:43 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-65eb364e-0a1c-4e31-9653-4f6a9c26aa14 tempest-VolumesGetTest-606996561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018" returned: 0 in 0.583s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:43 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-65eb364e-0a1c-4e31-9653-4f6a9c26aa14 tempest-VolumesGetTest-606996561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:43 devstack sudo[87554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018
Apr 09 12:47:43 devstack sudo[87554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:43 devstack sudo[87546]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:43 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-206e9680-a7c3-474f-8ebe-48deda3698d6 tempest-VolumeDependencyTests-476558810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9 1073741824" returned: 0 in 0.585s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:43 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-206e9680-a7c3-474f-8ebe-48deda3698d6 tempest-VolumeDependencyTests-476558810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:43 devstack sudo[87556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9
Apr 09 12:47:43 devstack sudo[87556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:43 devstack sudo[87554]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:43 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-65eb364e-0a1c-4e31-9653-4f6a9c26aa14 tempest-VolumesGetTest-606996561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-94ef36e6-a7db-4e18-861f-6c9b2c132018" returned: 0 in 0.522s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:43 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-65eb364e-0a1c-4e31-9653-4f6a9c26aa14 tempest-VolumesGetTest-606996561 None] Lock "cinder-quobyte-94ef36e6-a7db-4e18-861f-6c9b2c132018" released by "delete_volume" :: held 1.160s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:47:43 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-65eb364e-0a1c-4e31-9653-4f6a9c26aa14 tempest-VolumesGetTest-606996561 None] Created reservations ['f23ce959-4774-4eb2-aa9d-70a605bf8aad', 'd0bf2edc-2796-43fd-b55f-9771292ef80c', 'c03c1ebf-f321-4e1a-902d-a56f3a928a70', '0d7e8ef6-1046-4949-8bc9-202172fd1679'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:47:43 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-65eb364e-0a1c-4e31-9653-4f6a9c26aa14 tempest-VolumesGetTest-606996561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:43 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-65eb364e-0a1c-4e31-9653-4f6a9c26aa14 tempest-VolumesGetTest-606996561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:43 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-65eb364e-0a1c-4e31-9653-4f6a9c26aa14 tempest-VolumesGetTest-606996561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:47:43 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-65eb364e-0a1c-4e31-9653-4f6a9c26aa14 tempest-VolumesGetTest-606996561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:47:43 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-65eb364e-0a1c-4e31-9653-4f6a9c26aa14 tempest-VolumesGetTest-606996561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:43 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-65eb364e-0a1c-4e31-9653-4f6a9c26aa14 tempest-VolumesGetTest-606996561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:43 devstack sudo[87560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:47:43 devstack sudo[87560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:43 devstack sudo[87556]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:43 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-206e9680-a7c3-474f-8ebe-48deda3698d6 tempest-VolumeDependencyTests-476558810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9" returned: 0 in 0.488s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:43 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-206e9680-a7c3-474f-8ebe-48deda3698d6 tempest-VolumeDependencyTests-476558810 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:47:43 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-206e9680-a7c3-474f-8ebe-48deda3698d6 tempest-VolumeDependencyTests-476558810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:43 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-2fa74d09-a26d-4fff-9569-18862f675bc1 tempest-SnapshotsActionsTest-1850511053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.075s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:43 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-206e9680-a7c3-474f-8ebe-48deda3698d6 tempest-VolumeDependencyTests-476558810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cebe03c1-fefc-4b1c-9f6b-69ab8aa3f79b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d6deda8-96f0-4924-bcf0-3829657d33e9', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:43 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-206e9680-a7c3-474f-8ebe-48deda3698d6 tempest-VolumeDependencyTests-476558810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1414deab-d71a-4f5f-a9fc-c7bead134c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:43 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-2fa74d09-a26d-4fff-9569-18862f675bc1 tempest-SnapshotsActionsTest-1850511053 None] Creating offline snapshot b111f6a3-36d0-49ba-b193-4f7352aff34e of volume f1c57785-89aa-474f-9b0a-229da9fff2ee {{(pid=82760) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 12:47:44 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-206e9680-a7c3-474f-8ebe-48deda3698d6 tempest-VolumeDependencyTests-476558810 None] Volume volume-0d6deda8-96f0-4924-bcf0-3829657d33e9 (0d6deda8-96f0-4924-bcf0-3829657d33e9): created successfully
Apr 09 12:47:44 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-206e9680-a7c3-474f-8ebe-48deda3698d6 tempest-VolumeDependencyTests-476558810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1414deab-d71a-4f5f-a9fc-c7bead134c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:44 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-206e9680-a7c3-474f-8ebe-48deda3698d6 tempest-VolumeDependencyTests-476558810 None] Flow 'volume_create_manager' (b25ba364-b570-4bc9-b95f-5021087475d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:47:44 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e090bd-faf0-4e6c-94f2-f7047cc8fab5]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:47:44 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2fa74d09-a26d-4fff-9569-18862f675bc1 tempest-SnapshotsActionsTest-1850511053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:44 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-206e9680-a7c3-474f-8ebe-48deda3698d6 tempest-VolumeDependencyTests-476558810 None] Created volume successfully.
Apr 09 12:47:44 devstack sudo[87562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b
Apr 09 12:47:44 devstack sudo[87562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:44 devstack sudo[87560]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:44 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-65eb364e-0a1c-4e31-9653-4f6a9c26aa14 tempest-VolumesGetTest-606996561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.503s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:44 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-65eb364e-0a1c-4e31-9653-4f6a9c26aa14 tempest-VolumesGetTest-606996561 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:47:44 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-65eb364e-0a1c-4e31-9653-4f6a9c26aa14 tempest-VolumesGetTest-606996561 None] Deleted volume successfully.
Apr 09 12:47:44 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-65eb364e-0a1c-4e31-9653-4f6a9c26aa14 tempest-VolumesGetTest-606996561 None] Lock "cinder-94ef36e6-a7db-4e18-861f-6c9b2c132018-delete_volume" released by "delete_volume" :: held 1.838s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:47:44 devstack sudo[87562]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:44 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2fa74d09-a26d-4fff-9569-18862f675bc1 tempest-SnapshotsActionsTest-1850511053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b" returned: 0 in 0.534s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:44 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-2fa74d09-a26d-4fff-9569-18862f675bc1 tempest-SnapshotsActionsTest-1850511053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1c57785-89aa-474f-9b0a-229da9fff2ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:47:44 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2fa74d09-a26d-4fff-9569-18862f675bc1 tempest-SnapshotsActionsTest-1850511053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.b111f6a3-36d0-49ba-b193-4f7352aff34e 1G {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:44 devstack sudo[87568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.b111f6a3-36d0-49ba-b193-4f7352aff34e 1G
Apr 09 12:47:44 devstack sudo[87568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:44 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-f090017f-cdd7-49e5-a889-a7e7f90fed1a tempest-VolumesTransfersV355Test-383635032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:47:44 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f090017f-cdd7-49e5-a889-a7e7f90fed1a tempest-VolumesTransfersV355Test-383635032 None] Flow 'volume_create_manager' (a8ceee71-1837-48ad-b74b-c769ad138826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:47:44 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f090017f-cdd7-49e5-a889-a7e7f90fed1a tempest-VolumesTransfersV355Test-383635032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a956bd31-9767-4fe3-a564-adf5bfe50383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:44 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f090017f-cdd7-49e5-a889-a7e7f90fed1a tempest-VolumesTransfersV355Test-383635032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a956bd31-9767-4fe3-a564-adf5bfe50383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:47:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1622432063',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ad8291f-a524-41a9-b537-ea493e37411c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a61a1ac602c48a6b3719828bc3f61bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:47:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:47:45Z,use_quota=True,user_id='d069fd236b06494682cf0dff282d7e66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:44 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f090017f-cdd7-49e5-a889-a7e7f90fed1a tempest-VolumesTransfersV355Test-383635032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a59fe370-838d-47de-9a95-e30577c232b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:44 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f090017f-cdd7-49e5-a889-a7e7f90fed1a tempest-VolumesTransfersV355Test-383635032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a59fe370-838d-47de-9a95-e30577c232b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:44 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f090017f-cdd7-49e5-a889-a7e7f90fed1a tempest-VolumesTransfersV355Test-383635032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4069eff8-13ed-407e-8220-834259b85302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:44 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f090017f-cdd7-49e5-a889-a7e7f90fed1a tempest-VolumesTransfersV355Test-383635032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4069eff8-13ed-407e-8220-834259b85302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ad8291f-a524-41a9-b537-ea493e37411c', 'volume_name': 'volume-7ad8291f-a524-41a9-b537-ea493e37411c', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:44 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f090017f-cdd7-49e5-a889-a7e7f90fed1a tempest-VolumesTransfersV355Test-383635032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e1319a3-076e-4f3f-bbe2-8a5ba24cc86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:44 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f090017f-cdd7-49e5-a889-a7e7f90fed1a tempest-VolumesTransfersV355Test-383635032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e1319a3-076e-4f3f-bbe2-8a5ba24cc86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:44 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f090017f-cdd7-49e5-a889-a7e7f90fed1a tempest-VolumesTransfersV355Test-383635032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb6f09f7-9fa1-4a62-b7a2-3a58a65c2f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:44 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-f090017f-cdd7-49e5-a889-a7e7f90fed1a tempest-VolumesTransfersV355Test-383635032 None] Volume 7ad8291f-a524-41a9-b537-ea493e37411c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ad8291f-a524-41a9-b537-ea493e37411c', 'volume_size': 1}
Apr 09 12:47:44 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f090017f-cdd7-49e5-a889-a7e7f90fed1a tempest-VolumesTransfersV355Test-383635032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:44 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-49e63a4d-745b-4341-a108-0746405cace5 tempest-VolumeDependencyTests-476558810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:45 devstack sudo[87568]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:45 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2fa74d09-a26d-4fff-9569-18862f675bc1 tempest-SnapshotsActionsTest-1850511053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.b111f6a3-36d0-49ba-b193-4f7352aff34e 1G" returned: 0 in 0.619s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:45 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2fa74d09-a26d-4fff-9569-18862f675bc1 tempest-SnapshotsActionsTest-1850511053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.b111f6a3-36d0-49ba-b193-4f7352aff34e {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:45 devstack sudo[87573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.b111f6a3-36d0-49ba-b193-4f7352aff34e
Apr 09 12:47:45 devstack sudo[87573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:45 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:47:45 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] Flow 'volume_create_manager' (d120e0fa-cf38-4162-b007-dc4499aa4882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:47:45 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ceea10a-b69a-46dc-8fd3-f166d8e050fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:45 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ceea10a-b69a-46dc-8fd3-f166d8e050fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:47:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-337077529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc9493d8-4151-42ed-af89-b52bacdd253b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b1e2e15da8734d00b19bb36f846ccfc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:47:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:47:45Z,use_quota=True,user_id='f0fe31af3e8c462da1930eb8650f1836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:45 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (167be2bd-b6a3-4434-99a6-d7a30f1c2ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:45 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (167be2bd-b6a3-4434-99a6-d7a30f1c2ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:45 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e33f8c4-3c4f-4798-bc42-0ab8e1de3887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:45 devstack cinder-volume[82760]: DEBUG cinder.image.glance [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] Creating Keystone auth plugin from conf {{(pid=82760) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 09 12:47:45 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e33f8c4-3c4f-4798-bc42-0ab8e1de3887) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cc9493d8-4151-42ed-af89-b52bacdd253b', 'volume_name': 'volume-cc9493d8-4151-42ed-af89-b52bacdd253b', 'volume_size': 1, 'image_id': '11bf303b-adca-49d8-8d80-d4a3c72e719a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11bf303b-adca-49d8-8d80-d4a3c72e719a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c43b4928ecdf4421ad23e5f918ea33fe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '11bf303b-adca-49d8-8d80-d4a3c72e719a', 'created_at': datetime.datetime(2026, 4, 9, 10, 38, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 10, 38, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11bf303b-adca-49d8-8d80-d4a3c72e719a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f378dfe5fc0>}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:45 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5a5407f-0fcc-4f3b-8601-a96d8ec0c440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:45 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5a5407f-0fcc-4f3b-8601-a96d8ec0c440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:45 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd669da0-409a-4749-a1da-7784fcdeef04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:45 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] Volume cc9493d8-4151-42ed-af89-b52bacdd253b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cc9493d8-4151-42ed-af89-b52bacdd253b', 'volume_size': 1, 'image_id': '11bf303b-adca-49d8-8d80-d4a3c72e719a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11bf303b-adca-49d8-8d80-d4a3c72e719a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c43b4928ecdf4421ad23e5f918ea33fe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '11bf303b-adca-49d8-8d80-d4a3c72e719a', 'created_at': datetime.datetime(2026, 4, 9, 10, 38, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 10, 38, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11bf303b-adca-49d8-8d80-d4a3c72e719a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f378dfe5fc0>}
Apr 09 12:47:45 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] Trying to clone cc9493d8-4151-42ed-af89-b52bacdd253b from image 11bf303b-adca-49d8-8d80-d4a3c72e719a at location (None, [{'url': 'file:///opt/stack/data/glance/images/11bf303b-adca-49d8-8d80-d4a3c72e719a', 'metadata': {}}]). {{(pid=82760) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 09 12:47:45 devstack sudo[87573]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:45 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2fa74d09-a26d-4fff-9569-18862f675bc1 tempest-SnapshotsActionsTest-1850511053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.b111f6a3-36d0-49ba-b193-4f7352aff34e" returned: 0 in 0.518s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:45 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-2fa74d09-a26d-4fff-9569-18862f675bc1 tempest-SnapshotsActionsTest-1850511053 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.b111f6a3-36d0-49ba-b193-4f7352aff34e is being set with open permissions: ugo+rw
Apr 09 12:47:45 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2fa74d09-a26d-4fff-9569-18862f675bc1 tempest-SnapshotsActionsTest-1850511053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.b111f6a3-36d0-49ba-b193-4f7352aff34e {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:45 devstack sudo[87579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.b111f6a3-36d0-49ba-b193-4f7352aff34e
Apr 09 12:47:45 devstack sudo[87579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:45 devstack cinder-volume[82760]: DEBUG cinder.image.image_utils [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_11bf303b-adca-49d8-8d80-d4a3c72e719a_yqzj8ryydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82760) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 09 12:47:45 devstack cinder-volume[82760]: INFO cinder.image.image_utils [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] Image download 20.69 MB at 20.69 MB/s
Apr 09 12:47:45 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a24ace-2d2c-480a-8fb5-311fad6f1b60]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:47:45 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11bf303b-adca-49d8-8d80-d4a3c72e719a_yqzj8ryydevstack@QuobyteHD {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:45 devstack sudo[87581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11bf303b-adca-49d8-8d80-d4a3c72e719a_yqzj8ryydevstack@QuobyteHD
Apr 09 12:47:45 devstack sudo[87581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:46 devstack sudo[87579]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2fa74d09-a26d-4fff-9569-18862f675bc1 tempest-SnapshotsActionsTest-1850511053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.b111f6a3-36d0-49ba-b193-4f7352aff34e" returned: 0 in 0.508s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-2fa74d09-a26d-4fff-9569-18862f675bc1 tempest-SnapshotsActionsTest-1850511053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.282s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f090017f-cdd7-49e5-a889-a7e7f90fed1a tempest-VolumesTransfersV355Test-383635032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.364s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:46 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f090017f-cdd7-49e5-a889-a7e7f90fed1a tempest-VolumesTransfersV355Test-383635032 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:47:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1622432063',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ad8291f-a524-41a9-b537-ea493e37411c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a61a1ac602c48a6b3719828bc3f61bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:47:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:47:45Z,use_quota=True,user_id='d069fd236b06494682cf0dff282d7e66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:47:46 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-f090017f-cdd7-49e5-a889-a7e7f90fed1a tempest-VolumesTransfersV355Test-383635032 None] Creating volume 7ad8291f-a524-41a9-b537-ea493e37411c {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:47:46 devstack sudo[87581]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f090017f-cdd7-49e5-a889-a7e7f90fed1a tempest-VolumesTransfersV355Test-383635032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f090017f-cdd7-49e5-a889-a7e7f90fed1a tempest-VolumesTransfersV355Test-383635032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:46 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f090017f-cdd7-49e5-a889-a7e7f90fed1a tempest-VolumesTransfersV355Test-383635032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:47:46 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f090017f-cdd7-49e5-a889-a7e7f90fed1a tempest-VolumesTransfersV355Test-383635032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:47:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f090017f-cdd7-49e5-a889-a7e7f90fed1a tempest-VolumesTransfersV355Test-383635032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:46 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f090017f-cdd7-49e5-a889-a7e7f90fed1a tempest-VolumesTransfersV355Test-383635032 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:47:46 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-f090017f-cdd7-49e5-a889-a7e7f90fed1a tempest-VolumesTransfersV355Test-383635032 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:47:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f090017f-cdd7-49e5-a889-a7e7f90fed1a tempest-VolumesTransfersV355Test-383635032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7ad8291f-a524-41a9-b537-ea493e37411c 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11bf303b-adca-49d8-8d80-d4a3c72e719a_yqzj8ryydevstack@QuobyteHD" returned: 0 in 0.500s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:46 devstack cinder-volume[82760]: DEBUG cinder.image.image_utils [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] Temporary image 11bf303b-adca-49d8-8d80-d4a3c72e719a is fetched for user f0fe31af3e8c462da1930eb8650f1836. {{(pid=82760) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 09 12:47:46 devstack sudo[87587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7ad8291f-a524-41a9-b537-ea493e37411c 1073741824
Apr 09 12:47:46 devstack sudo[87587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:46 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-2fa74d09-a26d-4fff-9569-18862f675bc1 tempest-SnapshotsActionsTest-1850511053 None] Create snapshot completed successfully
Apr 09 12:47:46 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c15b70d-9f9d-4698-84ad-d43e4b5eee2c]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:47:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11bf303b-adca-49d8-8d80-d4a3c72e719a_yqzj8ryydevstack@QuobyteHD {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:46 devstack sudo[87589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11bf303b-adca-49d8-8d80-d4a3c72e719a_yqzj8ryydevstack@QuobyteHD
Apr 09 12:47:46 devstack sudo[87589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:46 devstack sudo[87587]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f090017f-cdd7-49e5-a889-a7e7f90fed1a tempest-VolumesTransfersV355Test-383635032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7ad8291f-a524-41a9-b537-ea493e37411c 1073741824" returned: 0 in 0.531s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:46 devstack sudo[87589]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11bf303b-adca-49d8-8d80-d4a3c72e719a_yqzj8ryydevstack@QuobyteHD" returned: 0 in 0.477s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f090017f-cdd7-49e5-a889-a7e7f90fed1a tempest-VolumesTransfersV355Test-383635032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7ad8291f-a524-41a9-b537-ea493e37411c {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:46 devstack sudo[87597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7ad8291f-a524-41a9-b537-ea493e37411c
Apr 09 12:47:46 devstack sudo[87597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:47 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-08a2875b-2b5d-4163-b959-58c380559ad0 tempest-SnapshotsActionsTest-758081170 None] Acquiring lock "cinder-b111f6a3-36d0-49ba-b193-4f7352aff34e-delete_snapshot" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:47:47 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-08a2875b-2b5d-4163-b959-58c380559ad0 tempest-SnapshotsActionsTest-758081170 None] Lock "cinder-b111f6a3-36d0-49ba-b193-4f7352aff34e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:47:47 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-08a2875b-2b5d-4163-b959-58c380559ad0 tempest-SnapshotsActionsTest-758081170 None] Acquiring lock "cinder-quobyte-f1c57785-89aa-474f-9b0a-229da9fff2ee" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:47:47 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-08a2875b-2b5d-4163-b959-58c380559ad0 tempest-SnapshotsActionsTest-758081170 None] Lock "cinder-quobyte-f1c57785-89aa-474f-9b0a-229da9fff2ee" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:47:47 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-08a2875b-2b5d-4163-b959-58c380559ad0 tempest-SnapshotsActionsTest-758081170 None] Acquiring lock "cinder-quobyte-b111f6a3-36d0-49ba-b193-4f7352aff34e" by "_delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:47:47 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-08a2875b-2b5d-4163-b959-58c380559ad0 tempest-SnapshotsActionsTest-758081170 None] Lock "cinder-quobyte-b111f6a3-36d0-49ba-b193-4f7352aff34e" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:47:47 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-08a2875b-2b5d-4163-b959-58c380559ad0 tempest-SnapshotsActionsTest-758081170 None] Deleting offline snapshot b111f6a3-36d0-49ba-b193-4f7352aff34e of volume f1c57785-89aa-474f-9b0a-229da9fff2ee {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 12:47:47 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-08a2875b-2b5d-4163-b959-58c380559ad0 tempest-SnapshotsActionsTest-758081170 None] snapshot_file for this snap is: volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.b111f6a3-36d0-49ba-b193-4f7352aff34e {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 12:47:47 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8fc8be-d72f-4688-ae52-82483cdeabd0]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:47:47 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-08a2875b-2b5d-4163-b959-58c380559ad0 tempest-SnapshotsActionsTest-758081170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.b111f6a3-36d0-49ba-b193-4f7352aff34e {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:47 devstack sudo[87597]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:47 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f090017f-cdd7-49e5-a889-a7e7f90fed1a tempest-VolumesTransfersV355Test-383635032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7ad8291f-a524-41a9-b537-ea493e37411c" returned: 0 in 0.430s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:47 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f090017f-cdd7-49e5-a889-a7e7f90fed1a tempest-VolumesTransfersV355Test-383635032 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:47:47 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f090017f-cdd7-49e5-a889-a7e7f90fed1a tempest-VolumesTransfersV355Test-383635032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:47 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-49e63a4d-745b-4341-a108-0746405cace5 tempest-VolumeDependencyTests-476558810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.342s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:47 devstack sudo[87600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.b111f6a3-36d0-49ba-b193-4f7352aff34e
Apr 09 12:47:47 devstack sudo[87600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:47 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-49e63a4d-745b-4341-a108-0746405cace5 tempest-VolumeDependencyTests-476558810 None] Creating offline snapshot 9934c9b8-db5a-4468-b3b6-090c027c7f0d of volume 0d6deda8-96f0-4924-bcf0-3829657d33e9 {{(pid=82760) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 12:47:47 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f090017f-cdd7-49e5-a889-a7e7f90fed1a tempest-VolumesTransfersV355Test-383635032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb6f09f7-9fa1-4a62-b7a2-3a58a65c2f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ad8291f-a524-41a9-b537-ea493e37411c', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:47 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f090017f-cdd7-49e5-a889-a7e7f90fed1a tempest-VolumesTransfersV355Test-383635032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (510845dc-599c-4d67-954e-03d32cf53afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:47 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ea2d24-36a7-4ac6-afe3-29bfc066b7b8]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:47:47 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-49e63a4d-745b-4341-a108-0746405cace5 tempest-VolumeDependencyTests-476558810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:47 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-f090017f-cdd7-49e5-a889-a7e7f90fed1a tempest-VolumesTransfersV355Test-383635032 None] Volume volume-7ad8291f-a524-41a9-b537-ea493e37411c (7ad8291f-a524-41a9-b537-ea493e37411c): created successfully
Apr 09 12:47:47 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f090017f-cdd7-49e5-a889-a7e7f90fed1a tempest-VolumesTransfersV355Test-383635032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (510845dc-599c-4d67-954e-03d32cf53afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:47 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f090017f-cdd7-49e5-a889-a7e7f90fed1a tempest-VolumesTransfersV355Test-383635032 None] Flow 'volume_create_manager' (a8ceee71-1837-48ad-b74b-c769ad138826) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:47:47 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-f090017f-cdd7-49e5-a889-a7e7f90fed1a tempest-VolumesTransfersV355Test-383635032 None] Created volume successfully.
Apr 09 12:47:47 devstack sudo[87602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9
Apr 09 12:47:47 devstack sudo[87602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:47 devstack sudo[87600]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:47 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-08a2875b-2b5d-4163-b959-58c380559ad0 tempest-SnapshotsActionsTest-758081170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.b111f6a3-36d0-49ba-b193-4f7352aff34e" returned: 0 in 0.578s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:47 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-08a2875b-2b5d-4163-b959-58c380559ad0 tempest-SnapshotsActionsTest-758081170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1c57785-89aa-474f-9b0a-229da9fff2ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:47:47 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[b827337d-b0c3-4cb4-9bdc-55564b5c74f0]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:47:47 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-08a2875b-2b5d-4163-b959-58c380559ad0 tempest-SnapshotsActionsTest-758081170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:47 devstack sudo[87609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b
Apr 09 12:47:47 devstack sudo[87609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:47 devstack sudo[87602]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:47 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-49e63a4d-745b-4341-a108-0746405cace5 tempest-VolumeDependencyTests-476558810 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9" returned: 0 in 0.592s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:47 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-49e63a4d-745b-4341-a108-0746405cace5 tempest-VolumeDependencyTests-476558810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9.9934c9b8-db5a-4468-b3b6-090c027c7f0d 1G {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:47 devstack sudo[87612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9.9934c9b8-db5a-4468-b3b6-090c027c7f0d 1G
Apr 09 12:47:47 devstack sudo[87612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:48 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-3a0d9a65-f981-4f68-a68a-35f65e5ab4ef tempest-VolumesTransfersV355Test-613855517 None] Transfer volume completed successfully.
Apr 09 12:47:48 devstack sudo[87609]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:48 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-08a2875b-2b5d-4163-b959-58c380559ad0 tempest-SnapshotsActionsTest-758081170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b" returned: 0 in 0.646s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:48 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-08a2875b-2b5d-4163-b959-58c380559ad0 tempest-SnapshotsActionsTest-758081170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1c57785-89aa-474f-9b0a-229da9fff2ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:47:48 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-08a2875b-2b5d-4163-b959-58c380559ad0 tempest-SnapshotsActionsTest-758081170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.b111f6a3-36d0-49ba-b193-4f7352aff34e {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:48 devstack sudo[87620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.b111f6a3-36d0-49ba-b193-4f7352aff34e
Apr 09 12:47:48 devstack sudo[87620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:48 devstack sudo[87612]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:48 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-49e63a4d-745b-4341-a108-0746405cace5 tempest-VolumeDependencyTests-476558810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9.9934c9b8-db5a-4468-b3b6-090c027c7f0d 1G" returned: 0 in 0.590s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:48 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-49e63a4d-745b-4341-a108-0746405cace5 tempest-VolumeDependencyTests-476558810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d6deda8-96f0-4924-bcf0-3829657d33e9 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9.9934c9b8-db5a-4468-b3b6-090c027c7f0d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:48 devstack sudo[87622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d6deda8-96f0-4924-bcf0-3829657d33e9 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9.9934c9b8-db5a-4468-b3b6-090c027c7f0d
Apr 09 12:47:48 devstack sudo[87622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:48 devstack sudo[87622]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:48 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-49e63a4d-745b-4341-a108-0746405cace5 tempest-VolumeDependencyTests-476558810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d6deda8-96f0-4924-bcf0-3829657d33e9 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9.9934c9b8-db5a-4468-b3b6-090c027c7f0d" returned: 0 in 0.445s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:48 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-49e63a4d-745b-4341-a108-0746405cace5 tempest-VolumeDependencyTests-476558810 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9.9934c9b8-db5a-4468-b3b6-090c027c7f0d is being set with open permissions: ugo+rw
Apr 09 12:47:48 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-49e63a4d-745b-4341-a108-0746405cace5 tempest-VolumeDependencyTests-476558810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9.9934c9b8-db5a-4468-b3b6-090c027c7f0d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:48 devstack sudo[87630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9.9934c9b8-db5a-4468-b3b6-090c027c7f0d
Apr 09 12:47:48 devstack sudo[87630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:49 devstack sudo[87620]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:49 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-08a2875b-2b5d-4163-b959-58c380559ad0 tempest-SnapshotsActionsTest-758081170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.b111f6a3-36d0-49ba-b193-4f7352aff34e" returned: 0 in 0.643s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:49 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-08a2875b-2b5d-4163-b959-58c380559ad0 tempest-SnapshotsActionsTest-758081170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.b111f6a3-36d0-49ba-b193-4f7352aff34e {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:49 devstack sudo[87632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.b111f6a3-36d0-49ba-b193-4f7352aff34e
Apr 09 12:47:49 devstack sudo[87632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:49 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-25bd41d2-a25d-4d04-bac6-0b1608ce53e2 tempest-VolumesTransfersV355Test-1294951454 None] Acquiring lock "cinder-7ad8291f-a524-41a9-b537-ea493e37411c-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:47:49 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-25bd41d2-a25d-4d04-bac6-0b1608ce53e2 tempest-VolumesTransfersV355Test-1294951454 None] Lock "cinder-7ad8291f-a524-41a9-b537-ea493e37411c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:47:49 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-25bd41d2-a25d-4d04-bac6-0b1608ce53e2 tempest-VolumesTransfersV355Test-1294951454 None] Acquiring lock "cinder-quobyte-7ad8291f-a524-41a9-b537-ea493e37411c" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:47:49 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-25bd41d2-a25d-4d04-bac6-0b1608ce53e2 tempest-VolumesTransfersV355Test-1294951454 None] Lock "cinder-quobyte-7ad8291f-a524-41a9-b537-ea493e37411c" acquired by "delete_volume" :: waited 0.009s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:47:49 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[392a2c74-c49a-40ad-af41-8519774ca971]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:47:49 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-25bd41d2-a25d-4d04-bac6-0b1608ce53e2 tempest-VolumesTransfersV355Test-1294951454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7ad8291f-a524-41a9-b537-ea493e37411c {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:49 devstack sudo[87634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7ad8291f-a524-41a9-b537-ea493e37411c
Apr 09 12:47:49 devstack sudo[87634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:49 devstack sudo[87630]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:49 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-49e63a4d-745b-4341-a108-0746405cace5 tempest-VolumeDependencyTests-476558810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9.9934c9b8-db5a-4468-b3b6-090c027c7f0d" returned: 0 in 0.465s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:49 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-49e63a4d-745b-4341-a108-0746405cace5 tempest-VolumeDependencyTests-476558810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:49 devstack sudo[87637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9.info
Apr 09 12:47:49 devstack sudo[87637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:49 devstack sudo[87632]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:49 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-08a2875b-2b5d-4163-b959-58c380559ad0 tempest-SnapshotsActionsTest-758081170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.b111f6a3-36d0-49ba-b193-4f7352aff34e" returned: 0 in 0.496s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:49 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-08a2875b-2b5d-4163-b959-58c380559ad0 tempest-SnapshotsActionsTest-758081170 None] Lock "cinder-quobyte-b111f6a3-36d0-49ba-b193-4f7352aff34e" released by "_delete_snapshot" :: held 2.421s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:47:49 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-08a2875b-2b5d-4163-b959-58c380559ad0 tempest-SnapshotsActionsTest-758081170 None] Lock "cinder-quobyte-f1c57785-89aa-474f-9b0a-229da9fff2ee" released by "delete_snapshot" :: held 2.440s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:47:49 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-08a2875b-2b5d-4163-b959-58c380559ad0 tempest-SnapshotsActionsTest-758081170 None] Created reservations ['6d64b2e1-152f-464a-be06-9b6f63762041', 'c4b3a4be-d083-4ca0-a031-b6998e1c146e', 'be330ff0-b63e-415f-8690-92d32372c4bb', 'fd304ba1-cfcf-4684-8c87-59198189b8c2'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:47:49 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-08a2875b-2b5d-4163-b959-58c380559ad0 tempest-SnapshotsActionsTest-758081170 None] Delete snapshot completed successfully.
Apr 09 12:47:49 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-08a2875b-2b5d-4163-b959-58c380559ad0 tempest-SnapshotsActionsTest-758081170 None] Lock "cinder-b111f6a3-36d0-49ba-b193-4f7352aff34e-delete_snapshot" released by "delete_snapshot" :: held 2.543s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:47:49 devstack sudo[87634]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:49 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-25bd41d2-a25d-4d04-bac6-0b1608ce53e2 tempest-VolumesTransfersV355Test-1294951454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7ad8291f-a524-41a9-b537-ea493e37411c" returned: 0 in 0.509s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:49 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-25bd41d2-a25d-4d04-bac6-0b1608ce53e2 tempest-VolumesTransfersV355Test-1294951454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7ad8291f-a524-41a9-b537-ea493e37411c {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:49 devstack sudo[87644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7ad8291f-a524-41a9-b537-ea493e37411c
Apr 09 12:47:49 devstack sudo[87644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:49 devstack sudo[87637]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:49 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-49e63a4d-745b-4341-a108-0746405cace5 tempest-VolumeDependencyTests-476558810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9.info" returned: 0 in 0.458s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:49 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-49e63a4d-745b-4341-a108-0746405cace5 tempest-VolumeDependencyTests-476558810 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9.info is being set with open permissions: ugo+rw
Apr 09 12:47:49 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-49e63a4d-745b-4341-a108-0746405cace5 tempest-VolumeDependencyTests-476558810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:49 devstack sudo[87646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9.info
Apr 09 12:47:49 devstack sudo[87646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:50 devstack sudo[87644]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-25bd41d2-a25d-4d04-bac6-0b1608ce53e2 tempest-VolumesTransfersV355Test-1294951454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7ad8291f-a524-41a9-b537-ea493e37411c" returned: 0 in 0.402s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:50 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-25bd41d2-a25d-4d04-bac6-0b1608ce53e2 tempest-VolumesTransfersV355Test-1294951454 None] Lock "cinder-quobyte-7ad8291f-a524-41a9-b537-ea493e37411c" released by "delete_volume" :: held 0.936s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:47:50 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-25bd41d2-a25d-4d04-bac6-0b1608ce53e2 tempest-VolumesTransfersV355Test-1294951454 None] Created reservations ['24ee9f36-b9da-4cb0-a28e-59aad109f874', 'bb658c41-eeb2-485e-bd12-f75830d06c05', '8e4f89ad-d3b1-492a-b095-5ae50d0da9a6', 'a1cf83fa-3587-481f-8a86-dc785a95f1a9'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:47:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-25bd41d2-a25d-4d04-bac6-0b1608ce53e2 tempest-VolumesTransfersV355Test-1294951454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-25bd41d2-a25d-4d04-bac6-0b1608ce53e2 tempest-VolumesTransfersV355Test-1294951454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:50 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-25bd41d2-a25d-4d04-bac6-0b1608ce53e2 tempest-VolumesTransfersV355Test-1294951454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:47:50 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-25bd41d2-a25d-4d04-bac6-0b1608ce53e2 tempest-VolumesTransfersV355Test-1294951454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:47:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-25bd41d2-a25d-4d04-bac6-0b1608ce53e2 tempest-VolumesTransfersV355Test-1294951454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-25bd41d2-a25d-4d04-bac6-0b1608ce53e2 tempest-VolumesTransfersV355Test-1294951454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:50 devstack sudo[87650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:47:50 devstack sudo[87650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:50 devstack sudo[87646]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-49e63a4d-745b-4341-a108-0746405cace5 tempest-VolumeDependencyTests-476558810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9.info" returned: 0 in 0.477s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-49e63a4d-745b-4341-a108-0746405cace5 tempest-VolumeDependencyTests-476558810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.115s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.577s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:50 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:47:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-337077529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc9493d8-4151-42ed-af89-b52bacdd253b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b1e2e15da8734d00b19bb36f846ccfc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:47:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:47:45Z,use_quota=True,user_id='f0fe31af3e8c462da1930eb8650f1836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:47:50 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] Creating volume cc9493d8-4151-42ed-af89-b52bacdd253b {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:47:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:50 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:47:50 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:47:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:50 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:47:50 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:47:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-cc9493d8-4151-42ed-af89-b52bacdd253b 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:50 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-49e63a4d-745b-4341-a108-0746405cace5 tempest-VolumeDependencyTests-476558810 None] Create snapshot completed successfully
Apr 09 12:47:50 devstack sudo[87652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-cc9493d8-4151-42ed-af89-b52bacdd253b 1073741824
Apr 09 12:47:50 devstack sudo[87652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-6bf1fccc-3926-4d3a-b49b-d08a919b432c tempest-SnapshotsActionsTest-1850511053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:50 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-a748c813-77ae-436d-8633-7716179f5d72 tempest-VolumesTransfersV355Test-383635032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:47:50 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-a748c813-77ae-436d-8633-7716179f5d72 tempest-VolumesTransfersV355Test-383635032 None] Flow 'volume_create_manager' (aee51476-374b-4618-b801-675761352b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:47:50 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-a748c813-77ae-436d-8633-7716179f5d72 tempest-VolumesTransfersV355Test-383635032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c1150f9-7c65-4469-a64d-550fbfbaa129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:50 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-a748c813-77ae-436d-8633-7716179f5d72 tempest-VolumesTransfersV355Test-383635032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c1150f9-7c65-4469-a64d-550fbfbaa129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:47:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2022747900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8181c95-91b7-42b8-bf88-a2651ea7d3fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a61a1ac602c48a6b3719828bc3f61bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:47:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:47:51Z,use_quota=True,user_id='d069fd236b06494682cf0dff282d7e66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:50 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-a748c813-77ae-436d-8633-7716179f5d72 tempest-VolumesTransfersV355Test-383635032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31c1938e-de57-4b86-98c5-726bd34c3c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:50 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-a748c813-77ae-436d-8633-7716179f5d72 tempest-VolumesTransfersV355Test-383635032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31c1938e-de57-4b86-98c5-726bd34c3c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:50 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-a748c813-77ae-436d-8633-7716179f5d72 tempest-VolumesTransfersV355Test-383635032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfe8662c-01a2-4ad7-9917-d6d330c66d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:50 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-a748c813-77ae-436d-8633-7716179f5d72 tempest-VolumesTransfersV355Test-383635032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfe8662c-01a2-4ad7-9917-d6d330c66d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8181c95-91b7-42b8-bf88-a2651ea7d3fb', 'volume_name': 'volume-d8181c95-91b7-42b8-bf88-a2651ea7d3fb', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:50 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-a748c813-77ae-436d-8633-7716179f5d72 tempest-VolumesTransfersV355Test-383635032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d77f969e-53d8-4a66-8595-07e159cef586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:50 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-a748c813-77ae-436d-8633-7716179f5d72 tempest-VolumesTransfersV355Test-383635032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d77f969e-53d8-4a66-8595-07e159cef586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:50 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-a748c813-77ae-436d-8633-7716179f5d72 tempest-VolumesTransfersV355Test-383635032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3edf6bc3-67ae-44e7-a04f-196e40b414ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:50 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-a748c813-77ae-436d-8633-7716179f5d72 tempest-VolumesTransfersV355Test-383635032 None] Volume d8181c95-91b7-42b8-bf88-a2651ea7d3fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8181c95-91b7-42b8-bf88-a2651ea7d3fb', 'volume_size': 1}
Apr 09 12:47:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-a748c813-77ae-436d-8633-7716179f5d72 tempest-VolumesTransfersV355Test-383635032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:50 devstack sudo[87650]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-25bd41d2-a25d-4d04-bac6-0b1608ce53e2 tempest-VolumesTransfersV355Test-1294951454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.551s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:50 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-25bd41d2-a25d-4d04-bac6-0b1608ce53e2 tempest-VolumesTransfersV355Test-1294951454 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:47:50 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-25bd41d2-a25d-4d04-bac6-0b1608ce53e2 tempest-VolumesTransfersV355Test-1294951454 None] Deleted volume successfully.
Apr 09 12:47:50 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-25bd41d2-a25d-4d04-bac6-0b1608ce53e2 tempest-VolumesTransfersV355Test-1294951454 None] Lock "cinder-7ad8291f-a524-41a9-b537-ea493e37411c-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:47:51 devstack sudo[87652]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-cc9493d8-4151-42ed-af89-b52bacdd253b 1073741824" returned: 0 in 0.606s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-cc9493d8-4151-42ed-af89-b52bacdd253b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:51 devstack sudo[87659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-cc9493d8-4151-42ed-af89-b52bacdd253b
Apr 09 12:47:51 devstack sudo[87659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:51 devstack sudo[87659]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-cc9493d8-4151-42ed-af89-b52bacdd253b" returned: 0 in 0.457s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:51 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:47:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-6bf1fccc-3926-4d3a-b49b-d08a919b432c tempest-SnapshotsActionsTest-1850511053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.907s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:51 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-6bf1fccc-3926-4d3a-b49b-d08a919b432c tempest-SnapshotsActionsTest-1850511053 None] Creating offline snapshot d42a8aa1-3e2e-4386-b240-71232b0d6747 of volume f1c57785-89aa-474f-9b0a-229da9fff2ee {{(pid=82760) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 12:47:51 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c72e7d-9771-4916-b850-4acb6aefcf7e]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:47:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6bf1fccc-3926-4d3a-b49b-d08a919b432c tempest-SnapshotsActionsTest-1850511053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:51 devstack cinder-volume[82760]: DEBUG cinder.volume.volume_utils [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] Attempting download of 11bf303b-adca-49d8-8d80-d4a3c72e719a ((None, [{'url': 'file:///opt/stack/data/glance/images/11bf303b-adca-49d8-8d80-d4a3c72e719a', 'metadata': {}}])) to volume cc9493d8-4151-42ed-af89-b52bacdd253b. {{(pid=82760) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 09 12:47:51 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-db9e6bde-4234-4baa-b45c-ae98d3820751 tempest-VolumeDependencyTests-476558810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:47:51 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-db9e6bde-4234-4baa-b45c-ae98d3820751 tempest-VolumeDependencyTests-476558810 None] Flow 'volume_create_manager' (9edd0eec-9cbc-4dcb-8ee2-b1115bb20afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:47:51 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-db9e6bde-4234-4baa-b45c-ae98d3820751 tempest-VolumeDependencyTests-476558810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c964c80a-e7d5-4470-9637-556acd1f5437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:51 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-db9e6bde-4234-4baa-b45c-ae98d3820751 tempest-VolumeDependencyTests-476558810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c964c80a-e7d5-4470-9637-556acd1f5437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:47:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2021487244',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcdd4787-4bfe-4621-ae68-d01b8e7d0eb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28f5a0458de448a0bde2c150376bc42e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:47:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9934c9b8-db5a-4468-b3b6-090c027c7f0d,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:47:51Z,use_quota=True,user_id='a04a77cece624a4e9632672086c90ef5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:51 devstack sudo[87662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b
Apr 09 12:47:51 devstack sudo[87662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:51 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-db9e6bde-4234-4baa-b45c-ae98d3820751 tempest-VolumeDependencyTests-476558810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42d456e2-c7fc-469d-8924-755cbdd3580b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:51 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-db9e6bde-4234-4baa-b45c-ae98d3820751 tempest-VolumeDependencyTests-476558810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42d456e2-c7fc-469d-8924-755cbdd3580b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:51 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-db9e6bde-4234-4baa-b45c-ae98d3820751 tempest-VolumeDependencyTests-476558810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bec98c30-578e-4ace-99e9-a4030e3d9006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:51 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-db9e6bde-4234-4baa-b45c-ae98d3820751 tempest-VolumeDependencyTests-476558810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bec98c30-578e-4ace-99e9-a4030e3d9006) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fcdd4787-4bfe-4621-ae68-d01b8e7d0eb0', 'volume_name': 'volume-fcdd4787-4bfe-4621-ae68-d01b8e7d0eb0', 'volume_size': 1, 'snapshot_id': '9934c9b8-db5a-4468-b3b6-090c027c7f0d'}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:51 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-db9e6bde-4234-4baa-b45c-ae98d3820751 tempest-VolumeDependencyTests-476558810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb068766-bd25-4e1d-a591-95f4b2e4050b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:51 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-db9e6bde-4234-4baa-b45c-ae98d3820751 tempest-VolumeDependencyTests-476558810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb068766-bd25-4e1d-a591-95f4b2e4050b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:51 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-db9e6bde-4234-4baa-b45c-ae98d3820751 tempest-VolumeDependencyTests-476558810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70b768e7-d8ad-4c37-ae8b-82c6af4aa4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:51 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-db9e6bde-4234-4baa-b45c-ae98d3820751 tempest-VolumeDependencyTests-476558810 None] Volume fcdd4787-4bfe-4621-ae68-d01b8e7d0eb0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fcdd4787-4bfe-4621-ae68-d01b8e7d0eb0', 'volume_size': 1, 'snapshot_id': '9934c9b8-db5a-4468-b3b6-090c027c7f0d'}
Apr 09 12:47:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-db9e6bde-4234-4baa-b45c-ae98d3820751 tempest-VolumeDependencyTests-476558810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:51 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c3e307-9485-41e5-9c5b-74e965799a1d]: (4, 'raw') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:47:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11bf303b-adca-49d8-8d80-d4a3c72e719a_tlxzv7pq {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:51 devstack sudo[87664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11bf303b-adca-49d8-8d80-d4a3c72e719a_tlxzv7pq
Apr 09 12:47:51 devstack sudo[87664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:52 devstack sudo[87662]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6bf1fccc-3926-4d3a-b49b-d08a919b432c tempest-SnapshotsActionsTest-1850511053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b" returned: 0 in 0.532s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:52 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-6bf1fccc-3926-4d3a-b49b-d08a919b432c tempest-SnapshotsActionsTest-1850511053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1c57785-89aa-474f-9b0a-229da9fff2ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:47:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6bf1fccc-3926-4d3a-b49b-d08a919b432c tempest-SnapshotsActionsTest-1850511053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.d42a8aa1-3e2e-4386-b240-71232b0d6747 1G {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:52 devstack sudo[87669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.d42a8aa1-3e2e-4386-b240-71232b0d6747 1G
Apr 09 12:47:52 devstack sudo[87669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:52 devstack sudo[87664]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11bf303b-adca-49d8-8d80-d4a3c72e719a_tlxzv7pq" returned: 0 in 0.508s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11bf303b-adca-49d8-8d80-d4a3c72e719a_tlxzv7pq {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:52 devstack sudo[87673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11bf303b-adca-49d8-8d80-d4a3c72e719a_tlxzv7pq
Apr 09 12:47:52 devstack sudo[87673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:52 devstack sudo[87669]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6bf1fccc-3926-4d3a-b49b-d08a919b432c tempest-SnapshotsActionsTest-1850511053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.d42a8aa1-3e2e-4386-b240-71232b0d6747 1G" returned: 0 in 0.619s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6bf1fccc-3926-4d3a-b49b-d08a919b432c tempest-SnapshotsActionsTest-1850511053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.d42a8aa1-3e2e-4386-b240-71232b0d6747 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:52 devstack sudo[87681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.d42a8aa1-3e2e-4386-b240-71232b0d6747
Apr 09 12:47:52 devstack sudo[87681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:52 devstack sudo[87673]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11bf303b-adca-49d8-8d80-d4a3c72e719a_tlxzv7pq" returned: 1 in 0.563s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11bf303b-adca-49d8-8d80-d4a3c72e719a_tlxzv7pq' failed. Not Retrying. {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 09 12:47:52 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2753cfb-39f7-4248-9a9f-5dbb5ba1fe19]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:47:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11bf303b-adca-49d8-8d80-d4a3c72e719a_yqzj8ryydevstack@QuobyteHD {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:52 devstack sudo[87683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11bf303b-adca-49d8-8d80-d4a3c72e719a_yqzj8ryydevstack@QuobyteHD
Apr 09 12:47:52 devstack sudo[87683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:53 devstack sudo[87681]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6bf1fccc-3926-4d3a-b49b-d08a919b432c tempest-SnapshotsActionsTest-1850511053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.d42a8aa1-3e2e-4386-b240-71232b0d6747" returned: 0 in 0.532s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:53 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-6bf1fccc-3926-4d3a-b49b-d08a919b432c tempest-SnapshotsActionsTest-1850511053 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.d42a8aa1-3e2e-4386-b240-71232b0d6747 is being set with open permissions: ugo+rw
Apr 09 12:47:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6bf1fccc-3926-4d3a-b49b-d08a919b432c tempest-SnapshotsActionsTest-1850511053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.d42a8aa1-3e2e-4386-b240-71232b0d6747 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:53 devstack sudo[87692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.d42a8aa1-3e2e-4386-b240-71232b0d6747
Apr 09 12:47:53 devstack sudo[87692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:53 devstack sudo[87683]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11bf303b-adca-49d8-8d80-d4a3c72e719a_yqzj8ryydevstack@QuobyteHD" returned: 0 in 0.549s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:53 devstack cinder-volume[82760]: DEBUG cinder.image.image_utils [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] 11bf303b-adca-49d8-8d80-d4a3c72e719a was qcow2, converting to raw {{(pid=82760) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 09 12:47:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_11bf303b-adca-49d8-8d80-d4a3c72e719a_yqzj8ryydevstack@QuobyteHD /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-cc9493d8-4151-42ed-af89-b52bacdd253b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:53 devstack sudo[87694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_11bf303b-adca-49d8-8d80-d4a3c72e719a_yqzj8ryydevstack@QuobyteHD /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-cc9493d8-4151-42ed-af89-b52bacdd253b
Apr 09 12:47:53 devstack sudo[87694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:53 devstack sudo[87692]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6bf1fccc-3926-4d3a-b49b-d08a919b432c tempest-SnapshotsActionsTest-1850511053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.d42a8aa1-3e2e-4386-b240-71232b0d6747" returned: 0 in 0.500s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-6bf1fccc-3926-4d3a-b49b-d08a919b432c tempest-SnapshotsActionsTest-1850511053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.273s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-a748c813-77ae-436d-8633-7716179f5d72 tempest-VolumesTransfersV355Test-383635032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.057s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:53 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-a748c813-77ae-436d-8633-7716179f5d72 tempest-VolumesTransfersV355Test-383635032 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:47:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2022747900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8181c95-91b7-42b8-bf88-a2651ea7d3fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a61a1ac602c48a6b3719828bc3f61bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:47:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:47:51Z,use_quota=True,user_id='d069fd236b06494682cf0dff282d7e66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:47:53 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-a748c813-77ae-436d-8633-7716179f5d72 tempest-VolumesTransfersV355Test-383635032 None] Creating volume d8181c95-91b7-42b8-bf88-a2651ea7d3fb {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:47:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-a748c813-77ae-436d-8633-7716179f5d72 tempest-VolumesTransfersV355Test-383635032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-a748c813-77ae-436d-8633-7716179f5d72 tempest-VolumesTransfersV355Test-383635032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:53 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-a748c813-77ae-436d-8633-7716179f5d72 tempest-VolumesTransfersV355Test-383635032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:47:53 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-a748c813-77ae-436d-8633-7716179f5d72 tempest-VolumesTransfersV355Test-383635032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:47:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-a748c813-77ae-436d-8633-7716179f5d72 tempest-VolumesTransfersV355Test-383635032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:53 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-a748c813-77ae-436d-8633-7716179f5d72 tempest-VolumesTransfersV355Test-383635032 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:47:53 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-a748c813-77ae-436d-8633-7716179f5d72 tempest-VolumesTransfersV355Test-383635032 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:47:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-a748c813-77ae-436d-8633-7716179f5d72 tempest-VolumesTransfersV355Test-383635032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d8181c95-91b7-42b8-bf88-a2651ea7d3fb 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:53 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-6bf1fccc-3926-4d3a-b49b-d08a919b432c tempest-SnapshotsActionsTest-1850511053 None] Create snapshot completed successfully
Apr 09 12:47:53 devstack sudo[87700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d8181c95-91b7-42b8-bf88-a2651ea7d3fb 1073741824
Apr 09 12:47:53 devstack sudo[87700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:54 devstack sudo[87694]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_11bf303b-adca-49d8-8d80-d4a3c72e719a_yqzj8ryydevstack@QuobyteHD /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-cc9493d8-4151-42ed-af89-b52bacdd253b" returned: 0 in 1.139s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:54 devstack cinder-volume[82760]: DEBUG cinder.image.image_utils [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_11bf303b-adca-49d8-8d80-d4a3c72e719a_yqzj8ryydevstack@QuobyteHD, size 112.00 MB, duration 1.14 sec, destination /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-cc9493d8-4151-42ed-af89-b52bacdd253b {{(pid=82760) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 12:47:54 devstack cinder-volume[82760]: INFO cinder.image.image_utils [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] Converted 112.00 MB image at 98.22 MB/s
Apr 09 12:47:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-cc9493d8-4151-42ed-af89-b52bacdd253b 1G {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:54 devstack sudo[87707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-cc9493d8-4151-42ed-af89-b52bacdd253b 1G
Apr 09 12:47:54 devstack sudo[87707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:54 devstack sudo[87700]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-a748c813-77ae-436d-8633-7716179f5d72 tempest-VolumesTransfersV355Test-383635032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d8181c95-91b7-42b8-bf88-a2651ea7d3fb 1073741824" returned: 0 in 0.725s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-a748c813-77ae-436d-8633-7716179f5d72 tempest-VolumesTransfersV355Test-383635032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d8181c95-91b7-42b8-bf88-a2651ea7d3fb {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:54 devstack sudo[87709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d8181c95-91b7-42b8-bf88-a2651ea7d3fb
Apr 09 12:47:54 devstack sudo[87709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:54 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-dd4c9f88-961a-41bc-a20e-9f683b7517a7 tempest-SnapshotsActionsTest-758081170 None] Acquiring lock "cinder-d42a8aa1-3e2e-4386-b240-71232b0d6747-delete_snapshot" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:47:54 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-dd4c9f88-961a-41bc-a20e-9f683b7517a7 tempest-SnapshotsActionsTest-758081170 None] Lock "cinder-d42a8aa1-3e2e-4386-b240-71232b0d6747-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:47:54 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-dd4c9f88-961a-41bc-a20e-9f683b7517a7 tempest-SnapshotsActionsTest-758081170 None] Acquiring lock "cinder-quobyte-f1c57785-89aa-474f-9b0a-229da9fff2ee" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:47:54 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-dd4c9f88-961a-41bc-a20e-9f683b7517a7 tempest-SnapshotsActionsTest-758081170 None] Lock "cinder-quobyte-f1c57785-89aa-474f-9b0a-229da9fff2ee" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:47:54 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-dd4c9f88-961a-41bc-a20e-9f683b7517a7 tempest-SnapshotsActionsTest-758081170 None] Acquiring lock "cinder-quobyte-d42a8aa1-3e2e-4386-b240-71232b0d6747" by "_delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:47:54 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-dd4c9f88-961a-41bc-a20e-9f683b7517a7 tempest-SnapshotsActionsTest-758081170 None] Lock "cinder-quobyte-d42a8aa1-3e2e-4386-b240-71232b0d6747" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:47:54 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-dd4c9f88-961a-41bc-a20e-9f683b7517a7 tempest-SnapshotsActionsTest-758081170 None] Deleting offline snapshot d42a8aa1-3e2e-4386-b240-71232b0d6747 of volume f1c57785-89aa-474f-9b0a-229da9fff2ee {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 12:47:54 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-dd4c9f88-961a-41bc-a20e-9f683b7517a7 tempest-SnapshotsActionsTest-758081170 None] snapshot_file for this snap is: volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.d42a8aa1-3e2e-4386-b240-71232b0d6747 {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 12:47:54 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[36200153-162a-48c4-927d-25d25c54b27b]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:47:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-dd4c9f88-961a-41bc-a20e-9f683b7517a7 tempest-SnapshotsActionsTest-758081170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.d42a8aa1-3e2e-4386-b240-71232b0d6747 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:55 devstack sudo[87714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.d42a8aa1-3e2e-4386-b240-71232b0d6747
Apr 09 12:47:55 devstack sudo[87714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:55 devstack sudo[87707]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-cc9493d8-4151-42ed-af89-b52bacdd253b 1G" returned: 0 in 0.570s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:55 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29b918e-81fe-4c5f-91ba-8cdd50cc3d3b]: (4, 'raw') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:47:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-cc9493d8-4151-42ed-af89-b52bacdd253b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:55 devstack sudo[87709]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-a748c813-77ae-436d-8633-7716179f5d72 tempest-VolumesTransfersV355Test-383635032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d8181c95-91b7-42b8-bf88-a2651ea7d3fb" returned: 0 in 0.533s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:55 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-a748c813-77ae-436d-8633-7716179f5d72 tempest-VolumesTransfersV355Test-383635032 None] <== create_volume: return (1295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:47:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-a748c813-77ae-436d-8633-7716179f5d72 tempest-VolumesTransfersV355Test-383635032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.299s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-db9e6bde-4234-4baa-b45c-ae98d3820751 tempest-VolumeDependencyTests-476558810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.401s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:55 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-db9e6bde-4234-4baa-b45c-ae98d3820751 tempest-VolumeDependencyTests-476558810 None] Acquiring lock "cinder-quobyte-9934c9b8-db5a-4468-b3b6-090c027c7f0d-fcdd4787-4bfe-4621-ae68-d01b8e7d0eb0" by "_create_volume_from_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:47:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-a748c813-77ae-436d-8633-7716179f5d72 tempest-VolumesTransfersV355Test-383635032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3edf6bc3-67ae-44e7-a04f-196e40b414ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8181c95-91b7-42b8-bf88-a2651ea7d3fb', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-a748c813-77ae-436d-8633-7716179f5d72 tempest-VolumesTransfersV355Test-383635032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7290770d-ed9d-467b-94ed-2d32ac6b3872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:55 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-a748c813-77ae-436d-8633-7716179f5d72 tempest-VolumesTransfersV355Test-383635032 None] Volume volume-d8181c95-91b7-42b8-bf88-a2651ea7d3fb (d8181c95-91b7-42b8-bf88-a2651ea7d3fb): created successfully
Apr 09 12:47:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-a748c813-77ae-436d-8633-7716179f5d72 tempest-VolumesTransfersV355Test-383635032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7290770d-ed9d-467b-94ed-2d32ac6b3872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-a748c813-77ae-436d-8633-7716179f5d72 tempest-VolumesTransfersV355Test-383635032 None] Flow 'volume_create_manager' (aee51476-374b-4618-b801-675761352b3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:47:55 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-db9e6bde-4234-4baa-b45c-ae98d3820751 tempest-VolumeDependencyTests-476558810 None] Lock "cinder-quobyte-9934c9b8-db5a-4468-b3b6-090c027c7f0d-fcdd4787-4bfe-4621-ae68-d01b8e7d0eb0" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:47:55 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-db9e6bde-4234-4baa-b45c-ae98d3820751 tempest-VolumeDependencyTests-476558810 None] Creating volume fcdd4787-4bfe-4621-ae68-d01b8e7d0eb0 from snapshot 9934c9b8-db5a-4468-b3b6-090c027c7f0d {{(pid=82760) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 09 12:47:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-db9e6bde-4234-4baa-b45c-ae98d3820751 tempest-VolumeDependencyTests-476558810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-db9e6bde-4234-4baa-b45c-ae98d3820751 tempest-VolumeDependencyTests-476558810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:55 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-db9e6bde-4234-4baa-b45c-ae98d3820751 tempest-VolumeDependencyTests-476558810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:47:55 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-db9e6bde-4234-4baa-b45c-ae98d3820751 tempest-VolumeDependencyTests-476558810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:47:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-db9e6bde-4234-4baa-b45c-ae98d3820751 tempest-VolumeDependencyTests-476558810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:55 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-db9e6bde-4234-4baa-b45c-ae98d3820751 tempest-VolumeDependencyTests-476558810 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:47:55 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-db9e6bde-4234-4baa-b45c-ae98d3820751 tempest-VolumeDependencyTests-476558810 None] Acquiring lock "cinder-quobyte-fcdd4787-4bfe-4621-ae68-d01b8e7d0eb0" by "_copy_volume_from_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:47:55 devstack sudo[87717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-cc9493d8-4151-42ed-af89-b52bacdd253b
Apr 09 12:47:55 devstack sudo[87717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:55 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-a748c813-77ae-436d-8633-7716179f5d72 tempest-VolumesTransfersV355Test-383635032 None] Created volume successfully.
Apr 09 12:47:55 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-db9e6bde-4234-4baa-b45c-ae98d3820751 tempest-VolumeDependencyTests-476558810 None] Lock "cinder-quobyte-fcdd4787-4bfe-4621-ae68-d01b8e7d0eb0" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:47:55 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-db9e6bde-4234-4baa-b45c-ae98d3820751 tempest-VolumeDependencyTests-476558810 None] snapshot: 9934c9b8-db5a-4468-b3b6-090c027c7f0d, volume: fcdd4787-4bfe-4621-ae68-d01b8e7d0eb0,  {{(pid=82760) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 09 12:47:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-db9e6bde-4234-4baa-b45c-ae98d3820751 tempest-VolumeDependencyTests-476558810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-db9e6bde-4234-4baa-b45c-ae98d3820751 tempest-VolumeDependencyTests-476558810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:55 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-db9e6bde-4234-4baa-b45c-ae98d3820751 tempest-VolumeDependencyTests-476558810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:47:55 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-db9e6bde-4234-4baa-b45c-ae98d3820751 tempest-VolumeDependencyTests-476558810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:47:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-db9e6bde-4234-4baa-b45c-ae98d3820751 tempest-VolumeDependencyTests-476558810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:55 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[efdd2869-e227-4158-a01d-c88b7dfbd64f]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:47:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-db9e6bde-4234-4baa-b45c-ae98d3820751 tempest-VolumeDependencyTests-476558810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9.9934c9b8-db5a-4468-b3b6-090c027c7f0d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:55 devstack sudo[87719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9.9934c9b8-db5a-4468-b3b6-090c027c7f0d
Apr 09 12:47:55 devstack sudo[87719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:55 devstack sudo[87714]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-dd4c9f88-961a-41bc-a20e-9f683b7517a7 tempest-SnapshotsActionsTest-758081170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.d42a8aa1-3e2e-4386-b240-71232b0d6747" returned: 0 in 0.588s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:55 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-dd4c9f88-961a-41bc-a20e-9f683b7517a7 tempest-SnapshotsActionsTest-758081170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1c57785-89aa-474f-9b0a-229da9fff2ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:47:55 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2541548-d760-432c-8da2-1e794c1e54a5]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:47:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-dd4c9f88-961a-41bc-a20e-9f683b7517a7 tempest-SnapshotsActionsTest-758081170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:55 devstack sudo[87726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b
Apr 09 12:47:55 devstack sudo[87726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:55 devstack sudo[87717]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-cc9493d8-4151-42ed-af89-b52bacdd253b" returned: 0 in 0.571s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-cc9493d8-4151-42ed-af89-b52bacdd253b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:55 devstack sudo[87728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-cc9493d8-4151-42ed-af89-b52bacdd253b
Apr 09 12:47:55 devstack sudo[87728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:55 devstack sudo[87719]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-db9e6bde-4234-4baa-b45c-ae98d3820751 tempest-VolumeDependencyTests-476558810 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9.9934c9b8-db5a-4468-b3b6-090c027c7f0d" returned: 0 in 0.612s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:55 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-db9e6bde-4234-4baa-b45c-ae98d3820751 tempest-VolumeDependencyTests-476558810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d6deda8-96f0-4924-bcf0-3829657d33e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:47:55 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-db9e6bde-4234-4baa-b45c-ae98d3820751 tempest-VolumeDependencyTests-476558810 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9 {{(pid=82760) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 09 12:47:55 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-db9e6bde-4234-4baa-b45c-ae98d3820751 tempest-VolumeDependencyTests-476558810 None] Creating direct copy from snapshot {{(pid=82760) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 09 12:47:55 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17242f7-1f88-4610-8f5b-8ecc5528ba7b]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:47:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-db9e6bde-4234-4baa-b45c-ae98d3820751 tempest-VolumeDependencyTests-476558810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:55 devstack sudo[87733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9
Apr 09 12:47:55 devstack sudo[87733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:56 devstack sudo[87726]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-dd4c9f88-961a-41bc-a20e-9f683b7517a7 tempest-SnapshotsActionsTest-758081170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b" returned: 0 in 0.661s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:56 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-dd4c9f88-961a-41bc-a20e-9f683b7517a7 tempest-SnapshotsActionsTest-758081170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1c57785-89aa-474f-9b0a-229da9fff2ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:47:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-dd4c9f88-961a-41bc-a20e-9f683b7517a7 tempest-SnapshotsActionsTest-758081170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.d42a8aa1-3e2e-4386-b240-71232b0d6747 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:56 devstack sudo[87728]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:56 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ea36ab25-a33a-46b0-8170-c796d0d28773 tempest-VolumesTransfersV355Test-1294951454 None] Acquiring lock "cinder-d8181c95-91b7-42b8-bf88-a2651ea7d3fb-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:47:56 devstack sudo[87741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.d42a8aa1-3e2e-4386-b240-71232b0d6747
Apr 09 12:47:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-cc9493d8-4151-42ed-af89-b52bacdd253b" returned: 1 in 0.603s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:56 devstack sudo[87741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-cc9493d8-4151-42ed-af89-b52bacdd253b' failed. Not Retrying. {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 09 12:47:56 devstack cinder-volume[82760]: DEBUG cinder.volume.volume_utils [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] Downloaded image 11bf303b-adca-49d8-8d80-d4a3c72e719a ((None, [{'url': 'file:///opt/stack/data/glance/images/11bf303b-adca-49d8-8d80-d4a3c72e719a', 'metadata': {}}])) to volume cc9493d8-4151-42ed-af89-b52bacdd253b successfully. {{(pid=82760) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 09 12:47:56 devstack cinder-volume[82760]: DEBUG cinder.image.image_utils [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] Temporary image 11bf303b-adca-49d8-8d80-d4a3c72e719a for user f0fe31af3e8c462da1930eb8650f1836 is deleted. {{(pid=82760) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 09 12:47:56 devstack cinder-volume[82760]: DEBUG cinder.volume.volume_utils [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] Marking volume cc9493d8-4151-42ed-af89-b52bacdd253b as bootable. {{(pid=82760) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 09 12:47:56 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ea36ab25-a33a-46b0-8170-c796d0d28773 tempest-VolumesTransfersV355Test-1294951454 None] Lock "cinder-d8181c95-91b7-42b8-bf88-a2651ea7d3fb-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:47:56 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] Copying metadata from image 11bf303b-adca-49d8-8d80-d4a3c72e719a to cc9493d8-4151-42ed-af89-b52bacdd253b. {{(pid=82760) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 09 12:47:56 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] Creating volume glance metadata for volume cc9493d8-4151-42ed-af89-b52bacdd253b backed by image 11bf303b-adca-49d8-8d80-d4a3c72e719a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '11bf303b-adca-49d8-8d80-d4a3c72e719a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82760) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 09 12:47:56 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ea36ab25-a33a-46b0-8170-c796d0d28773 tempest-VolumesTransfersV355Test-1294951454 None] Acquiring lock "cinder-quobyte-d8181c95-91b7-42b8-bf88-a2651ea7d3fb" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:47:56 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ea36ab25-a33a-46b0-8170-c796d0d28773 tempest-VolumesTransfersV355Test-1294951454 None] Lock "cinder-quobyte-d8181c95-91b7-42b8-bf88-a2651ea7d3fb" acquired by "delete_volume" :: waited 0.009s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:47:56 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd669da0-409a-4749-a1da-7784fcdeef04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc9493d8-4151-42ed-af89-b52bacdd253b', 'volume_size': 1, 'image_id': '11bf303b-adca-49d8-8d80-d4a3c72e719a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11bf303b-adca-49d8-8d80-d4a3c72e719a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c43b4928ecdf4421ad23e5f918ea33fe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '11bf303b-adca-49d8-8d80-d4a3c72e719a', 'created_at': datetime.datetime(2026, 4, 9, 10, 38, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 10, 38, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11bf303b-adca-49d8-8d80-d4a3c72e719a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f378dfe5fc0>}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:56 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (901e455b-580a-4573-a1fb-6e80f20e09a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:56 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06ad0ee-0eb4-4f9c-9273-ec3d00250de2]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:47:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ea36ab25-a33a-46b0-8170-c796d0d28773 tempest-VolumesTransfersV355Test-1294951454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d8181c95-91b7-42b8-bf88-a2651ea7d3fb {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:56 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] Volume volume-cc9493d8-4151-42ed-af89-b52bacdd253b (cc9493d8-4151-42ed-af89-b52bacdd253b): created successfully
Apr 09 12:47:56 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (901e455b-580a-4573-a1fb-6e80f20e09a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:56 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] Flow 'volume_create_manager' (d120e0fa-cf38-4162-b007-dc4499aa4882) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:47:56 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-d2fa8a79-f1a3-4972-8358-42e502ae45a0 tempest-VolumesGetTest-606996561 None] Created volume successfully.
Apr 09 12:47:56 devstack sudo[87743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d8181c95-91b7-42b8-bf88-a2651ea7d3fb
Apr 09 12:47:56 devstack sudo[87743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:56 devstack sudo[87733]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-db9e6bde-4234-4baa-b45c-ae98d3820751 tempest-VolumeDependencyTests-476558810 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9" returned: 0 in 0.662s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:56 devstack cinder-volume[82760]: DEBUG cinder.utils [None req-db9e6bde-4234-4baa-b45c-ae98d3820751 tempest-VolumeDependencyTests-476558810 None] Path /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-fcdd4787-4bfe-4621-ae68-d01b8e7d0eb0 not found in is_blk_device check {{(pid=82760) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 09 12:47:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-db9e6bde-4234-4baa-b45c-ae98d3820751 tempest-VolumeDependencyTests-476558810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-fcdd4787-4bfe-4621-ae68-d01b8e7d0eb0 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:56 devstack sudo[87748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-fcdd4787-4bfe-4621-ae68-d01b8e7d0eb0
Apr 09 12:47:56 devstack sudo[87748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:56 devstack sudo[87741]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-dd4c9f88-961a-41bc-a20e-9f683b7517a7 tempest-SnapshotsActionsTest-758081170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.d42a8aa1-3e2e-4386-b240-71232b0d6747" returned: 0 in 0.580s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-dd4c9f88-961a-41bc-a20e-9f683b7517a7 tempest-SnapshotsActionsTest-758081170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.d42a8aa1-3e2e-4386-b240-71232b0d6747 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:56 devstack sudo[87753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.d42a8aa1-3e2e-4386-b240-71232b0d6747
Apr 09 12:47:56 devstack sudo[87753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:56 devstack sudo[87743]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ea36ab25-a33a-46b0-8170-c796d0d28773 tempest-VolumesTransfersV355Test-1294951454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d8181c95-91b7-42b8-bf88-a2651ea7d3fb" returned: 0 in 0.600s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ea36ab25-a33a-46b0-8170-c796d0d28773 tempest-VolumesTransfersV355Test-1294951454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d8181c95-91b7-42b8-bf88-a2651ea7d3fb {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:57 devstack sudo[87761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d8181c95-91b7-42b8-bf88-a2651ea7d3fb
Apr 09 12:47:57 devstack sudo[87761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:57 devstack sudo[87753]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-dd4c9f88-961a-41bc-a20e-9f683b7517a7 tempest-SnapshotsActionsTest-758081170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.d42a8aa1-3e2e-4386-b240-71232b0d6747" returned: 0 in 1.232s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:58 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-dd4c9f88-961a-41bc-a20e-9f683b7517a7 tempest-SnapshotsActionsTest-758081170 None] Lock "cinder-quobyte-d42a8aa1-3e2e-4386-b240-71232b0d6747" released by "_delete_snapshot" :: held 3.155s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:47:58 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-dd4c9f88-961a-41bc-a20e-9f683b7517a7 tempest-SnapshotsActionsTest-758081170 None] Lock "cinder-quobyte-f1c57785-89aa-474f-9b0a-229da9fff2ee" released by "delete_snapshot" :: held 3.169s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:47:58 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-dd4c9f88-961a-41bc-a20e-9f683b7517a7 tempest-SnapshotsActionsTest-758081170 None] Created reservations ['446da483-7fc2-4453-a0f5-7f134d076c5c', '586c0db3-6d44-4ef1-9daa-a33170a54d0b', '8cb1e76c-adb8-4bc1-a2a6-618f9fa27434', 'd7c4e6bc-c016-4ea4-8aab-843ca346e732'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:47:58 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ae1f802-985d-4eec-a890-4da4554e5aae tempest-VolumesGetTest-606996561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:47:58 devstack sudo[87761]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:58 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-5ae1f802-985d-4eec-a890-4da4554e5aae tempest-VolumesGetTest-606996561 None] Flow 'volume_create_manager' (13ea11d5-24bc-489c-a70c-5387262aeb9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:47:58 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-5ae1f802-985d-4eec-a890-4da4554e5aae tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42c49627-9640-42ef-af5a-4ce5e410f200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ea36ab25-a33a-46b0-8170-c796d0d28773 tempest-VolumesTransfersV355Test-1294951454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d8181c95-91b7-42b8-bf88-a2651ea7d3fb" returned: 0 in 1.538s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:58 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-5ae1f802-985d-4eec-a890-4da4554e5aae tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42c49627-9640-42ef-af5a-4ce5e410f200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:47:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1716934810',display_name='tempest-VolumesGetTest-Volume-600381438',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1efb3f5d-ff26-4589-bf21-9c4fce39340b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1e2e15da8734d00b19bb36f846ccfc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:47:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:47:58Z,use_quota=True,user_id='f0fe31af3e8c462da1930eb8650f1836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:58 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-5ae1f802-985d-4eec-a890-4da4554e5aae tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dab81a7-174b-4121-9936-5efd3135c77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:58 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-5ae1f802-985d-4eec-a890-4da4554e5aae tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dab81a7-174b-4121-9936-5efd3135c77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:58 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-5ae1f802-985d-4eec-a890-4da4554e5aae tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d28bf26-d047-4ef4-86f9-6e2124e3b896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:58 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-5ae1f802-985d-4eec-a890-4da4554e5aae tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d28bf26-d047-4ef4-86f9-6e2124e3b896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1efb3f5d-ff26-4589-bf21-9c4fce39340b', 'volume_name': 'volume-1efb3f5d-ff26-4589-bf21-9c4fce39340b', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:58 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-5ae1f802-985d-4eec-a890-4da4554e5aae tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bea40da5-9f75-4c5c-a396-f0900d14fa89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:58 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-5ae1f802-985d-4eec-a890-4da4554e5aae tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bea40da5-9f75-4c5c-a396-f0900d14fa89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:47:58 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-5ae1f802-985d-4eec-a890-4da4554e5aae tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcc8f31c-6d9b-4bc9-9270-65c5d62ee3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:47:58 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-5ae1f802-985d-4eec-a890-4da4554e5aae tempest-VolumesGetTest-606996561 None] Volume 1efb3f5d-ff26-4589-bf21-9c4fce39340b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1efb3f5d-ff26-4589-bf21-9c4fce39340b', 'volume_size': 1}
Apr 09 12:47:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-5ae1f802-985d-4eec-a890-4da4554e5aae tempest-VolumesGetTest-606996561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:58 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ea36ab25-a33a-46b0-8170-c796d0d28773 tempest-VolumesTransfersV355Test-1294951454 None] Lock "cinder-quobyte-d8181c95-91b7-42b8-bf88-a2651ea7d3fb" released by "delete_volume" :: held 2.348s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:47:58 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-dd4c9f88-961a-41bc-a20e-9f683b7517a7 tempest-SnapshotsActionsTest-758081170 None] Delete snapshot completed successfully.
Apr 09 12:47:58 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-dd4c9f88-961a-41bc-a20e-9f683b7517a7 tempest-SnapshotsActionsTest-758081170 None] Lock "cinder-d42a8aa1-3e2e-4386-b240-71232b0d6747-delete_snapshot" released by "delete_snapshot" :: held 3.947s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:47:58 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-ea36ab25-a33a-46b0-8170-c796d0d28773 tempest-VolumesTransfersV355Test-1294951454 None] Created reservations ['6b051879-2081-4f3c-907f-9950d4e13737', '15f76b48-2c48-44b3-9dc3-063fd00e9747', '749c3c53-32f5-4fbd-b577-d9995a982311', '4ad7f667-26d6-4550-9b01-4bef6c9b8b44'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:47:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ea36ab25-a33a-46b0-8170-c796d0d28773 tempest-VolumesTransfersV355Test-1294951454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ea36ab25-a33a-46b0-8170-c796d0d28773 tempest-VolumesTransfersV355Test-1294951454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:47:58 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-ea36ab25-a33a-46b0-8170-c796d0d28773 tempest-VolumesTransfersV355Test-1294951454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:47:58 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-ea36ab25-a33a-46b0-8170-c796d0d28773 tempest-VolumesTransfersV355Test-1294951454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:47:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ea36ab25-a33a-46b0-8170-c796d0d28773 tempest-VolumesTransfersV355Test-1294951454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:47:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ea36ab25-a33a-46b0-8170-c796d0d28773 tempest-VolumesTransfersV355Test-1294951454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:59 devstack sudo[87777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:47:59 devstack sudo[87777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:59 devstack sudo[87748]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:59 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-db9e6bde-4234-4baa-b45c-ae98d3820751 tempest-VolumeDependencyTests-476558810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-fcdd4787-4bfe-4621-ae68-d01b8e7d0eb0" returned: 0 in 2.706s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:59 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[110b709f-96f1-4c59-8fc0-64abb2d1ce60]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:47:59 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-db9e6bde-4234-4baa-b45c-ae98d3820751 tempest-VolumeDependencyTests-476558810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:59 devstack sudo[87779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9
Apr 09 12:47:59 devstack sudo[87779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:47:59 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-2030de63-fde2-4841-854a-b9b69515eecd tempest-SnapshotsActionsTest-1850511053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:47:59 devstack sudo[87777]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:59 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ea36ab25-a33a-46b0-8170-c796d0d28773 tempest-VolumesTransfersV355Test-1294951454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.560s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:59 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-ea36ab25-a33a-46b0-8170-c796d0d28773 tempest-VolumesTransfersV355Test-1294951454 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:47:59 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-ea36ab25-a33a-46b0-8170-c796d0d28773 tempest-VolumesTransfersV355Test-1294951454 None] Deleted volume successfully.
Apr 09 12:47:59 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ea36ab25-a33a-46b0-8170-c796d0d28773 tempest-VolumesTransfersV355Test-1294951454 None] Lock "cinder-d8181c95-91b7-42b8-bf88-a2651ea7d3fb-delete_volume" released by "delete_volume" :: held 3.310s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:47:59 devstack sudo[87779]: pam_unix(sudo:session): session closed for user root
Apr 09 12:47:59 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-db9e6bde-4234-4baa-b45c-ae98d3820751 tempest-VolumeDependencyTests-476558810 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9" returned: 0 in 0.722s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:47:59 devstack cinder-volume[82760]: DEBUG cinder.image.image_utils [None req-db9e6bde-4234-4baa-b45c-ae98d3820751 tempest-VolumeDependencyTests-476558810 None] Image conversion details: src /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9, size 1024.00 MB, duration 2.71 sec, destination /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-fcdd4787-4bfe-4621-ae68-d01b8e7d0eb0 {{(pid=82760) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 12:47:59 devstack cinder-volume[82760]: INFO cinder.image.image_utils [None req-db9e6bde-4234-4baa-b45c-ae98d3820751 tempest-VolumeDependencyTests-476558810 None] Converted 1024.00 MB image at 378.14 MB/s
Apr 09 12:47:59 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-db9e6bde-4234-4baa-b45c-ae98d3820751 tempest-VolumeDependencyTests-476558810 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-fcdd4787-4bfe-4621-ae68-d01b8e7d0eb0 is being set with open permissions: ugo+rw
Apr 09 12:47:59 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-db9e6bde-4234-4baa-b45c-ae98d3820751 tempest-VolumeDependencyTests-476558810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-fcdd4787-4bfe-4621-ae68-d01b8e7d0eb0 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:47:59 devstack sudo[87785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-fcdd4787-4bfe-4621-ae68-d01b8e7d0eb0
Apr 09 12:47:59 devstack sudo[87785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:00 devstack sudo[87785]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-db9e6bde-4234-4baa-b45c-ae98d3820751 tempest-VolumeDependencyTests-476558810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-fcdd4787-4bfe-4621-ae68-d01b8e7d0eb0" returned: 0 in 0.510s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:00 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-db9e6bde-4234-4baa-b45c-ae98d3820751 tempest-VolumeDependencyTests-476558810 None] Lock "cinder-quobyte-fcdd4787-4bfe-4621-ae68-d01b8e7d0eb0" released by "_copy_volume_from_snapshot" :: held 5.332s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:48:00 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-db9e6bde-4234-4baa-b45c-ae98d3820751 tempest-VolumeDependencyTests-476558810 None] Lock "cinder-quobyte-9934c9b8-db5a-4468-b3b6-090c027c7f0d-fcdd4787-4bfe-4621-ae68-d01b8e7d0eb0" released by "_create_volume_from_snapshot" :: held 5.368s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:48:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-db9e6bde-4234-4baa-b45c-ae98d3820751 tempest-VolumeDependencyTests-476558810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.405s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:48:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-5ae1f802-985d-4eec-a890-4da4554e5aae tempest-VolumesGetTest-606996561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.853s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:48:00 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-5ae1f802-985d-4eec-a890-4da4554e5aae tempest-VolumesGetTest-606996561 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:47:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1716934810',display_name='tempest-VolumesGetTest-Volume-600381438',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1efb3f5d-ff26-4589-bf21-9c4fce39340b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1e2e15da8734d00b19bb36f846ccfc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:47:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:47:58Z,use_quota=True,user_id='f0fe31af3e8c462da1930eb8650f1836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:48:00 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-5ae1f802-985d-4eec-a890-4da4554e5aae tempest-VolumesGetTest-606996561 None] Creating volume 1efb3f5d-ff26-4589-bf21-9c4fce39340b {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:48:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-5ae1f802-985d-4eec-a890-4da4554e5aae tempest-VolumesGetTest-606996561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:48:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-5ae1f802-985d-4eec-a890-4da4554e5aae tempest-VolumesGetTest-606996561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:48:00 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-5ae1f802-985d-4eec-a890-4da4554e5aae tempest-VolumesGetTest-606996561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:48:00 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-5ae1f802-985d-4eec-a890-4da4554e5aae tempest-VolumesGetTest-606996561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:48:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-5ae1f802-985d-4eec-a890-4da4554e5aae tempest-VolumesGetTest-606996561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:48:00 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-5ae1f802-985d-4eec-a890-4da4554e5aae tempest-VolumesGetTest-606996561 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:48:00 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-5ae1f802-985d-4eec-a890-4da4554e5aae tempest-VolumesGetTest-606996561 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:48:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-5ae1f802-985d-4eec-a890-4da4554e5aae tempest-VolumesGetTest-606996561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1efb3f5d-ff26-4589-bf21-9c4fce39340b 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:00 devstack sudo[87788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1efb3f5d-ff26-4589-bf21-9c4fce39340b 1073741824
Apr 09 12:48:00 devstack sudo[87788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:00 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-db9e6bde-4234-4baa-b45c-ae98d3820751 tempest-VolumeDependencyTests-476558810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70b768e7-d8ad-4c37-ae8b-82c6af4aa4ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcdd4787-4bfe-4621-ae68-d01b8e7d0eb0', 'volume_size': 1, 'snapshot_id': '9934c9b8-db5a-4468-b3b6-090c027c7f0d'}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:48:00 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-db9e6bde-4234-4baa-b45c-ae98d3820751 tempest-VolumeDependencyTests-476558810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cadb54d6-b36c-4696-b534-3cadd0a84919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:48:00 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-db9e6bde-4234-4baa-b45c-ae98d3820751 tempest-VolumeDependencyTests-476558810 None] Volume volume-fcdd4787-4bfe-4621-ae68-d01b8e7d0eb0 (fcdd4787-4bfe-4621-ae68-d01b8e7d0eb0): created successfully
Apr 09 12:48:00 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-db9e6bde-4234-4baa-b45c-ae98d3820751 tempest-VolumeDependencyTests-476558810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cadb54d6-b36c-4696-b534-3cadd0a84919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:48:00 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-db9e6bde-4234-4baa-b45c-ae98d3820751 tempest-VolumeDependencyTests-476558810 None] Flow 'volume_create_manager' (9edd0eec-9cbc-4dcb-8ee2-b1115bb20afa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:48:00 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-db9e6bde-4234-4baa-b45c-ae98d3820751 tempest-VolumeDependencyTests-476558810 None] Created volume successfully.
Apr 09 12:48:01 devstack sudo[87788]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-5ae1f802-985d-4eec-a890-4da4554e5aae tempest-VolumesGetTest-606996561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1efb3f5d-ff26-4589-bf21-9c4fce39340b 1073741824" returned: 0 in 0.574s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-5ae1f802-985d-4eec-a890-4da4554e5aae tempest-VolumesGetTest-606996561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1efb3f5d-ff26-4589-bf21-9c4fce39340b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:01 devstack sudo[87793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1efb3f5d-ff26-4589-bf21-9c4fce39340b
Apr 09 12:48:01 devstack sudo[87793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:01 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-b7e467a4-065e-4c24-b21d-67b443dc1bdd tempest-VolumeDependencyTests-476558810 None] Acquiring lock "cinder-9934c9b8-db5a-4468-b3b6-090c027c7f0d-delete_snapshot" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:48:01 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-b7e467a4-065e-4c24-b21d-67b443dc1bdd tempest-VolumeDependencyTests-476558810 None] Lock "cinder-9934c9b8-db5a-4468-b3b6-090c027c7f0d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:48:01 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-b7e467a4-065e-4c24-b21d-67b443dc1bdd tempest-VolumeDependencyTests-476558810 None] Acquiring lock "cinder-quobyte-0d6deda8-96f0-4924-bcf0-3829657d33e9" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:48:01 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-b7e467a4-065e-4c24-b21d-67b443dc1bdd tempest-VolumeDependencyTests-476558810 None] Lock "cinder-quobyte-0d6deda8-96f0-4924-bcf0-3829657d33e9" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:48:01 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-b7e467a4-065e-4c24-b21d-67b443dc1bdd tempest-VolumeDependencyTests-476558810 None] Acquiring lock "cinder-quobyte-9934c9b8-db5a-4468-b3b6-090c027c7f0d" by "_delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:48:01 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-b7e467a4-065e-4c24-b21d-67b443dc1bdd tempest-VolumeDependencyTests-476558810 None] Lock "cinder-quobyte-9934c9b8-db5a-4468-b3b6-090c027c7f0d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:48:01 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-b7e467a4-065e-4c24-b21d-67b443dc1bdd tempest-VolumeDependencyTests-476558810 None] Deleting offline snapshot 9934c9b8-db5a-4468-b3b6-090c027c7f0d of volume 0d6deda8-96f0-4924-bcf0-3829657d33e9 {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 12:48:01 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-b7e467a4-065e-4c24-b21d-67b443dc1bdd tempest-VolumeDependencyTests-476558810 None] snapshot_file for this snap is: volume-0d6deda8-96f0-4924-bcf0-3829657d33e9.9934c9b8-db5a-4468-b3b6-090c027c7f0d {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 12:48:01 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[a860c42f-2667-4801-a765-0b096d435893]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:48:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b7e467a4-065e-4c24-b21d-67b443dc1bdd tempest-VolumeDependencyTests-476558810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9.9934c9b8-db5a-4468-b3b6-090c027c7f0d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:01 devstack sudo[87795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9.9934c9b8-db5a-4468-b3b6-090c027c7f0d
Apr 09 12:48:01 devstack sudo[87795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:01 devstack sudo[87793]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-5ae1f802-985d-4eec-a890-4da4554e5aae tempest-VolumesGetTest-606996561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1efb3f5d-ff26-4589-bf21-9c4fce39340b" returned: 0 in 0.560s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:01 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-5ae1f802-985d-4eec-a890-4da4554e5aae tempest-VolumesGetTest-606996561 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:48:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-5ae1f802-985d-4eec-a890-4da4554e5aae tempest-VolumesGetTest-606996561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:48:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-2030de63-fde2-4841-854a-b9b69515eecd tempest-SnapshotsActionsTest-1850511053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.269s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:48:01 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-2030de63-fde2-4841-854a-b9b69515eecd tempest-SnapshotsActionsTest-1850511053 None] Creating offline snapshot 79effdc6-777d-475d-bc8a-e3120a3839be of volume f1c57785-89aa-474f-9b0a-229da9fff2ee {{(pid=82760) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 12:48:01 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-5ae1f802-985d-4eec-a890-4da4554e5aae tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcc8f31c-6d9b-4bc9-9270-65c5d62ee3bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1efb3f5d-ff26-4589-bf21-9c4fce39340b', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:48:01 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-5ae1f802-985d-4eec-a890-4da4554e5aae tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53eeb953-7c8a-4769-85d4-0a71581d6d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:48:01 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[5842e21d-5ef2-4565-a19e-b01321b86faa]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:48:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2030de63-fde2-4841-854a-b9b69515eecd tempest-SnapshotsActionsTest-1850511053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:01 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-5ae1f802-985d-4eec-a890-4da4554e5aae tempest-VolumesGetTest-606996561 None] Volume volume-1efb3f5d-ff26-4589-bf21-9c4fce39340b (1efb3f5d-ff26-4589-bf21-9c4fce39340b): created successfully
Apr 09 12:48:01 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-5ae1f802-985d-4eec-a890-4da4554e5aae tempest-VolumesGetTest-606996561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53eeb953-7c8a-4769-85d4-0a71581d6d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:48:01 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-5ae1f802-985d-4eec-a890-4da4554e5aae tempest-VolumesGetTest-606996561 None] Flow 'volume_create_manager' (13ea11d5-24bc-489c-a70c-5387262aeb9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:48:01 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-5ae1f802-985d-4eec-a890-4da4554e5aae tempest-VolumesGetTest-606996561 None] Created volume successfully.
Apr 09 12:48:01 devstack sudo[87798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b
Apr 09 12:48:01 devstack sudo[87798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:02 devstack sudo[87795]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b7e467a4-065e-4c24-b21d-67b443dc1bdd tempest-VolumeDependencyTests-476558810 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9.9934c9b8-db5a-4468-b3b6-090c027c7f0d" returned: 0 in 0.622s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:02 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-b7e467a4-065e-4c24-b21d-67b443dc1bdd tempest-VolumeDependencyTests-476558810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d6deda8-96f0-4924-bcf0-3829657d33e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:48:02 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab07d2e6-912d-4cc5-8558-3533d6369ccf]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:48:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b7e467a4-065e-4c24-b21d-67b443dc1bdd tempest-VolumeDependencyTests-476558810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:02 devstack sudo[87803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9
Apr 09 12:48:02 devstack sudo[87803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:02 devstack sudo[87798]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2030de63-fde2-4841-854a-b9b69515eecd tempest-SnapshotsActionsTest-1850511053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b" returned: 0 in 0.644s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:02 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-2030de63-fde2-4841-854a-b9b69515eecd tempest-SnapshotsActionsTest-1850511053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1c57785-89aa-474f-9b0a-229da9fff2ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:48:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2030de63-fde2-4841-854a-b9b69515eecd tempest-SnapshotsActionsTest-1850511053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.79effdc6-777d-475d-bc8a-e3120a3839be 1G {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:02 devstack sudo[87808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.79effdc6-777d-475d-bc8a-e3120a3839be 1G
Apr 09 12:48:02 devstack sudo[87808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:02 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-70ce9fc5-ce32-4746-8d6b-a0c2a05bdcee tempest-VolumesGetTest-606996561 None] Acquiring lock "cinder-1efb3f5d-ff26-4589-bf21-9c4fce39340b-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:48:02 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-70ce9fc5-ce32-4746-8d6b-a0c2a05bdcee tempest-VolumesGetTest-606996561 None] Lock "cinder-1efb3f5d-ff26-4589-bf21-9c4fce39340b-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:48:02 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-70ce9fc5-ce32-4746-8d6b-a0c2a05bdcee tempest-VolumesGetTest-606996561 None] Acquiring lock "cinder-quobyte-1efb3f5d-ff26-4589-bf21-9c4fce39340b" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:48:02 devstack sudo[87803]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b7e467a4-065e-4c24-b21d-67b443dc1bdd tempest-VolumeDependencyTests-476558810 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9" returned: 0 in 0.668s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b7e467a4-065e-4c24-b21d-67b443dc1bdd tempest-VolumeDependencyTests-476558810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9.9934c9b8-db5a-4468-b3b6-090c027c7f0d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:02 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-70ce9fc5-ce32-4746-8d6b-a0c2a05bdcee tempest-VolumesGetTest-606996561 None] Lock "cinder-quobyte-1efb3f5d-ff26-4589-bf21-9c4fce39340b" acquired by "delete_volume" :: waited 0.020s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:48:02 devstack sudo[87814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9.9934c9b8-db5a-4468-b3b6-090c027c7f0d
Apr 09 12:48:02 devstack sudo[87814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:02 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efde78e-a5ce-4511-ae2c-c088a14e710a]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:48:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-70ce9fc5-ce32-4746-8d6b-a0c2a05bdcee tempest-VolumesGetTest-606996561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1efb3f5d-ff26-4589-bf21-9c4fce39340b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:02 devstack sudo[87816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1efb3f5d-ff26-4589-bf21-9c4fce39340b
Apr 09 12:48:02 devstack sudo[87816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:03 devstack sudo[87808]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2030de63-fde2-4841-854a-b9b69515eecd tempest-SnapshotsActionsTest-1850511053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.79effdc6-777d-475d-bc8a-e3120a3839be 1G" returned: 0 in 0.716s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2030de63-fde2-4841-854a-b9b69515eecd tempest-SnapshotsActionsTest-1850511053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.79effdc6-777d-475d-bc8a-e3120a3839be {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:03 devstack sudo[87821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.79effdc6-777d-475d-bc8a-e3120a3839be
Apr 09 12:48:03 devstack sudo[87821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:03 devstack sudo[87814]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b7e467a4-065e-4c24-b21d-67b443dc1bdd tempest-VolumeDependencyTests-476558810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9.9934c9b8-db5a-4468-b3b6-090c027c7f0d" returned: 0 in 0.624s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b7e467a4-065e-4c24-b21d-67b443dc1bdd tempest-VolumeDependencyTests-476558810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9.9934c9b8-db5a-4468-b3b6-090c027c7f0d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:03 devstack sudo[87829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9.9934c9b8-db5a-4468-b3b6-090c027c7f0d
Apr 09 12:48:03 devstack sudo[87829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:03 devstack sudo[87816]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-70ce9fc5-ce32-4746-8d6b-a0c2a05bdcee tempest-VolumesGetTest-606996561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1efb3f5d-ff26-4589-bf21-9c4fce39340b" returned: 0 in 0.663s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-70ce9fc5-ce32-4746-8d6b-a0c2a05bdcee tempest-VolumesGetTest-606996561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1efb3f5d-ff26-4589-bf21-9c4fce39340b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:03 devstack sudo[87831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1efb3f5d-ff26-4589-bf21-9c4fce39340b
Apr 09 12:48:03 devstack sudo[87831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:03 devstack sudo[87821]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2030de63-fde2-4841-854a-b9b69515eecd tempest-SnapshotsActionsTest-1850511053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.79effdc6-777d-475d-bc8a-e3120a3839be" returned: 0 in 0.545s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:03 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-2030de63-fde2-4841-854a-b9b69515eecd tempest-SnapshotsActionsTest-1850511053 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.79effdc6-777d-475d-bc8a-e3120a3839be is being set with open permissions: ugo+rw
Apr 09 12:48:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2030de63-fde2-4841-854a-b9b69515eecd tempest-SnapshotsActionsTest-1850511053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.79effdc6-777d-475d-bc8a-e3120a3839be {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:03 devstack sudo[87836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.79effdc6-777d-475d-bc8a-e3120a3839be
Apr 09 12:48:03 devstack sudo[87836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:03 devstack sudo[87829]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b7e467a4-065e-4c24-b21d-67b443dc1bdd tempest-VolumeDependencyTests-476558810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9.9934c9b8-db5a-4468-b3b6-090c027c7f0d" returned: 0 in 0.596s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:03 devstack sudo[87831]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-70ce9fc5-ce32-4746-8d6b-a0c2a05bdcee tempest-VolumesGetTest-606996561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1efb3f5d-ff26-4589-bf21-9c4fce39340b" returned: 0 in 0.550s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:03 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-b7e467a4-065e-4c24-b21d-67b443dc1bdd tempest-VolumeDependencyTests-476558810 None] Lock "cinder-quobyte-9934c9b8-db5a-4468-b3b6-090c027c7f0d" released by "_delete_snapshot" :: held 2.611s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:48:03 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-70ce9fc5-ce32-4746-8d6b-a0c2a05bdcee tempest-VolumesGetTest-606996561 None] Lock "cinder-quobyte-1efb3f5d-ff26-4589-bf21-9c4fce39340b" released by "delete_volume" :: held 1.262s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:48:03 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-b7e467a4-065e-4c24-b21d-67b443dc1bdd tempest-VolumeDependencyTests-476558810 None] Lock "cinder-quobyte-0d6deda8-96f0-4924-bcf0-3829657d33e9" released by "delete_snapshot" :: held 2.638s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:48:04 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-70ce9fc5-ce32-4746-8d6b-a0c2a05bdcee tempest-VolumesGetTest-606996561 None] Created reservations ['c0d0b821-933e-4657-8d33-02b5b27d6938', 'c04584c5-c5b7-4ab1-9441-fc3468938eb0', 'c89e3de0-07ab-4464-8f98-464fb63aa41d', '69c8d18b-94c2-4c4b-9592-a0d9303197d2'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:48:04 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-b7e467a4-065e-4c24-b21d-67b443dc1bdd tempest-VolumeDependencyTests-476558810 None] Created reservations ['1ae7abfd-5d34-4989-9f05-15a26097f5c9', '5c72e3b4-84a0-4e5f-bea1-56e090fd0e32', 'f00a671d-3728-4d24-8b95-d159bd122ffc', '94a3fed1-5476-4f86-b3f7-378729808536'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:48:04 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-b7e467a4-065e-4c24-b21d-67b443dc1bdd tempest-VolumeDependencyTests-476558810 None] Delete snapshot completed successfully.
Apr 09 12:48:04 devstack sudo[87836]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-70ce9fc5-ce32-4746-8d6b-a0c2a05bdcee tempest-VolumesGetTest-606996561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:48:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-70ce9fc5-ce32-4746-8d6b-a0c2a05bdcee tempest-VolumesGetTest-606996561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:48:04 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-70ce9fc5-ce32-4746-8d6b-a0c2a05bdcee tempest-VolumesGetTest-606996561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:48:04 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-70ce9fc5-ce32-4746-8d6b-a0c2a05bdcee tempest-VolumesGetTest-606996561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:48:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-70ce9fc5-ce32-4746-8d6b-a0c2a05bdcee tempest-VolumesGetTest-606996561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:48:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-70ce9fc5-ce32-4746-8d6b-a0c2a05bdcee tempest-VolumesGetTest-606996561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2030de63-fde2-4841-854a-b9b69515eecd tempest-SnapshotsActionsTest-1850511053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.79effdc6-777d-475d-bc8a-e3120a3839be" returned: 0 in 0.548s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:04 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-b7e467a4-065e-4c24-b21d-67b443dc1bdd tempest-VolumeDependencyTests-476558810 None] Lock "cinder-9934c9b8-db5a-4468-b3b6-090c027c7f0d-delete_snapshot" released by "delete_snapshot" :: held 2.844s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:48:04 devstack sudo[87841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:48:04 devstack sudo[87841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-2030de63-fde2-4841-854a-b9b69515eecd tempest-SnapshotsActionsTest-1850511053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.548s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:48:04 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-2030de63-fde2-4841-854a-b9b69515eecd tempest-SnapshotsActionsTest-1850511053 None] Create snapshot completed successfully
Apr 09 12:48:04 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-3a35f2fa-921c-4716-8ba1-d35ceea19bbe tempest-VolumeDependencyTests-476558810 None] Acquiring lock "cinder-0d6deda8-96f0-4924-bcf0-3829657d33e9-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:48:04 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-3a35f2fa-921c-4716-8ba1-d35ceea19bbe tempest-VolumeDependencyTests-476558810 None] Lock "cinder-0d6deda8-96f0-4924-bcf0-3829657d33e9-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:48:04 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-3a35f2fa-921c-4716-8ba1-d35ceea19bbe tempest-VolumeDependencyTests-476558810 None] Acquiring lock "cinder-quobyte-0d6deda8-96f0-4924-bcf0-3829657d33e9" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:48:04 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-3a35f2fa-921c-4716-8ba1-d35ceea19bbe tempest-VolumeDependencyTests-476558810 None] Lock "cinder-quobyte-0d6deda8-96f0-4924-bcf0-3829657d33e9" acquired by "delete_volume" :: waited 0.015s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:48:04 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd04761-5aed-4b54-b566-c0ab280f1623]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:48:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-3a35f2fa-921c-4716-8ba1-d35ceea19bbe tempest-VolumeDependencyTests-476558810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:04 devstack sudo[87844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9
Apr 09 12:48:04 devstack sudo[87844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:04 devstack sudo[87841]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-70ce9fc5-ce32-4746-8d6b-a0c2a05bdcee tempest-VolumesGetTest-606996561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.519s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:04 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-70ce9fc5-ce32-4746-8d6b-a0c2a05bdcee tempest-VolumesGetTest-606996561 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:48:04 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-70ce9fc5-ce32-4746-8d6b-a0c2a05bdcee tempest-VolumesGetTest-606996561 None] Deleted volume successfully.
Apr 09 12:48:04 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-70ce9fc5-ce32-4746-8d6b-a0c2a05bdcee tempest-VolumesGetTest-606996561 None] Lock "cinder-1efb3f5d-ff26-4589-bf21-9c4fce39340b-delete_volume" released by "delete_volume" :: held 2.034s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:48:04 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-8f20ede6-e71f-4b66-a179-8341b165d47e tempest-SnapshotsActionsTest-758081170 None] Acquiring lock "cinder-79effdc6-777d-475d-bc8a-e3120a3839be-delete_snapshot" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:48:04 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-8f20ede6-e71f-4b66-a179-8341b165d47e tempest-SnapshotsActionsTest-758081170 None] Lock "cinder-79effdc6-777d-475d-bc8a-e3120a3839be-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:48:04 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-8f20ede6-e71f-4b66-a179-8341b165d47e tempest-SnapshotsActionsTest-758081170 None] Acquiring lock "cinder-quobyte-f1c57785-89aa-474f-9b0a-229da9fff2ee" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:48:04 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-8f20ede6-e71f-4b66-a179-8341b165d47e tempest-SnapshotsActionsTest-758081170 None] Lock "cinder-quobyte-f1c57785-89aa-474f-9b0a-229da9fff2ee" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:48:04 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-8f20ede6-e71f-4b66-a179-8341b165d47e tempest-SnapshotsActionsTest-758081170 None] Acquiring lock "cinder-quobyte-79effdc6-777d-475d-bc8a-e3120a3839be" by "_delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:48:04 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-8f20ede6-e71f-4b66-a179-8341b165d47e tempest-SnapshotsActionsTest-758081170 None] Lock "cinder-quobyte-79effdc6-777d-475d-bc8a-e3120a3839be" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:48:04 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-8f20ede6-e71f-4b66-a179-8341b165d47e tempest-SnapshotsActionsTest-758081170 None] Deleting offline snapshot 79effdc6-777d-475d-bc8a-e3120a3839be of volume f1c57785-89aa-474f-9b0a-229da9fff2ee {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 12:48:04 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-8f20ede6-e71f-4b66-a179-8341b165d47e tempest-SnapshotsActionsTest-758081170 None] snapshot_file for this snap is: volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.79effdc6-777d-475d-bc8a-e3120a3839be {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 12:48:04 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[870807c7-b8d0-4a2f-b95a-96e630e6ca53]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:48:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-8f20ede6-e71f-4b66-a179-8341b165d47e tempest-SnapshotsActionsTest-758081170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.79effdc6-777d-475d-bc8a-e3120a3839be {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:04 devstack sudo[87846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.79effdc6-777d-475d-bc8a-e3120a3839be
Apr 09 12:48:04 devstack sudo[87846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:04 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-073e1358-b269-4823-a6d7-ec91d421497c tempest-VolumesGetTest-606996561 None] Acquiring lock "cinder-cc9493d8-4151-42ed-af89-b52bacdd253b-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:48:04 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-073e1358-b269-4823-a6d7-ec91d421497c tempest-VolumesGetTest-606996561 None] Lock "cinder-cc9493d8-4151-42ed-af89-b52bacdd253b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:48:04 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-073e1358-b269-4823-a6d7-ec91d421497c tempest-VolumesGetTest-606996561 None] Acquiring lock "cinder-quobyte-cc9493d8-4151-42ed-af89-b52bacdd253b" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:48:05 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-073e1358-b269-4823-a6d7-ec91d421497c tempest-VolumesGetTest-606996561 None] Lock "cinder-quobyte-cc9493d8-4151-42ed-af89-b52bacdd253b" acquired by "delete_volume" :: waited 0.014s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:48:05 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[b336ba72-736c-4019-8dfa-53c7625a4c37]: (4, 'raw') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:48:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-073e1358-b269-4823-a6d7-ec91d421497c tempest-VolumesGetTest-606996561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-cc9493d8-4151-42ed-af89-b52bacdd253b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:05 devstack sudo[87848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-cc9493d8-4151-42ed-af89-b52bacdd253b
Apr 09 12:48:05 devstack sudo[87848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:05 devstack sudo[87844]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-3a35f2fa-921c-4716-8ba1-d35ceea19bbe tempest-VolumeDependencyTests-476558810 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9" returned: 0 in 0.644s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-3a35f2fa-921c-4716-8ba1-d35ceea19bbe tempest-VolumeDependencyTests-476558810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:05 devstack sudo[87853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9
Apr 09 12:48:05 devstack sudo[87853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:05 devstack sudo[87846]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-8f20ede6-e71f-4b66-a179-8341b165d47e tempest-SnapshotsActionsTest-758081170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.79effdc6-777d-475d-bc8a-e3120a3839be" returned: 0 in 0.628s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:05 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-8f20ede6-e71f-4b66-a179-8341b165d47e tempest-SnapshotsActionsTest-758081170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1c57785-89aa-474f-9b0a-229da9fff2ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:48:05 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9a98f5-7319-485e-bddd-c0e827eba3d6]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:48:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-8f20ede6-e71f-4b66-a179-8341b165d47e tempest-SnapshotsActionsTest-758081170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:05 devstack sudo[87858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b
Apr 09 12:48:05 devstack sudo[87858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:05 devstack sudo[87848]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-073e1358-b269-4823-a6d7-ec91d421497c tempest-VolumesGetTest-606996561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-cc9493d8-4151-42ed-af89-b52bacdd253b" returned: 0 in 0.626s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-073e1358-b269-4823-a6d7-ec91d421497c tempest-VolumesGetTest-606996561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-cc9493d8-4151-42ed-af89-b52bacdd253b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:05 devstack sudo[87853]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-3a35f2fa-921c-4716-8ba1-d35ceea19bbe tempest-VolumeDependencyTests-476558810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-0d6deda8-96f0-4924-bcf0-3829657d33e9" returned: 0 in 0.498s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:05 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-3a35f2fa-921c-4716-8ba1-d35ceea19bbe tempest-VolumeDependencyTests-476558810 None] Lock "cinder-quobyte-0d6deda8-96f0-4924-bcf0-3829657d33e9" released by "delete_volume" :: held 1.190s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:48:05 devstack sudo[87863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-cc9493d8-4151-42ed-af89-b52bacdd253b
Apr 09 12:48:05 devstack sudo[87863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:05 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-3a35f2fa-921c-4716-8ba1-d35ceea19bbe tempest-VolumeDependencyTests-476558810 None] Created reservations ['0ac5454c-6c30-4512-ac89-c1a80015c788', 'e34c4e37-636a-4fba-bbef-d14d56893b47', '6ffffb65-4d8a-4ad2-89f1-94c38abd7b5a', 'ca4fdd65-9de9-4ccc-9b0f-71e5b7f26035'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:48:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-3a35f2fa-921c-4716-8ba1-d35ceea19bbe tempest-VolumeDependencyTests-476558810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:48:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-3a35f2fa-921c-4716-8ba1-d35ceea19bbe tempest-VolumeDependencyTests-476558810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:48:05 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-3a35f2fa-921c-4716-8ba1-d35ceea19bbe tempest-VolumeDependencyTests-476558810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:48:05 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-3a35f2fa-921c-4716-8ba1-d35ceea19bbe tempest-VolumeDependencyTests-476558810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:48:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-3a35f2fa-921c-4716-8ba1-d35ceea19bbe tempest-VolumeDependencyTests-476558810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:48:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-3a35f2fa-921c-4716-8ba1-d35ceea19bbe tempest-VolumeDependencyTests-476558810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:05 devstack sudo[87865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:48:05 devstack sudo[87865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:06 devstack sudo[87858]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:06 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-8f20ede6-e71f-4b66-a179-8341b165d47e tempest-SnapshotsActionsTest-758081170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b" returned: 0 in 0.670s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:06 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-8f20ede6-e71f-4b66-a179-8341b165d47e tempest-SnapshotsActionsTest-758081170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1c57785-89aa-474f-9b0a-229da9fff2ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:48:06 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-8f20ede6-e71f-4b66-a179-8341b165d47e tempest-SnapshotsActionsTest-758081170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.79effdc6-777d-475d-bc8a-e3120a3839be {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:06 devstack sudo[87870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.79effdc6-777d-475d-bc8a-e3120a3839be
Apr 09 12:48:06 devstack sudo[87870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:06 devstack sudo[87863]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:06 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-073e1358-b269-4823-a6d7-ec91d421497c tempest-VolumesGetTest-606996561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-cc9493d8-4151-42ed-af89-b52bacdd253b" returned: 1 in 0.647s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:06 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-073e1358-b269-4823-a6d7-ec91d421497c tempest-VolumesGetTest-606996561 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-cc9493d8-4151-42ed-af89-b52bacdd253b' failed. Not Retrying. {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 09 12:48:06 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-073e1358-b269-4823-a6d7-ec91d421497c tempest-VolumesGetTest-606996561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-cc9493d8-4151-42ed-af89-b52bacdd253b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:06 devstack sudo[87876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-cc9493d8-4151-42ed-af89-b52bacdd253b
Apr 09 12:48:06 devstack sudo[87876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:06 devstack sudo[87865]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:06 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-3a35f2fa-921c-4716-8ba1-d35ceea19bbe tempest-VolumeDependencyTests-476558810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.537s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:06 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-3a35f2fa-921c-4716-8ba1-d35ceea19bbe tempest-VolumeDependencyTests-476558810 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:48:06 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-3a35f2fa-921c-4716-8ba1-d35ceea19bbe tempest-VolumeDependencyTests-476558810 None] Deleted volume successfully.
Apr 09 12:48:06 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-3a35f2fa-921c-4716-8ba1-d35ceea19bbe tempest-VolumeDependencyTests-476558810 None] Lock "cinder-0d6deda8-96f0-4924-bcf0-3829657d33e9-delete_volume" released by "delete_volume" :: held 1.891s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:48:06 devstack sudo[87870]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:06 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-8f20ede6-e71f-4b66-a179-8341b165d47e tempest-SnapshotsActionsTest-758081170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.79effdc6-777d-475d-bc8a-e3120a3839be" returned: 0 in 0.526s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:06 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-8f20ede6-e71f-4b66-a179-8341b165d47e tempest-SnapshotsActionsTest-758081170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.79effdc6-777d-475d-bc8a-e3120a3839be {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:06 devstack sudo[87881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.79effdc6-777d-475d-bc8a-e3120a3839be
Apr 09 12:48:06 devstack sudo[87881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:06 devstack sudo[87876]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:06 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-073e1358-b269-4823-a6d7-ec91d421497c tempest-VolumesGetTest-606996561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-cc9493d8-4151-42ed-af89-b52bacdd253b" returned: 0 in 0.488s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:06 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-073e1358-b269-4823-a6d7-ec91d421497c tempest-VolumesGetTest-606996561 None] Lock "cinder-quobyte-cc9493d8-4151-42ed-af89-b52bacdd253b" released by "delete_volume" :: held 1.833s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:48:06 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-073e1358-b269-4823-a6d7-ec91d421497c tempest-VolumesGetTest-606996561 None] Created reservations ['08b90f3a-3699-41d1-a196-795581e1bae7', '96484975-382e-4980-bfdc-77db0943ae98', '3914f843-3af8-4adb-96e0-e16e7628b3db', '134266f0-7bf8-4381-9a81-dda845639c1f'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:48:07 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a0d7c7f-2d8a-4076-8068-413459412ab9 tempest-VolumeDependencyTests-476558810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:48:07 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-7a0d7c7f-2d8a-4076-8068-413459412ab9 tempest-VolumeDependencyTests-476558810 None] Flow 'volume_create_manager' (bb3dda47-a0ea-4b01-be8f-07fdb43384d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:48:07 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-7a0d7c7f-2d8a-4076-8068-413459412ab9 tempest-VolumeDependencyTests-476558810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (596756ce-d44d-4601-a35d-c718fe1af6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:48:07 devstack sudo[87881]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:07 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-7a0d7c7f-2d8a-4076-8068-413459412ab9 tempest-VolumeDependencyTests-476558810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (596756ce-d44d-4601-a35d-c718fe1af6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:48:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1129627244',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2754ab7d-095a-4866-8ed8-0596600a6fc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28f5a0458de448a0bde2c150376bc42e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:48:07Z,use_quota=True,user_id='a04a77cece624a4e9632672086c90ef5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:48:07 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-7a0d7c7f-2d8a-4076-8068-413459412ab9 tempest-VolumeDependencyTests-476558810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50b46803-ea34-4b1f-bd3c-ef0b62a9d547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:48:07 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-7a0d7c7f-2d8a-4076-8068-413459412ab9 tempest-VolumeDependencyTests-476558810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50b46803-ea34-4b1f-bd3c-ef0b62a9d547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:48:07 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-7a0d7c7f-2d8a-4076-8068-413459412ab9 tempest-VolumeDependencyTests-476558810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (643ffe1c-757a-42e7-afde-4c9138b6e944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:48:07 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-7a0d7c7f-2d8a-4076-8068-413459412ab9 tempest-VolumeDependencyTests-476558810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (643ffe1c-757a-42e7-afde-4c9138b6e944) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2754ab7d-095a-4866-8ed8-0596600a6fc8', 'volume_name': 'volume-2754ab7d-095a-4866-8ed8-0596600a6fc8', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:48:07 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-7a0d7c7f-2d8a-4076-8068-413459412ab9 tempest-VolumeDependencyTests-476558810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc6c6e40-86ec-4ed7-b499-e45a97895ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:48:07 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-7a0d7c7f-2d8a-4076-8068-413459412ab9 tempest-VolumeDependencyTests-476558810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc6c6e40-86ec-4ed7-b499-e45a97895ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:48:07 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-7a0d7c7f-2d8a-4076-8068-413459412ab9 tempest-VolumeDependencyTests-476558810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1dfaff4-68d3-4ed9-828b-cd0e3867af47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:48:07 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-7a0d7c7f-2d8a-4076-8068-413459412ab9 tempest-VolumeDependencyTests-476558810 None] Volume 2754ab7d-095a-4866-8ed8-0596600a6fc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2754ab7d-095a-4866-8ed8-0596600a6fc8', 'volume_size': 1}
Apr 09 12:48:07 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-7a0d7c7f-2d8a-4076-8068-413459412ab9 tempest-VolumeDependencyTests-476558810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:48:07 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-7a0d7c7f-2d8a-4076-8068-413459412ab9 tempest-VolumeDependencyTests-476558810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:48:07 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-7a0d7c7f-2d8a-4076-8068-413459412ab9 tempest-VolumeDependencyTests-476558810 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:48:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1129627244',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2754ab7d-095a-4866-8ed8-0596600a6fc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28f5a0458de448a0bde2c150376bc42e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:48:07Z,use_quota=True,user_id='a04a77cece624a4e9632672086c90ef5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:48:07 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-7a0d7c7f-2d8a-4076-8068-413459412ab9 tempest-VolumeDependencyTests-476558810 None] Creating volume 2754ab7d-095a-4866-8ed8-0596600a6fc8 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:48:07 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-7a0d7c7f-2d8a-4076-8068-413459412ab9 tempest-VolumeDependencyTests-476558810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:48:07 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-7a0d7c7f-2d8a-4076-8068-413459412ab9 tempest-VolumeDependencyTests-476558810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:48:07 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-7a0d7c7f-2d8a-4076-8068-413459412ab9 tempest-VolumeDependencyTests-476558810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:48:07 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-7a0d7c7f-2d8a-4076-8068-413459412ab9 tempest-VolumeDependencyTests-476558810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:48:07 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-7a0d7c7f-2d8a-4076-8068-413459412ab9 tempest-VolumeDependencyTests-476558810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:48:07 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-7a0d7c7f-2d8a-4076-8068-413459412ab9 tempest-VolumeDependencyTests-476558810 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:48:07 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-7a0d7c7f-2d8a-4076-8068-413459412ab9 tempest-VolumeDependencyTests-476558810 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:48:07 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-7a0d7c7f-2d8a-4076-8068-413459412ab9 tempest-VolumeDependencyTests-476558810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:07 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-073e1358-b269-4823-a6d7-ec91d421497c tempest-VolumesGetTest-606996561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:48:07 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-073e1358-b269-4823-a6d7-ec91d421497c tempest-VolumesGetTest-606996561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:48:07 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-073e1358-b269-4823-a6d7-ec91d421497c tempest-VolumesGetTest-606996561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:48:07 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-073e1358-b269-4823-a6d7-ec91d421497c tempest-VolumesGetTest-606996561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:48:07 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-073e1358-b269-4823-a6d7-ec91d421497c tempest-VolumesGetTest-606996561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:48:07 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-073e1358-b269-4823-a6d7-ec91d421497c tempest-VolumesGetTest-606996561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:07 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-8f20ede6-e71f-4b66-a179-8341b165d47e tempest-SnapshotsActionsTest-758081170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.79effdc6-777d-475d-bc8a-e3120a3839be" returned: 0 in 0.655s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:07 devstack sudo[87885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8 1073741824
Apr 09 12:48:07 devstack sudo[87885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:07 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-8f20ede6-e71f-4b66-a179-8341b165d47e tempest-SnapshotsActionsTest-758081170 None] Lock "cinder-quobyte-79effdc6-777d-475d-bc8a-e3120a3839be" released by "_delete_snapshot" :: held 2.542s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:48:07 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-8f20ede6-e71f-4b66-a179-8341b165d47e tempest-SnapshotsActionsTest-758081170 None] Lock "cinder-quobyte-f1c57785-89aa-474f-9b0a-229da9fff2ee" released by "delete_snapshot" :: held 2.558s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:48:07 devstack sudo[87886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:48:07 devstack sudo[87886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:07 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-8f20ede6-e71f-4b66-a179-8341b165d47e tempest-SnapshotsActionsTest-758081170 None] Created reservations ['bcd741e9-e693-41e7-98d7-274741f0ffcb', 'e632dabd-d663-4f84-a57d-bcee558649fa', '7ec77d3c-5e70-47f8-be01-2eaa2ac1a136', 'b5586bf0-17c5-493c-ba76-2f8452cc1aa7'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:48:07 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-8f20ede6-e71f-4b66-a179-8341b165d47e tempest-SnapshotsActionsTest-758081170 None] Delete snapshot completed successfully.
Apr 09 12:48:07 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-8f20ede6-e71f-4b66-a179-8341b165d47e tempest-SnapshotsActionsTest-758081170 None] Lock "cinder-79effdc6-777d-475d-bc8a-e3120a3839be-delete_snapshot" released by "delete_snapshot" :: held 2.696s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:48:07 devstack sudo[87886]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:07 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-073e1358-b269-4823-a6d7-ec91d421497c tempest-VolumesGetTest-606996561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.623s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:07 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-073e1358-b269-4823-a6d7-ec91d421497c tempest-VolumesGetTest-606996561 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:48:07 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-073e1358-b269-4823-a6d7-ec91d421497c tempest-VolumesGetTest-606996561 None] Deleted volume successfully.
Apr 09 12:48:07 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-073e1358-b269-4823-a6d7-ec91d421497c tempest-VolumesGetTest-606996561 None] Lock "cinder-cc9493d8-4151-42ed-af89-b52bacdd253b-delete_volume" released by "delete_volume" :: held 2.960s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:48:07 devstack sudo[87885]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:07 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-7a0d7c7f-2d8a-4076-8068-413459412ab9 tempest-VolumeDependencyTests-476558810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8 1073741824" returned: 0 in 0.744s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-7a0d7c7f-2d8a-4076-8068-413459412ab9 tempest-VolumeDependencyTests-476558810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:08 devstack sudo[87893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8
Apr 09 12:48:08 devstack sudo[87893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-080a6522-ee52-4407-be35-2ebaa51593ac tempest-SnapshotsActionsTest-1850511053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:48:08 devstack sudo[87893]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-7a0d7c7f-2d8a-4076-8068-413459412ab9 tempest-VolumeDependencyTests-476558810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8" returned: 0 in 0.533s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:08 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-7a0d7c7f-2d8a-4076-8068-413459412ab9 tempest-VolumeDependencyTests-476558810 None] <== create_volume: return (1313ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:48:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-7a0d7c7f-2d8a-4076-8068-413459412ab9 tempest-VolumeDependencyTests-476558810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.316s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:48:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-080a6522-ee52-4407-be35-2ebaa51593ac tempest-SnapshotsActionsTest-1850511053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.355s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:48:08 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-7a0d7c7f-2d8a-4076-8068-413459412ab9 tempest-VolumeDependencyTests-476558810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1dfaff4-68d3-4ed9-828b-cd0e3867af47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2754ab7d-095a-4866-8ed8-0596600a6fc8', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:48:08 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-7a0d7c7f-2d8a-4076-8068-413459412ab9 tempest-VolumeDependencyTests-476558810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4d05b0d-99c4-4c02-b67d-e2e83958671c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:48:08 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-080a6522-ee52-4407-be35-2ebaa51593ac tempest-SnapshotsActionsTest-1850511053 None] Creating offline snapshot 9a91de16-21e6-4a6d-8c5a-98816c0228ff of volume f1c57785-89aa-474f-9b0a-229da9fff2ee {{(pid=82760) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 12:48:08 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-7a0d7c7f-2d8a-4076-8068-413459412ab9 tempest-VolumeDependencyTests-476558810 None] Volume volume-2754ab7d-095a-4866-8ed8-0596600a6fc8 (2754ab7d-095a-4866-8ed8-0596600a6fc8): created successfully
Apr 09 12:48:08 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-7a0d7c7f-2d8a-4076-8068-413459412ab9 tempest-VolumeDependencyTests-476558810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4d05b0d-99c4-4c02-b67d-e2e83958671c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:48:08 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-7a0d7c7f-2d8a-4076-8068-413459412ab9 tempest-VolumeDependencyTests-476558810 None] Flow 'volume_create_manager' (bb3dda47-a0ea-4b01-be8f-07fdb43384d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:48:08 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff64114-d2cc-4707-af8d-4dd10330c615]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:48:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-080a6522-ee52-4407-be35-2ebaa51593ac tempest-SnapshotsActionsTest-1850511053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:08 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-7a0d7c7f-2d8a-4076-8068-413459412ab9 tempest-VolumeDependencyTests-476558810 None] Created volume successfully.
Apr 09 12:48:08 devstack sudo[87896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b
Apr 09 12:48:08 devstack sudo[87896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:09 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-27851b33-8a86-4eeb-96b4-aea32a1cc1d2 tempest-VolumesListTestJSON-47761830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:48:09 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-27851b33-8a86-4eeb-96b4-aea32a1cc1d2 tempest-VolumesListTestJSON-47761830 None] Flow 'volume_create_manager' (fe7f27f8-9ab4-4a66-9678-059eb5628de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:48:09 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-27851b33-8a86-4eeb-96b4-aea32a1cc1d2 tempest-VolumesListTestJSON-47761830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cd4067d-8f45-4b5d-86b4-6fa47fc48310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:48:09 devstack sudo[87896]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:09 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-27851b33-8a86-4eeb-96b4-aea32a1cc1d2 tempest-VolumesListTestJSON-47761830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cd4067d-8f45-4b5d-86b4-6fa47fc48310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1251530484',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e675bb62-b976-40f7-b368-2ee5a0173388,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='27f1eed5a19845fea75546a8825250b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:48:09Z,use_quota=True,user_id='b4dd6d93e0a24ea8998f301c0f42dd17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:48:09 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-27851b33-8a86-4eeb-96b4-aea32a1cc1d2 tempest-VolumesListTestJSON-47761830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d93887c0-7026-4167-8b25-104ba730a4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:48:09 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-27851b33-8a86-4eeb-96b4-aea32a1cc1d2 tempest-VolumesListTestJSON-47761830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d93887c0-7026-4167-8b25-104ba730a4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:48:09 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-27851b33-8a86-4eeb-96b4-aea32a1cc1d2 tempest-VolumesListTestJSON-47761830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30c1502c-e681-4e64-b5c8-207f5e4aa7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:48:09 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-27851b33-8a86-4eeb-96b4-aea32a1cc1d2 tempest-VolumesListTestJSON-47761830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30c1502c-e681-4e64-b5c8-207f5e4aa7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e675bb62-b976-40f7-b368-2ee5a0173388', 'volume_name': 'volume-e675bb62-b976-40f7-b368-2ee5a0173388', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:48:09 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-27851b33-8a86-4eeb-96b4-aea32a1cc1d2 tempest-VolumesListTestJSON-47761830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c5466f2-2aab-4ccc-a50a-3b3ce397a6b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:48:09 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-27851b33-8a86-4eeb-96b4-aea32a1cc1d2 tempest-VolumesListTestJSON-47761830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c5466f2-2aab-4ccc-a50a-3b3ce397a6b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:48:09 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-27851b33-8a86-4eeb-96b4-aea32a1cc1d2 tempest-VolumesListTestJSON-47761830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b12cf1e-13c1-49ee-9510-e88a9ad8e11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:48:09 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-27851b33-8a86-4eeb-96b4-aea32a1cc1d2 tempest-VolumesListTestJSON-47761830 None] Volume e675bb62-b976-40f7-b368-2ee5a0173388: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e675bb62-b976-40f7-b368-2ee5a0173388', 'volume_size': 1}
Apr 09 12:48:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-27851b33-8a86-4eeb-96b4-aea32a1cc1d2 tempest-VolumesListTestJSON-47761830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:48:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-080a6522-ee52-4407-be35-2ebaa51593ac tempest-SnapshotsActionsTest-1850511053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b" returned: 0 in 0.711s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:09 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-080a6522-ee52-4407-be35-2ebaa51593ac tempest-SnapshotsActionsTest-1850511053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1c57785-89aa-474f-9b0a-229da9fff2ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:48:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-080a6522-ee52-4407-be35-2ebaa51593ac tempest-SnapshotsActionsTest-1850511053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.9a91de16-21e6-4a6d-8c5a-98816c0228ff 1G {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:09 devstack sudo[87902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.9a91de16-21e6-4a6d-8c5a-98816c0228ff 1G
Apr 09 12:48:09 devstack sudo[87902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:09 devstack cinder-volume[82760]: DEBUG oslo_service.periodic_task [None req-f8337202-8290-4658-916e-19cfa929172e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82760) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 09 12:48:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f8337202-8290-4658-916e-19cfa929172e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:48:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f8337202-8290-4658-916e-19cfa929172e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:48:09 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f8337202-8290-4658-916e-19cfa929172e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:48:09 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f8337202-8290-4658-916e-19cfa929172e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:48:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f8337202-8290-4658-916e-19cfa929172e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:48:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f8337202-8290-4658-916e-19cfa929172e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:09 devstack sudo[87904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:48:09 devstack sudo[87904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:09 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:48:09 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] Flow 'volume_create_manager' (1f87aa6b-e0f2-4087-ad1c-4a6b507b9d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:48:09 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e30be0bc-fcb5-4118-8853-27ad265ad8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:48:09 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e30be0bc-fcb5-4118-8853-27ad265ad8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2028402608',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7092806f-102c-4b3e-9f6d-949d9f6be992,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28f5a0458de448a0bde2c150376bc42e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=2754ab7d-095a-4866-8ed8-0596600a6fc8,status='creating',terminated_at=None,updated_at=2026-04-09T10:48:10Z,use_quota=True,user_id='a04a77cece624a4e9632672086c90ef5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:48:09 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (337f132b-1d57-429a-a78c-488317bb632e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:48:09 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (337f132b-1d57-429a-a78c-488317bb632e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:48:09 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47c4b1fe-19dc-4c2e-bdfd-47279c75e1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:48:09 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47c4b1fe-19dc-4c2e-bdfd-47279c75e1b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '7092806f-102c-4b3e-9f6d-949d9f6be992', 'volume_name': 'volume-7092806f-102c-4b3e-9f6d-949d9f6be992', 'volume_size': 1, 'source_volid': '2754ab7d-095a-4866-8ed8-0596600a6fc8', 'source_volstatus': 'available'}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:48:09 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f80877aa-edf6-4a3e-aaa4-cac051e16f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:48:09 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f80877aa-edf6-4a3e-aaa4-cac051e16f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:48:09 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcba319d-4752-4e87-b2ca-fccde998d939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:48:09 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] Volume 7092806f-102c-4b3e-9f6d-949d9f6be992: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-7092806f-102c-4b3e-9f6d-949d9f6be992', 'volume_size': 1, 'source_volid': '2754ab7d-095a-4866-8ed8-0596600a6fc8', 'source_volstatus': 'available'}
Apr 09 12:48:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:48:09 devstack sudo[87902]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-080a6522-ee52-4407-be35-2ebaa51593ac tempest-SnapshotsActionsTest-1850511053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.9a91de16-21e6-4a6d-8c5a-98816c0228ff 1G" returned: 0 in 0.598s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-080a6522-ee52-4407-be35-2ebaa51593ac tempest-SnapshotsActionsTest-1850511053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.9a91de16-21e6-4a6d-8c5a-98816c0228ff {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:09 devstack sudo[87904]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f8337202-8290-4658-916e-19cfa929172e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.558s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:09 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-f8337202-8290-4658-916e-19cfa929172e None None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:48:09 devstack sudo[87910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.9a91de16-21e6-4a6d-8c5a-98816c0228ff
Apr 09 12:48:09 devstack sudo[87910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:10 devstack sudo[87910]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-080a6522-ee52-4407-be35-2ebaa51593ac tempest-SnapshotsActionsTest-1850511053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.9a91de16-21e6-4a6d-8c5a-98816c0228ff" returned: 0 in 0.498s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:10 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-080a6522-ee52-4407-be35-2ebaa51593ac tempest-SnapshotsActionsTest-1850511053 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.9a91de16-21e6-4a6d-8c5a-98816c0228ff is being set with open permissions: ugo+rw
Apr 09 12:48:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-080a6522-ee52-4407-be35-2ebaa51593ac tempest-SnapshotsActionsTest-1850511053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.9a91de16-21e6-4a6d-8c5a-98816c0228ff {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:10 devstack sudo[87915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.9a91de16-21e6-4a6d-8c5a-98816c0228ff
Apr 09 12:48:10 devstack sudo[87915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:10 devstack sudo[87915]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-080a6522-ee52-4407-be35-2ebaa51593ac tempest-SnapshotsActionsTest-1850511053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.9a91de16-21e6-4a6d-8c5a-98816c0228ff" returned: 0 in 0.461s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-080a6522-ee52-4407-be35-2ebaa51593ac tempest-SnapshotsActionsTest-1850511053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.364s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:48:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-27851b33-8a86-4eeb-96b4-aea32a1cc1d2 tempest-VolumesListTestJSON-47761830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.586s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:48:10 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-27851b33-8a86-4eeb-96b4-aea32a1cc1d2 tempest-VolumesListTestJSON-47761830 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1251530484',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e675bb62-b976-40f7-b368-2ee5a0173388,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='27f1eed5a19845fea75546a8825250b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:48:09Z,use_quota=True,user_id='b4dd6d93e0a24ea8998f301c0f42dd17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:48:10 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-27851b33-8a86-4eeb-96b4-aea32a1cc1d2 tempest-VolumesListTestJSON-47761830 None] Creating volume e675bb62-b976-40f7-b368-2ee5a0173388 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:48:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-27851b33-8a86-4eeb-96b4-aea32a1cc1d2 tempest-VolumesListTestJSON-47761830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:48:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-27851b33-8a86-4eeb-96b4-aea32a1cc1d2 tempest-VolumesListTestJSON-47761830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:48:10 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-27851b33-8a86-4eeb-96b4-aea32a1cc1d2 tempest-VolumesListTestJSON-47761830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:48:10 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-27851b33-8a86-4eeb-96b4-aea32a1cc1d2 tempest-VolumesListTestJSON-47761830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:48:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-27851b33-8a86-4eeb-96b4-aea32a1cc1d2 tempest-VolumesListTestJSON-47761830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:48:10 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-27851b33-8a86-4eeb-96b4-aea32a1cc1d2 tempest-VolumesListTestJSON-47761830 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:48:10 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-27851b33-8a86-4eeb-96b4-aea32a1cc1d2 tempest-VolumesListTestJSON-47761830 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:48:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-27851b33-8a86-4eeb-96b4-aea32a1cc1d2 tempest-VolumesListTestJSON-47761830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e675bb62-b976-40f7-b368-2ee5a0173388 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:10 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-080a6522-ee52-4407-be35-2ebaa51593ac tempest-SnapshotsActionsTest-1850511053 None] Create snapshot completed successfully
Apr 09 12:48:10 devstack sudo[87918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e675bb62-b976-40f7-b368-2ee5a0173388 1073741824
Apr 09 12:48:10 devstack sudo[87918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:11 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-d1f8f9e7-73e3-4bdd-8a27-c060e9a56ae1 tempest-SnapshotsActionsTest-758081170 None] Acquiring lock "cinder-9a91de16-21e6-4a6d-8c5a-98816c0228ff-delete_snapshot" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:48:11 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-d1f8f9e7-73e3-4bdd-8a27-c060e9a56ae1 tempest-SnapshotsActionsTest-758081170 None] Lock "cinder-9a91de16-21e6-4a6d-8c5a-98816c0228ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:48:11 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-d1f8f9e7-73e3-4bdd-8a27-c060e9a56ae1 tempest-SnapshotsActionsTest-758081170 None] Acquiring lock "cinder-quobyte-f1c57785-89aa-474f-9b0a-229da9fff2ee" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:48:11 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-d1f8f9e7-73e3-4bdd-8a27-c060e9a56ae1 tempest-SnapshotsActionsTest-758081170 None] Lock "cinder-quobyte-f1c57785-89aa-474f-9b0a-229da9fff2ee" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:48:11 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-d1f8f9e7-73e3-4bdd-8a27-c060e9a56ae1 tempest-SnapshotsActionsTest-758081170 None] Acquiring lock "cinder-quobyte-9a91de16-21e6-4a6d-8c5a-98816c0228ff" by "_delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:48:11 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-d1f8f9e7-73e3-4bdd-8a27-c060e9a56ae1 tempest-SnapshotsActionsTest-758081170 None] Lock "cinder-quobyte-9a91de16-21e6-4a6d-8c5a-98816c0228ff" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:48:11 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-d1f8f9e7-73e3-4bdd-8a27-c060e9a56ae1 tempest-SnapshotsActionsTest-758081170 None] Deleting offline snapshot 9a91de16-21e6-4a6d-8c5a-98816c0228ff of volume f1c57785-89aa-474f-9b0a-229da9fff2ee {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 12:48:11 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-d1f8f9e7-73e3-4bdd-8a27-c060e9a56ae1 tempest-SnapshotsActionsTest-758081170 None] snapshot_file for this snap is: volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.9a91de16-21e6-4a6d-8c5a-98816c0228ff {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 12:48:11 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ec33f8-0af1-4318-8b58-4eb347d467e8]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:48:11 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d1f8f9e7-73e3-4bdd-8a27-c060e9a56ae1 tempest-SnapshotsActionsTest-758081170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.9a91de16-21e6-4a6d-8c5a-98816c0228ff {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:11 devstack sudo[87924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.9a91de16-21e6-4a6d-8c5a-98816c0228ff
Apr 09 12:48:11 devstack sudo[87924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:11 devstack sudo[87918]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:11 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-27851b33-8a86-4eeb-96b4-aea32a1cc1d2 tempest-VolumesListTestJSON-47761830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e675bb62-b976-40f7-b368-2ee5a0173388 1073741824" returned: 0 in 0.684s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:11 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-27851b33-8a86-4eeb-96b4-aea32a1cc1d2 tempest-VolumesListTestJSON-47761830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e675bb62-b976-40f7-b368-2ee5a0173388 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:11 devstack sudo[87926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e675bb62-b976-40f7-b368-2ee5a0173388
Apr 09 12:48:11 devstack sudo[87926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:11 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c77dc7c-fcdc-4ac1-aafb-d6ea43385626 tempest-VolumesActionsTest-2093358557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:48:11 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-2c77dc7c-fcdc-4ac1-aafb-d6ea43385626 tempest-VolumesActionsTest-2093358557 None] Flow 'volume_create_manager' (d3b8745f-214d-43b5-a1d7-622c242d2272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:48:11 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-2c77dc7c-fcdc-4ac1-aafb-d6ea43385626 tempest-VolumesActionsTest-2093358557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cba2119a-80e2-471b-b448-475ac1c01029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:48:11 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-2c77dc7c-fcdc-4ac1-aafb-d6ea43385626 tempest-VolumesActionsTest-2093358557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cba2119a-80e2-471b-b448-475ac1c01029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:48:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1999641085',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca2d894e-5587-4797-9daa-d4fe29c9414d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c53f5af8ad2b4e288caf33164bd923ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:48:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:48:12Z,use_quota=True,user_id='6fd8d01ce0b640cd87a78a1e289e7c15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:48:11 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-2c77dc7c-fcdc-4ac1-aafb-d6ea43385626 tempest-VolumesActionsTest-2093358557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa7535d5-00a2-4622-90f2-20b4d50a014a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:48:11 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-2c77dc7c-fcdc-4ac1-aafb-d6ea43385626 tempest-VolumesActionsTest-2093358557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa7535d5-00a2-4622-90f2-20b4d50a014a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:48:11 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-2c77dc7c-fcdc-4ac1-aafb-d6ea43385626 tempest-VolumesActionsTest-2093358557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8811ed1-2473-450b-90ef-ce6fcc13917a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:48:11 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-2c77dc7c-fcdc-4ac1-aafb-d6ea43385626 tempest-VolumesActionsTest-2093358557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8811ed1-2473-450b-90ef-ce6fcc13917a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca2d894e-5587-4797-9daa-d4fe29c9414d', 'volume_name': 'volume-ca2d894e-5587-4797-9daa-d4fe29c9414d', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:48:11 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-2c77dc7c-fcdc-4ac1-aafb-d6ea43385626 tempest-VolumesActionsTest-2093358557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (141412c8-7260-49bf-806b-12763bec7a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:48:11 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-2c77dc7c-fcdc-4ac1-aafb-d6ea43385626 tempest-VolumesActionsTest-2093358557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (141412c8-7260-49bf-806b-12763bec7a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:48:11 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-2c77dc7c-fcdc-4ac1-aafb-d6ea43385626 tempest-VolumesActionsTest-2093358557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b336c1c-78cf-4d03-9d55-7693be5b7a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:48:11 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-2c77dc7c-fcdc-4ac1-aafb-d6ea43385626 tempest-VolumesActionsTest-2093358557 None] Volume ca2d894e-5587-4797-9daa-d4fe29c9414d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca2d894e-5587-4797-9daa-d4fe29c9414d', 'volume_size': 1}
Apr 09 12:48:11 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-2c77dc7c-fcdc-4ac1-aafb-d6ea43385626 tempest-VolumesActionsTest-2093358557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:48:12 devstack sudo[87924]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:12 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d1f8f9e7-73e3-4bdd-8a27-c060e9a56ae1 tempest-SnapshotsActionsTest-758081170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.9a91de16-21e6-4a6d-8c5a-98816c0228ff" returned: 0 in 0.585s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:12 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-d1f8f9e7-73e3-4bdd-8a27-c060e9a56ae1 tempest-SnapshotsActionsTest-758081170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1c57785-89aa-474f-9b0a-229da9fff2ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:48:12 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a7607b-d22d-454a-9d41-811d5427ddae]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:48:12 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d1f8f9e7-73e3-4bdd-8a27-c060e9a56ae1 tempest-SnapshotsActionsTest-758081170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:12 devstack sudo[87926]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:12 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-27851b33-8a86-4eeb-96b4-aea32a1cc1d2 tempest-VolumesListTestJSON-47761830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e675bb62-b976-40f7-b368-2ee5a0173388" returned: 0 in 0.451s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:12 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-27851b33-8a86-4eeb-96b4-aea32a1cc1d2 tempest-VolumesListTestJSON-47761830 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:48:12 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-27851b33-8a86-4eeb-96b4-aea32a1cc1d2 tempest-VolumesListTestJSON-47761830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:48:12 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 2.361s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:48:12 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] Cloning volume 2754ab7d-095a-4866-8ed8-0596600a6fc8 to volume 7092806f-102c-4b3e-9f6d-949d9f6be992
Apr 09 12:48:12 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-27851b33-8a86-4eeb-96b4-aea32a1cc1d2 tempest-VolumesListTestJSON-47761830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b12cf1e-13c1-49ee-9510-e88a9ad8e11d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e675bb62-b976-40f7-b368-2ee5a0173388', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:48:12 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-27851b33-8a86-4eeb-96b4-aea32a1cc1d2 tempest-VolumesListTestJSON-47761830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a84396b-2a86-4f5e-a4bf-629b237334d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:48:12 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-27851b33-8a86-4eeb-96b4-aea32a1cc1d2 tempest-VolumesListTestJSON-47761830 None] Volume volume-e675bb62-b976-40f7-b368-2ee5a0173388 (e675bb62-b976-40f7-b368-2ee5a0173388): created successfully
Apr 09 12:48:12 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-27851b33-8a86-4eeb-96b4-aea32a1cc1d2 tempest-VolumesListTestJSON-47761830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a84396b-2a86-4f5e-a4bf-629b237334d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:48:12 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-27851b33-8a86-4eeb-96b4-aea32a1cc1d2 tempest-VolumesListTestJSON-47761830 None] Flow 'volume_create_manager' (fe7f27f8-9ab4-4a66-9678-059eb5628de3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:48:12 devstack sudo[87932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b
Apr 09 12:48:12 devstack sudo[87932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:12 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] Creating offline snapshot 6f700696-4ba7-420f-823f-b636aac6160e of volume 2754ab7d-095a-4866-8ed8-0596600a6fc8 {{(pid=82760) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 12:48:12 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-27851b33-8a86-4eeb-96b4-aea32a1cc1d2 tempest-VolumesListTestJSON-47761830 None] Created volume successfully.
Apr 09 12:48:12 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c877fbe-d5f5-4e1b-8406-16fe528e5230]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:48:12 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:12 devstack sudo[87934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8
Apr 09 12:48:12 devstack sudo[87934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:12 devstack sudo[87932]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:12 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d1f8f9e7-73e3-4bdd-8a27-c060e9a56ae1 tempest-SnapshotsActionsTest-758081170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b" returned: 0 in 0.524s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:12 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-d1f8f9e7-73e3-4bdd-8a27-c060e9a56ae1 tempest-SnapshotsActionsTest-758081170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1c57785-89aa-474f-9b0a-229da9fff2ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:48:12 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d1f8f9e7-73e3-4bdd-8a27-c060e9a56ae1 tempest-SnapshotsActionsTest-758081170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.9a91de16-21e6-4a6d-8c5a-98816c0228ff {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:12 devstack sudo[87940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.9a91de16-21e6-4a6d-8c5a-98816c0228ff
Apr 09 12:48:12 devstack sudo[87940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:12 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad9d28f8-1699-4b30-9184-50845d45924b tempest-VolumesListTestJSON-47761830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:48:12 devstack sudo[87934]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:12 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ad9d28f8-1699-4b30-9184-50845d45924b tempest-VolumesListTestJSON-47761830 None] Flow 'volume_create_manager' (d28c514b-546b-4219-9b8d-222fd2a995ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:48:12 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ad9d28f8-1699-4b30-9184-50845d45924b tempest-VolumesListTestJSON-47761830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbda21fe-da6c-490e-97fa-f737a7ea81d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:48:12 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8" returned: 0 in 0.607s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:12 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8.6f700696-4ba7-420f-823f-b636aac6160e 1G {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:12 devstack sudo[87945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8.6f700696-4ba7-420f-823f-b636aac6160e 1G
Apr 09 12:48:12 devstack sudo[87945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:12 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ad9d28f8-1699-4b30-9184-50845d45924b tempest-VolumesListTestJSON-47761830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbda21fe-da6c-490e-97fa-f737a7ea81d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:48:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-451045821',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd6226d6-e439-4a72-ba59-d17e9172991b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='27f1eed5a19845fea75546a8825250b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:48:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:48:13Z,use_quota=True,user_id='b4dd6d93e0a24ea8998f301c0f42dd17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:48:12 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ad9d28f8-1699-4b30-9184-50845d45924b tempest-VolumesListTestJSON-47761830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a5790de-64e4-43c4-b511-ae3823661606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:48:12 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ad9d28f8-1699-4b30-9184-50845d45924b tempest-VolumesListTestJSON-47761830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a5790de-64e4-43c4-b511-ae3823661606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:48:12 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ad9d28f8-1699-4b30-9184-50845d45924b tempest-VolumesListTestJSON-47761830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0320f5bb-391a-42a7-97ac-8af804c27520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:48:12 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ad9d28f8-1699-4b30-9184-50845d45924b tempest-VolumesListTestJSON-47761830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0320f5bb-391a-42a7-97ac-8af804c27520) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd6226d6-e439-4a72-ba59-d17e9172991b', 'volume_name': 'volume-bd6226d6-e439-4a72-ba59-d17e9172991b', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:48:12 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ad9d28f8-1699-4b30-9184-50845d45924b tempest-VolumesListTestJSON-47761830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c179689-755e-42ef-b843-f038e7cfad16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:48:12 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ad9d28f8-1699-4b30-9184-50845d45924b tempest-VolumesListTestJSON-47761830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c179689-755e-42ef-b843-f038e7cfad16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:48:12 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ad9d28f8-1699-4b30-9184-50845d45924b tempest-VolumesListTestJSON-47761830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cb43f4e-3a22-4f51-9f81-f7f021c37f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:48:12 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-ad9d28f8-1699-4b30-9184-50845d45924b tempest-VolumesListTestJSON-47761830 None] Volume bd6226d6-e439-4a72-ba59-d17e9172991b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd6226d6-e439-4a72-ba59-d17e9172991b', 'volume_size': 1}
Apr 09 12:48:12 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ad9d28f8-1699-4b30-9184-50845d45924b tempest-VolumesListTestJSON-47761830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:48:13 devstack sudo[87940]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:13 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d1f8f9e7-73e3-4bdd-8a27-c060e9a56ae1 tempest-SnapshotsActionsTest-758081170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.9a91de16-21e6-4a6d-8c5a-98816c0228ff" returned: 0 in 0.599s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:13 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d1f8f9e7-73e3-4bdd-8a27-c060e9a56ae1 tempest-SnapshotsActionsTest-758081170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.9a91de16-21e6-4a6d-8c5a-98816c0228ff {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:13 devstack sudo[87953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.9a91de16-21e6-4a6d-8c5a-98816c0228ff
Apr 09 12:48:13 devstack sudo[87953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:13 devstack sudo[87945]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:13 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8.6f700696-4ba7-420f-823f-b636aac6160e 1G" returned: 0 in 0.533s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:13 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2754ab7d-095a-4866-8ed8-0596600a6fc8 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8.6f700696-4ba7-420f-823f-b636aac6160e {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:13 devstack sudo[87955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2754ab7d-095a-4866-8ed8-0596600a6fc8 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8.6f700696-4ba7-420f-823f-b636aac6160e
Apr 09 12:48:13 devstack sudo[87955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:13 devstack sudo[87953]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:13 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d1f8f9e7-73e3-4bdd-8a27-c060e9a56ae1 tempest-SnapshotsActionsTest-758081170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.9a91de16-21e6-4a6d-8c5a-98816c0228ff" returned: 0 in 0.441s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:13 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-d1f8f9e7-73e3-4bdd-8a27-c060e9a56ae1 tempest-SnapshotsActionsTest-758081170 None] Lock "cinder-quobyte-9a91de16-21e6-4a6d-8c5a-98816c0228ff" released by "_delete_snapshot" :: held 2.221s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:48:13 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-d1f8f9e7-73e3-4bdd-8a27-c060e9a56ae1 tempest-SnapshotsActionsTest-758081170 None] Lock "cinder-quobyte-f1c57785-89aa-474f-9b0a-229da9fff2ee" released by "delete_snapshot" :: held 2.238s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:48:13 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-d1f8f9e7-73e3-4bdd-8a27-c060e9a56ae1 tempest-SnapshotsActionsTest-758081170 None] Created reservations ['1886c358-8895-4483-bdc4-f2aadcafa28a', '76cc1a7e-c4ce-4823-8ac0-5860afa0a72e', 'fcecc071-5bf0-4d30-9fde-af180a1d6b98', 'ddd84f4a-be46-4d76-8ef6-7fe267647c3f'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:48:13 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-d1f8f9e7-73e3-4bdd-8a27-c060e9a56ae1 tempest-SnapshotsActionsTest-758081170 None] Delete snapshot completed successfully.
Apr 09 12:48:13 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-d1f8f9e7-73e3-4bdd-8a27-c060e9a56ae1 tempest-SnapshotsActionsTest-758081170 None] Lock "cinder-9a91de16-21e6-4a6d-8c5a-98816c0228ff-delete_snapshot" released by "delete_snapshot" :: held 2.336s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:48:13 devstack sudo[87955]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:13 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2754ab7d-095a-4866-8ed8-0596600a6fc8 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8.6f700696-4ba7-420f-823f-b636aac6160e" returned: 0 in 0.499s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:13 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8.6f700696-4ba7-420f-823f-b636aac6160e is being set with open permissions: ugo+rw
Apr 09 12:48:13 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8.6f700696-4ba7-420f-823f-b636aac6160e {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:13 devstack sudo[87961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8.6f700696-4ba7-420f-823f-b636aac6160e
Apr 09 12:48:13 devstack sudo[87961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:14 devstack sudo[87961]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8.6f700696-4ba7-420f-823f-b636aac6160e" returned: 0 in 0.426s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:14 devstack sudo[87964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8.info
Apr 09 12:48:14 devstack sudo[87964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:14 devstack sudo[87964]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8.info" returned: 0 in 0.463s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:14 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8.info is being set with open permissions: ugo+rw
Apr 09 12:48:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:14 devstack sudo[87967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8.info
Apr 09 12:48:14 devstack sudo[87967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:14 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-544c86bb-0818-4d5a-a491-c020714cb947 tempest-SnapshotsActionsTest-1850511053 None] Acquiring lock "cinder-25dc9abb-fdd9-46fa-946e-01ab2ab92d5b-delete_snapshot" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:48:14 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-544c86bb-0818-4d5a-a491-c020714cb947 tempest-SnapshotsActionsTest-1850511053 None] Lock "cinder-25dc9abb-fdd9-46fa-946e-01ab2ab92d5b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:48:14 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-544c86bb-0818-4d5a-a491-c020714cb947 tempest-SnapshotsActionsTest-1850511053 None] Acquiring lock "cinder-quobyte-f1c57785-89aa-474f-9b0a-229da9fff2ee" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:48:14 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-544c86bb-0818-4d5a-a491-c020714cb947 tempest-SnapshotsActionsTest-1850511053 None] Lock "cinder-quobyte-f1c57785-89aa-474f-9b0a-229da9fff2ee" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:48:14 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-544c86bb-0818-4d5a-a491-c020714cb947 tempest-SnapshotsActionsTest-1850511053 None] Acquiring lock "cinder-quobyte-25dc9abb-fdd9-46fa-946e-01ab2ab92d5b" by "_delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:48:14 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-544c86bb-0818-4d5a-a491-c020714cb947 tempest-SnapshotsActionsTest-1850511053 None] Lock "cinder-quobyte-25dc9abb-fdd9-46fa-946e-01ab2ab92d5b" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:48:14 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-544c86bb-0818-4d5a-a491-c020714cb947 tempest-SnapshotsActionsTest-1850511053 None] Deleting offline snapshot 25dc9abb-fdd9-46fa-946e-01ab2ab92d5b of volume f1c57785-89aa-474f-9b0a-229da9fff2ee {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 12:48:14 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-544c86bb-0818-4d5a-a491-c020714cb947 tempest-SnapshotsActionsTest-1850511053 None] snapshot_file for this snap is: volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 12:48:14 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[5597f288-1a0f-4833-befe-0d010fc030cd]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:48:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-544c86bb-0818-4d5a-a491-c020714cb947 tempest-SnapshotsActionsTest-1850511053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:14 devstack sudo[87969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b
Apr 09 12:48:14 devstack sudo[87969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:15 devstack sudo[87967]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:15 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8.info" returned: 0 in 0.462s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:15 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] Acquiring lock "cinder-quobyte-7092806f-102c-4b3e-9f6d-949d9f6be992" by "_copy_volume_from_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:48:15 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] Lock "cinder-quobyte-7092806f-102c-4b3e-9f6d-949d9f6be992" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:48:15 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] snapshot: 6f700696-4ba7-420f-823f-b636aac6160e, volume: 7092806f-102c-4b3e-9f6d-949d9f6be992,  {{(pid=82760) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 09 12:48:15 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:48:15 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:48:15 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:48:15 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:48:15 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:48:15 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd58f22-72a5-474d-99cd-3856d1b99f24]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:48:15 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8.6f700696-4ba7-420f-823f-b636aac6160e {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:15 devstack sudo[87972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8.6f700696-4ba7-420f-823f-b636aac6160e
Apr 09 12:48:15 devstack sudo[87972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:15 devstack sudo[87969]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:15 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-544c86bb-0818-4d5a-a491-c020714cb947 tempest-SnapshotsActionsTest-1850511053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b" returned: 0 in 0.498s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:15 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-544c86bb-0818-4d5a-a491-c020714cb947 tempest-SnapshotsActionsTest-1850511053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1c57785-89aa-474f-9b0a-229da9fff2ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:48:15 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e2024e-106d-413a-8907-f9bbaf4cd8d3]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:48:15 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-544c86bb-0818-4d5a-a491-c020714cb947 tempest-SnapshotsActionsTest-1850511053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:15 devstack sudo[87977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee
Apr 09 12:48:15 devstack sudo[87977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:15 devstack sudo[87972]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:15 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8.6f700696-4ba7-420f-823f-b636aac6160e" returned: 0 in 0.478s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:15 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2754ab7d-095a-4866-8ed8-0596600a6fc8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:48:15 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8 {{(pid=82760) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 09 12:48:15 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] Creating direct copy from snapshot {{(pid=82760) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 09 12:48:15 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a3c5e1-bc85-45a2-93e9-e8310530a888]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:48:15 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:15 devstack sudo[87982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8
Apr 09 12:48:15 devstack sudo[87982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:15 devstack sudo[87977]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:15 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-544c86bb-0818-4d5a-a491-c020714cb947 tempest-SnapshotsActionsTest-1850511053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee" returned: 0 in 0.543s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:15 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-544c86bb-0818-4d5a-a491-c020714cb947 tempest-SnapshotsActionsTest-1850511053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:15 devstack sudo[87987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b
Apr 09 12:48:15 devstack sudo[87987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:16 devstack sudo[87982]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:16 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8" returned: 0 in 0.528s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:16 devstack cinder-volume[82760]: DEBUG cinder.utils [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] Path /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7092806f-102c-4b3e-9f6d-949d9f6be992 not found in is_blk_device check {{(pid=82760) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 09 12:48:16 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7092806f-102c-4b3e-9f6d-949d9f6be992 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:16 devstack sudo[87992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7092806f-102c-4b3e-9f6d-949d9f6be992
Apr 09 12:48:16 devstack sudo[87992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:16 devstack sudo[87987]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:16 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-544c86bb-0818-4d5a-a491-c020714cb947 tempest-SnapshotsActionsTest-1850511053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b" returned: 0 in 0.466s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:16 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-544c86bb-0818-4d5a-a491-c020714cb947 tempest-SnapshotsActionsTest-1850511053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:16 devstack sudo[87997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b
Apr 09 12:48:16 devstack sudo[87997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:17 devstack sudo[87997]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:17 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-544c86bb-0818-4d5a-a491-c020714cb947 tempest-SnapshotsActionsTest-1850511053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee.25dc9abb-fdd9-46fa-946e-01ab2ab92d5b" returned: 0 in 0.754s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:17 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-544c86bb-0818-4d5a-a491-c020714cb947 tempest-SnapshotsActionsTest-1850511053 None] Lock "cinder-quobyte-25dc9abb-fdd9-46fa-946e-01ab2ab92d5b" released by "_delete_snapshot" :: held 2.350s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:48:17 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-544c86bb-0818-4d5a-a491-c020714cb947 tempest-SnapshotsActionsTest-1850511053 None] Lock "cinder-quobyte-f1c57785-89aa-474f-9b0a-229da9fff2ee" released by "delete_snapshot" :: held 2.363s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:48:17 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-544c86bb-0818-4d5a-a491-c020714cb947 tempest-SnapshotsActionsTest-1850511053 None] Created reservations ['83149f9f-8b80-4a52-8ff5-980cf79461c9', '18839b1a-6066-491e-b0b9-4e191b487556', 'c5a89615-bd8c-44bc-9b2c-47dd96fe3c8f', '16936475-9b74-4df7-b8ab-7a35cb7440e6'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:48:17 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-544c86bb-0818-4d5a-a491-c020714cb947 tempest-SnapshotsActionsTest-1850511053 None] Delete snapshot completed successfully.
Apr 09 12:48:17 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-544c86bb-0818-4d5a-a491-c020714cb947 tempest-SnapshotsActionsTest-1850511053 None] Lock "cinder-25dc9abb-fdd9-46fa-946e-01ab2ab92d5b-delete_snapshot" released by "delete_snapshot" :: held 2.601s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:48:18 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-17f36aca-86c9-4657-9772-efaa93895643 tempest-SnapshotsActionsTest-1850511053 None] Acquiring lock "cinder-f1c57785-89aa-474f-9b0a-229da9fff2ee-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:48:18 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-17f36aca-86c9-4657-9772-efaa93895643 tempest-SnapshotsActionsTest-1850511053 None] Lock "cinder-f1c57785-89aa-474f-9b0a-229da9fff2ee-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:48:18 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-17f36aca-86c9-4657-9772-efaa93895643 tempest-SnapshotsActionsTest-1850511053 None] Acquiring lock "cinder-quobyte-f1c57785-89aa-474f-9b0a-229da9fff2ee" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:48:18 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-17f36aca-86c9-4657-9772-efaa93895643 tempest-SnapshotsActionsTest-1850511053 None] Lock "cinder-quobyte-f1c57785-89aa-474f-9b0a-229da9fff2ee" acquired by "delete_volume" :: waited 0.014s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:48:18 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2972e6-0708-497b-97d2-a95c95ac391e]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:48:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-17f36aca-86c9-4657-9772-efaa93895643 tempest-SnapshotsActionsTest-1850511053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:18 devstack sudo[87992]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7092806f-102c-4b3e-9f6d-949d9f6be992" returned: 0 in 2.271s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:18 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d13788-d6a8-4b95-90b5-e82389fa6780]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:48:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:18 devstack sudo[88010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee
Apr 09 12:48:18 devstack sudo[88010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:18 devstack sudo[88011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8
Apr 09 12:48:18 devstack sudo[88011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:18 devstack sudo[88010]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-17f36aca-86c9-4657-9772-efaa93895643 tempest-SnapshotsActionsTest-1850511053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee" returned: 0 in 0.461s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-17f36aca-86c9-4657-9772-efaa93895643 tempest-SnapshotsActionsTest-1850511053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:18 devstack sudo[88019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee
Apr 09 12:48:18 devstack sudo[88019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:19 devstack sudo[88011]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8" returned: 0 in 0.632s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:19 devstack cinder-volume[82760]: DEBUG cinder.image.image_utils [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] Image conversion details: src /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8, size 1024.00 MB, duration 2.27 sec, destination /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7092806f-102c-4b3e-9f6d-949d9f6be992 {{(pid=82760) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 12:48:19 devstack cinder-volume[82760]: INFO cinder.image.image_utils [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] Converted 1024.00 MB image at 450.65 MB/s
Apr 09 12:48:19 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7092806f-102c-4b3e-9f6d-949d9f6be992 is being set with open permissions: ugo+rw
Apr 09 12:48:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7092806f-102c-4b3e-9f6d-949d9f6be992 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:19 devstack sudo[88022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7092806f-102c-4b3e-9f6d-949d9f6be992
Apr 09 12:48:19 devstack sudo[88022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:19 devstack sudo[88019]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-17f36aca-86c9-4657-9772-efaa93895643 tempest-SnapshotsActionsTest-1850511053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f1c57785-89aa-474f-9b0a-229da9fff2ee" returned: 0 in 0.457s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:19 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-17f36aca-86c9-4657-9772-efaa93895643 tempest-SnapshotsActionsTest-1850511053 None] Lock "cinder-quobyte-f1c57785-89aa-474f-9b0a-229da9fff2ee" released by "delete_volume" :: held 0.950s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:48:19 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-17f36aca-86c9-4657-9772-efaa93895643 tempest-SnapshotsActionsTest-1850511053 None] Created reservations ['435ca7a5-200a-45cd-bf8b-4fb4aa157238', '0c6b8b0f-0206-4194-b1fb-3d5f42956f14', '868439e9-373c-4e48-93b6-be4958023c76', 'c9f367af-30e7-46ab-b7bd-daff909ab413'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:48:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-17f36aca-86c9-4657-9772-efaa93895643 tempest-SnapshotsActionsTest-1850511053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:48:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-17f36aca-86c9-4657-9772-efaa93895643 tempest-SnapshotsActionsTest-1850511053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:48:19 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-17f36aca-86c9-4657-9772-efaa93895643 tempest-SnapshotsActionsTest-1850511053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:48:19 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-17f36aca-86c9-4657-9772-efaa93895643 tempest-SnapshotsActionsTest-1850511053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:48:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-17f36aca-86c9-4657-9772-efaa93895643 tempest-SnapshotsActionsTest-1850511053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:48:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-17f36aca-86c9-4657-9772-efaa93895643 tempest-SnapshotsActionsTest-1850511053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:19 devstack sudo[88025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:48:19 devstack sudo[88025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:19 devstack sudo[88022]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7092806f-102c-4b3e-9f6d-949d9f6be992" returned: 0 in 0.467s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:19 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] Lock "cinder-quobyte-7092806f-102c-4b3e-9f6d-949d9f6be992" released by "_copy_volume_from_snapshot" :: held 4.431s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:48:19 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] Acquiring lock "cinder-quobyte-6f700696-4ba7-420f-823f-b636aac6160e" by "_delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:48:19 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] Lock "cinder-quobyte-6f700696-4ba7-420f-823f-b636aac6160e" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:48:19 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] Deleting offline snapshot 6f700696-4ba7-420f-823f-b636aac6160e of volume 2754ab7d-095a-4866-8ed8-0596600a6fc8 {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 12:48:19 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] snapshot_file for this snap is: volume-2754ab7d-095a-4866-8ed8-0596600a6fc8.6f700696-4ba7-420f-823f-b636aac6160e {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 12:48:19 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f387e0-efc8-4bd0-9aa5-e35fe4d16415]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:48:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8.6f700696-4ba7-420f-823f-b636aac6160e {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:19 devstack sudo[88028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8.6f700696-4ba7-420f-823f-b636aac6160e
Apr 09 12:48:19 devstack sudo[88028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:19 devstack sudo[88025]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-17f36aca-86c9-4657-9772-efaa93895643 tempest-SnapshotsActionsTest-1850511053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.472s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:19 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-17f36aca-86c9-4657-9772-efaa93895643 tempest-SnapshotsActionsTest-1850511053 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:48:19 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-17f36aca-86c9-4657-9772-efaa93895643 tempest-SnapshotsActionsTest-1850511053 None] Deleted volume successfully.
Apr 09 12:48:19 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-17f36aca-86c9-4657-9772-efaa93895643 tempest-SnapshotsActionsTest-1850511053 None] Lock "cinder-f1c57785-89aa-474f-9b0a-229da9fff2ee-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:48:20 devstack sudo[88028]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:20 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8.6f700696-4ba7-420f-823f-b636aac6160e" returned: 0 in 0.589s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:20 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2754ab7d-095a-4866-8ed8-0596600a6fc8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:48:20 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b90abd5-ce88-450c-9e2e-c063477b11c5]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:48:20 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:20 devstack sudo[88034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8
Apr 09 12:48:20 devstack sudo[88034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:20 devstack sudo[88034]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:20 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8" returned: 0 in 0.540s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:20 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8.6f700696-4ba7-420f-823f-b636aac6160e {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:20 devstack sudo[88039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8.6f700696-4ba7-420f-823f-b636aac6160e
Apr 09 12:48:20 devstack sudo[88039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:21 devstack sudo[88039]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:21 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8.6f700696-4ba7-420f-823f-b636aac6160e" returned: 0 in 0.527s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:21 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8.6f700696-4ba7-420f-823f-b636aac6160e {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:21 devstack sudo[88044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8.6f700696-4ba7-420f-823f-b636aac6160e
Apr 09 12:48:21 devstack sudo[88044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:21 devstack sudo[88044]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:21 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8.6f700696-4ba7-420f-823f-b636aac6160e" returned: 0 in 0.458s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:21 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] Lock "cinder-quobyte-6f700696-4ba7-420f-823f-b636aac6160e" released by "_delete_snapshot" :: held 2.183s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:48:21 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.753s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:48:21 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-2c77dc7c-fcdc-4ac1-aafb-d6ea43385626 tempest-VolumesActionsTest-2093358557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.098s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:48:21 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-2c77dc7c-fcdc-4ac1-aafb-d6ea43385626 tempest-VolumesActionsTest-2093358557 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:48:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1999641085',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca2d894e-5587-4797-9daa-d4fe29c9414d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c53f5af8ad2b4e288caf33164bd923ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:48:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:48:12Z,use_quota=True,user_id='6fd8d01ce0b640cd87a78a1e289e7c15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:48:21 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-2c77dc7c-fcdc-4ac1-aafb-d6ea43385626 tempest-VolumesActionsTest-2093358557 None] Creating volume ca2d894e-5587-4797-9daa-d4fe29c9414d {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:48:21 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-2c77dc7c-fcdc-4ac1-aafb-d6ea43385626 tempest-VolumesActionsTest-2093358557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:48:21 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-2c77dc7c-fcdc-4ac1-aafb-d6ea43385626 tempest-VolumesActionsTest-2093358557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:48:21 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-2c77dc7c-fcdc-4ac1-aafb-d6ea43385626 tempest-VolumesActionsTest-2093358557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:48:21 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-2c77dc7c-fcdc-4ac1-aafb-d6ea43385626 tempest-VolumesActionsTest-2093358557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:48:21 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-2c77dc7c-fcdc-4ac1-aafb-d6ea43385626 tempest-VolumesActionsTest-2093358557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:48:21 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-2c77dc7c-fcdc-4ac1-aafb-d6ea43385626 tempest-VolumesActionsTest-2093358557 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:48:21 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-2c77dc7c-fcdc-4ac1-aafb-d6ea43385626 tempest-VolumesActionsTest-2093358557 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:48:21 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2c77dc7c-fcdc-4ac1-aafb-d6ea43385626 tempest-VolumesActionsTest-2093358557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ca2d894e-5587-4797-9daa-d4fe29c9414d 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:21 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcba319d-4752-4e87-b2ca-fccde998d939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7092806f-102c-4b3e-9f6d-949d9f6be992', 'volume_size': 1, 'source_volid': '2754ab7d-095a-4866-8ed8-0596600a6fc8', 'source_volstatus': 'available'}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:48:21 devstack sudo[88051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ca2d894e-5587-4797-9daa-d4fe29c9414d 1073741824
Apr 09 12:48:21 devstack sudo[88051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:21 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c327a70-60cd-43ce-8eeb-21f9dc1d12fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:48:21 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] Volume volume-7092806f-102c-4b3e-9f6d-949d9f6be992 (7092806f-102c-4b3e-9f6d-949d9f6be992): created successfully
Apr 09 12:48:21 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c327a70-60cd-43ce-8eeb-21f9dc1d12fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:48:21 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] Flow 'volume_create_manager' (1f87aa6b-e0f2-4087-ad1c-4a6b507b9d82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:48:21 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-02c69766-a7f2-4b9d-a802-e24c2562e057 tempest-VolumeDependencyTests-476558810 None] Created volume successfully.
Apr 09 12:48:22 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ea33c03e-e775-41d2-8702-f47cba4f451d tempest-VolumeDependencyTests-476558810 None] Acquiring lock "cinder-2754ab7d-095a-4866-8ed8-0596600a6fc8-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:48:22 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ea33c03e-e775-41d2-8702-f47cba4f451d tempest-VolumeDependencyTests-476558810 None] Lock "cinder-2754ab7d-095a-4866-8ed8-0596600a6fc8-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:48:22 devstack sudo[88051]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:22 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2c77dc7c-fcdc-4ac1-aafb-d6ea43385626 tempest-VolumesActionsTest-2093358557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ca2d894e-5587-4797-9daa-d4fe29c9414d 1073741824" returned: 0 in 0.656s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:22 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ea33c03e-e775-41d2-8702-f47cba4f451d tempest-VolumeDependencyTests-476558810 None] Acquiring lock "cinder-quobyte-2754ab7d-095a-4866-8ed8-0596600a6fc8" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:48:22 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ea33c03e-e775-41d2-8702-f47cba4f451d tempest-VolumeDependencyTests-476558810 None] Lock "cinder-quobyte-2754ab7d-095a-4866-8ed8-0596600a6fc8" acquired by "delete_volume" :: waited 0.012s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:48:22 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5032711-2a11-4cb4-b83a-2734305a7aa0]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:48:22 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ea33c03e-e775-41d2-8702-f47cba4f451d tempest-VolumeDependencyTests-476558810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:22 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2c77dc7c-fcdc-4ac1-aafb-d6ea43385626 tempest-VolumesActionsTest-2093358557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ca2d894e-5587-4797-9daa-d4fe29c9414d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:22 devstack sudo[88058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ca2d894e-5587-4797-9daa-d4fe29c9414d
Apr 09 12:48:22 devstack sudo[88058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:22 devstack sudo[88057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8
Apr 09 12:48:22 devstack sudo[88057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:23 devstack sudo[88058]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2c77dc7c-fcdc-4ac1-aafb-d6ea43385626 tempest-VolumesActionsTest-2093358557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ca2d894e-5587-4797-9daa-d4fe29c9414d" returned: 0 in 0.451s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:23 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-2c77dc7c-fcdc-4ac1-aafb-d6ea43385626 tempest-VolumesActionsTest-2093358557 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:48:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-2c77dc7c-fcdc-4ac1-aafb-d6ea43385626 tempest-VolumesActionsTest-2093358557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:48:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ad9d28f8-1699-4b30-9184-50845d45924b tempest-VolumesListTestJSON-47761830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.205s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:48:23 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-ad9d28f8-1699-4b30-9184-50845d45924b tempest-VolumesListTestJSON-47761830 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:48:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-451045821',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd6226d6-e439-4a72-ba59-d17e9172991b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='27f1eed5a19845fea75546a8825250b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:48:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:48:13Z,use_quota=True,user_id='b4dd6d93e0a24ea8998f301c0f42dd17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:48:23 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-ad9d28f8-1699-4b30-9184-50845d45924b tempest-VolumesListTestJSON-47761830 None] Creating volume bd6226d6-e439-4a72-ba59-d17e9172991b {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:48:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ad9d28f8-1699-4b30-9184-50845d45924b tempest-VolumesListTestJSON-47761830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:48:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ad9d28f8-1699-4b30-9184-50845d45924b tempest-VolumesListTestJSON-47761830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:48:23 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-ad9d28f8-1699-4b30-9184-50845d45924b tempest-VolumesListTestJSON-47761830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:48:23 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-ad9d28f8-1699-4b30-9184-50845d45924b tempest-VolumesListTestJSON-47761830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:48:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ad9d28f8-1699-4b30-9184-50845d45924b tempest-VolumesListTestJSON-47761830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:48:23 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-ad9d28f8-1699-4b30-9184-50845d45924b tempest-VolumesListTestJSON-47761830 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:48:23 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-ad9d28f8-1699-4b30-9184-50845d45924b tempest-VolumesListTestJSON-47761830 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:48:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ad9d28f8-1699-4b30-9184-50845d45924b tempest-VolumesListTestJSON-47761830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bd6226d6-e439-4a72-ba59-d17e9172991b 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:23 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-2c77dc7c-fcdc-4ac1-aafb-d6ea43385626 tempest-VolumesActionsTest-2093358557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b336c1c-78cf-4d03-9d55-7693be5b7a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca2d894e-5587-4797-9daa-d4fe29c9414d', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:48:23 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-2c77dc7c-fcdc-4ac1-aafb-d6ea43385626 tempest-VolumesActionsTest-2093358557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b1e2215-bbd7-4000-818c-bf2653182f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:48:23 devstack sudo[88071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bd6226d6-e439-4a72-ba59-d17e9172991b 1073741824
Apr 09 12:48:23 devstack sudo[88071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:23 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-2c77dc7c-fcdc-4ac1-aafb-d6ea43385626 tempest-VolumesActionsTest-2093358557 None] Volume volume-ca2d894e-5587-4797-9daa-d4fe29c9414d (ca2d894e-5587-4797-9daa-d4fe29c9414d): created successfully
Apr 09 12:48:23 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-2c77dc7c-fcdc-4ac1-aafb-d6ea43385626 tempest-VolumesActionsTest-2093358557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b1e2215-bbd7-4000-818c-bf2653182f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:48:23 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-2c77dc7c-fcdc-4ac1-aafb-d6ea43385626 tempest-VolumesActionsTest-2093358557 None] Flow 'volume_create_manager' (d3b8745f-214d-43b5-a1d7-622c242d2272) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:48:23 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-2c77dc7c-fcdc-4ac1-aafb-d6ea43385626 tempest-VolumesActionsTest-2093358557 None] Created volume successfully.
Apr 09 12:48:23 devstack sudo[88057]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ea33c03e-e775-41d2-8702-f47cba4f451d tempest-VolumeDependencyTests-476558810 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8" returned: 0 in 0.570s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ea33c03e-e775-41d2-8702-f47cba4f451d tempest-VolumeDependencyTests-476558810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:23 devstack sudo[88073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8
Apr 09 12:48:23 devstack sudo[88073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:23 devstack sudo[88071]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ad9d28f8-1699-4b30-9184-50845d45924b tempest-VolumesListTestJSON-47761830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bd6226d6-e439-4a72-ba59-d17e9172991b 1073741824" returned: 0 in 0.617s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:23 devstack sudo[88073]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ea33c03e-e775-41d2-8702-f47cba4f451d tempest-VolumeDependencyTests-476558810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2754ab7d-095a-4866-8ed8-0596600a6fc8" returned: 0 in 0.543s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:23 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ea33c03e-e775-41d2-8702-f47cba4f451d tempest-VolumeDependencyTests-476558810 None] Lock "cinder-quobyte-2754ab7d-095a-4866-8ed8-0596600a6fc8" released by "delete_volume" :: held 1.159s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:48:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ad9d28f8-1699-4b30-9184-50845d45924b tempest-VolumesListTestJSON-47761830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bd6226d6-e439-4a72-ba59-d17e9172991b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:23 devstack sudo[88079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bd6226d6-e439-4a72-ba59-d17e9172991b
Apr 09 12:48:23 devstack sudo[88079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:23 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-ea33c03e-e775-41d2-8702-f47cba4f451d tempest-VolumeDependencyTests-476558810 None] Created reservations ['9f3bbd50-6354-48b4-b082-a89ce96814b0', 'ac1ed07a-439f-40af-934d-f399a519134e', '3bd7b57c-2f6b-4fc4-a606-1954a9ecbc8e', '49c4b50d-b487-4cc8-8a21-b131b4088957'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:48:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ea33c03e-e775-41d2-8702-f47cba4f451d tempest-VolumeDependencyTests-476558810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:48:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ea33c03e-e775-41d2-8702-f47cba4f451d tempest-VolumeDependencyTests-476558810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:48:23 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-ea33c03e-e775-41d2-8702-f47cba4f451d tempest-VolumeDependencyTests-476558810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:48:23 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-ea33c03e-e775-41d2-8702-f47cba4f451d tempest-VolumeDependencyTests-476558810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:48:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ea33c03e-e775-41d2-8702-f47cba4f451d tempest-VolumeDependencyTests-476558810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:48:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ea33c03e-e775-41d2-8702-f47cba4f451d tempest-VolumeDependencyTests-476558810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:23 devstack sudo[88081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:48:23 devstack sudo[88081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:24 devstack sudo[88079]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ad9d28f8-1699-4b30-9184-50845d45924b tempest-VolumesListTestJSON-47761830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bd6226d6-e439-4a72-ba59-d17e9172991b" returned: 0 in 0.504s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:24 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-ad9d28f8-1699-4b30-9184-50845d45924b tempest-VolumesListTestJSON-47761830 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:48:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ad9d28f8-1699-4b30-9184-50845d45924b tempest-VolumesListTestJSON-47761830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:48:24 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ad9d28f8-1699-4b30-9184-50845d45924b tempest-VolumesListTestJSON-47761830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cb43f4e-3a22-4f51-9f81-f7f021c37f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd6226d6-e439-4a72-ba59-d17e9172991b', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:48:24 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ad9d28f8-1699-4b30-9184-50845d45924b tempest-VolumesListTestJSON-47761830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ef80635-713a-497c-9095-0f8533b4dbeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:48:24 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-ad9d28f8-1699-4b30-9184-50845d45924b tempest-VolumesListTestJSON-47761830 None] Volume volume-bd6226d6-e439-4a72-ba59-d17e9172991b (bd6226d6-e439-4a72-ba59-d17e9172991b): created successfully
Apr 09 12:48:24 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ad9d28f8-1699-4b30-9184-50845d45924b tempest-VolumesListTestJSON-47761830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ef80635-713a-497c-9095-0f8533b4dbeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:48:24 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-ad9d28f8-1699-4b30-9184-50845d45924b tempest-VolumesListTestJSON-47761830 None] Flow 'volume_create_manager' (d28c514b-546b-4219-9b8d-222fd2a995ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:48:24 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-ad9d28f8-1699-4b30-9184-50845d45924b tempest-VolumesListTestJSON-47761830 None] Created volume successfully.
Apr 09 12:48:24 devstack sudo[88081]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ea33c03e-e775-41d2-8702-f47cba4f451d tempest-VolumeDependencyTests-476558810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.590s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:24 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-ea33c03e-e775-41d2-8702-f47cba4f451d tempest-VolumeDependencyTests-476558810 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:48:24 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-ea33c03e-e775-41d2-8702-f47cba4f451d tempest-VolumeDependencyTests-476558810 None] Deleted volume successfully.
Apr 09 12:48:24 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ea33c03e-e775-41d2-8702-f47cba4f451d tempest-VolumeDependencyTests-476558810 None] Lock "cinder-2754ab7d-095a-4866-8ed8-0596600a6fc8-delete_volume" released by "delete_volume" :: held 2.018s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:48:24 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-30111298-7ed0-4426-ad34-e49fb1017ebc tempest-VolumeDependencyTests-476558810 None] Acquiring lock "cinder-7092806f-102c-4b3e-9f6d-949d9f6be992-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:48:24 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-30111298-7ed0-4426-ad34-e49fb1017ebc tempest-VolumeDependencyTests-476558810 None] Lock "cinder-7092806f-102c-4b3e-9f6d-949d9f6be992-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:48:24 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-30111298-7ed0-4426-ad34-e49fb1017ebc tempest-VolumeDependencyTests-476558810 None] Acquiring lock "cinder-quobyte-7092806f-102c-4b3e-9f6d-949d9f6be992" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:48:24 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-30111298-7ed0-4426-ad34-e49fb1017ebc tempest-VolumeDependencyTests-476558810 None] Lock "cinder-quobyte-7092806f-102c-4b3e-9f6d-949d9f6be992" acquired by "delete_volume" :: waited 0.009s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:48:24 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da3ae72-a10a-40f2-95d6-13594c6a30d2]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:48:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-30111298-7ed0-4426-ad34-e49fb1017ebc tempest-VolumeDependencyTests-476558810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7092806f-102c-4b3e-9f6d-949d9f6be992 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:24 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1212645-4ec2-4638-adc1-17fb5aa1d386 tempest-VolumesListTestJSON-47761830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:48:24 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b1212645-4ec2-4638-adc1-17fb5aa1d386 tempest-VolumesListTestJSON-47761830 None] Flow 'volume_create_manager' (b4fb9715-a309-480b-a6b7-cb5f497d3849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:48:24 devstack sudo[88088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7092806f-102c-4b3e-9f6d-949d9f6be992
Apr 09 12:48:24 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b1212645-4ec2-4638-adc1-17fb5aa1d386 tempest-VolumesListTestJSON-47761830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd545ff2-05f0-45ad-9cc5-d7f9d4c05ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:48:24 devstack sudo[88088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:24 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b1212645-4ec2-4638-adc1-17fb5aa1d386 tempest-VolumesListTestJSON-47761830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd545ff2-05f0-45ad-9cc5-d7f9d4c05ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:48:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1482539127',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e6baaa8-bdd9-44df-9701-b4f0f8da4f7e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='27f1eed5a19845fea75546a8825250b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:48:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:48:25Z,use_quota=True,user_id='b4dd6d93e0a24ea8998f301c0f42dd17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:48:24 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b1212645-4ec2-4638-adc1-17fb5aa1d386 tempest-VolumesListTestJSON-47761830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9781fe1-fa22-4ab5-8910-9de4f559cf7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:48:24 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b1212645-4ec2-4638-adc1-17fb5aa1d386 tempest-VolumesListTestJSON-47761830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9781fe1-fa22-4ab5-8910-9de4f559cf7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:48:24 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b1212645-4ec2-4638-adc1-17fb5aa1d386 tempest-VolumesListTestJSON-47761830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb22742b-25ba-4886-b5ce-ec20b9205660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:48:24 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b1212645-4ec2-4638-adc1-17fb5aa1d386 tempest-VolumesListTestJSON-47761830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb22742b-25ba-4886-b5ce-ec20b9205660) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e6baaa8-bdd9-44df-9701-b4f0f8da4f7e', 'volume_name': 'volume-3e6baaa8-bdd9-44df-9701-b4f0f8da4f7e', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:48:24 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b1212645-4ec2-4638-adc1-17fb5aa1d386 tempest-VolumesListTestJSON-47761830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04be43f0-069f-4a76-ab3e-598a22af5480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:48:24 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b1212645-4ec2-4638-adc1-17fb5aa1d386 tempest-VolumesListTestJSON-47761830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04be43f0-069f-4a76-ab3e-598a22af5480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:48:24 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b1212645-4ec2-4638-adc1-17fb5aa1d386 tempest-VolumesListTestJSON-47761830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40fe4fe2-357c-4c4c-b4f8-e6db40381354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:48:24 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-b1212645-4ec2-4638-adc1-17fb5aa1d386 tempest-VolumesListTestJSON-47761830 None] Volume 3e6baaa8-bdd9-44df-9701-b4f0f8da4f7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e6baaa8-bdd9-44df-9701-b4f0f8da4f7e', 'volume_size': 1}
Apr 09 12:48:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b1212645-4ec2-4638-adc1-17fb5aa1d386 tempest-VolumesListTestJSON-47761830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:48:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b1212645-4ec2-4638-adc1-17fb5aa1d386 tempest-VolumesListTestJSON-47761830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:48:24 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-b1212645-4ec2-4638-adc1-17fb5aa1d386 tempest-VolumesListTestJSON-47761830 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:48:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1482539127',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e6baaa8-bdd9-44df-9701-b4f0f8da4f7e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='27f1eed5a19845fea75546a8825250b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:48:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:48:25Z,use_quota=True,user_id='b4dd6d93e0a24ea8998f301c0f42dd17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:48:24 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-b1212645-4ec2-4638-adc1-17fb5aa1d386 tempest-VolumesListTestJSON-47761830 None] Creating volume 3e6baaa8-bdd9-44df-9701-b4f0f8da4f7e {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:48:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b1212645-4ec2-4638-adc1-17fb5aa1d386 tempest-VolumesListTestJSON-47761830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:48:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b1212645-4ec2-4638-adc1-17fb5aa1d386 tempest-VolumesListTestJSON-47761830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:48:24 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-b1212645-4ec2-4638-adc1-17fb5aa1d386 tempest-VolumesListTestJSON-47761830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:48:24 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-b1212645-4ec2-4638-adc1-17fb5aa1d386 tempest-VolumesListTestJSON-47761830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:48:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b1212645-4ec2-4638-adc1-17fb5aa1d386 tempest-VolumesListTestJSON-47761830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:48:24 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-b1212645-4ec2-4638-adc1-17fb5aa1d386 tempest-VolumesListTestJSON-47761830 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:48:24 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-b1212645-4ec2-4638-adc1-17fb5aa1d386 tempest-VolumesListTestJSON-47761830 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:48:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b1212645-4ec2-4638-adc1-17fb5aa1d386 tempest-VolumesListTestJSON-47761830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3e6baaa8-bdd9-44df-9701-b4f0f8da4f7e 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:24 devstack sudo[88090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3e6baaa8-bdd9-44df-9701-b4f0f8da4f7e 1073741824
Apr 09 12:48:24 devstack sudo[88090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:25 devstack sudo[88088]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-30111298-7ed0-4426-ad34-e49fb1017ebc tempest-VolumeDependencyTests-476558810 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7092806f-102c-4b3e-9f6d-949d9f6be992" returned: 0 in 0.613s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-30111298-7ed0-4426-ad34-e49fb1017ebc tempest-VolumeDependencyTests-476558810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7092806f-102c-4b3e-9f6d-949d9f6be992 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:25 devstack sudo[88098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7092806f-102c-4b3e-9f6d-949d9f6be992
Apr 09 12:48:25 devstack sudo[88098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:25 devstack sudo[88090]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b1212645-4ec2-4638-adc1-17fb5aa1d386 tempest-VolumesListTestJSON-47761830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3e6baaa8-bdd9-44df-9701-b4f0f8da4f7e 1073741824" returned: 0 in 0.635s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b1212645-4ec2-4638-adc1-17fb5aa1d386 tempest-VolumesListTestJSON-47761830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3e6baaa8-bdd9-44df-9701-b4f0f8da4f7e {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:25 devstack sudo[88100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3e6baaa8-bdd9-44df-9701-b4f0f8da4f7e
Apr 09 12:48:25 devstack sudo[88100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:25 devstack sudo[88098]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-30111298-7ed0-4426-ad34-e49fb1017ebc tempest-VolumeDependencyTests-476558810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7092806f-102c-4b3e-9f6d-949d9f6be992" returned: 0 in 0.587s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:26 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-30111298-7ed0-4426-ad34-e49fb1017ebc tempest-VolumeDependencyTests-476558810 None] Lock "cinder-quobyte-7092806f-102c-4b3e-9f6d-949d9f6be992" released by "delete_volume" :: held 1.237s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:48:26 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-30111298-7ed0-4426-ad34-e49fb1017ebc tempest-VolumeDependencyTests-476558810 None] Created reservations ['7a614843-b3b8-4dfe-ba0d-0b074957b7a9', '649c0ed0-0fad-4e57-9865-c909bddf1496', 'fd791df3-50d5-4790-aa4f-ffa0c594541b', 'c719161b-b94c-4608-adc0-dce15628ec21'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:48:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-30111298-7ed0-4426-ad34-e49fb1017ebc tempest-VolumeDependencyTests-476558810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:48:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-30111298-7ed0-4426-ad34-e49fb1017ebc tempest-VolumeDependencyTests-476558810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:48:26 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-30111298-7ed0-4426-ad34-e49fb1017ebc tempest-VolumeDependencyTests-476558810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:48:26 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-30111298-7ed0-4426-ad34-e49fb1017ebc tempest-VolumeDependencyTests-476558810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:48:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-30111298-7ed0-4426-ad34-e49fb1017ebc tempest-VolumeDependencyTests-476558810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:48:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-30111298-7ed0-4426-ad34-e49fb1017ebc tempest-VolumeDependencyTests-476558810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:26 devstack sudo[88105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:48:26 devstack sudo[88105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:26 devstack sudo[88100]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b1212645-4ec2-4638-adc1-17fb5aa1d386 tempest-VolumesListTestJSON-47761830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3e6baaa8-bdd9-44df-9701-b4f0f8da4f7e" returned: 0 in 0.533s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:26 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-b1212645-4ec2-4638-adc1-17fb5aa1d386 tempest-VolumesListTestJSON-47761830 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:48:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b1212645-4ec2-4638-adc1-17fb5aa1d386 tempest-VolumesListTestJSON-47761830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:48:26 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b1212645-4ec2-4638-adc1-17fb5aa1d386 tempest-VolumesListTestJSON-47761830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40fe4fe2-357c-4c4c-b4f8-e6db40381354) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e6baaa8-bdd9-44df-9701-b4f0f8da4f7e', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:48:26 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b1212645-4ec2-4638-adc1-17fb5aa1d386 tempest-VolumesListTestJSON-47761830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a00d34d-9063-43ee-8359-7114f1f699bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:48:26 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-b1212645-4ec2-4638-adc1-17fb5aa1d386 tempest-VolumesListTestJSON-47761830 None] Volume volume-3e6baaa8-bdd9-44df-9701-b4f0f8da4f7e (3e6baaa8-bdd9-44df-9701-b4f0f8da4f7e): created successfully
Apr 09 12:48:26 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b1212645-4ec2-4638-adc1-17fb5aa1d386 tempest-VolumesListTestJSON-47761830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a00d34d-9063-43ee-8359-7114f1f699bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:48:26 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b1212645-4ec2-4638-adc1-17fb5aa1d386 tempest-VolumesListTestJSON-47761830 None] Flow 'volume_create_manager' (b4fb9715-a309-480b-a6b7-cb5f497d3849) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:48:26 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-b1212645-4ec2-4638-adc1-17fb5aa1d386 tempest-VolumesListTestJSON-47761830 None] Created volume successfully.
Apr 09 12:48:26 devstack sudo[88105]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-30111298-7ed0-4426-ad34-e49fb1017ebc tempest-VolumeDependencyTests-476558810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.503s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:26 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-30111298-7ed0-4426-ad34-e49fb1017ebc tempest-VolumeDependencyTests-476558810 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:48:26 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-30111298-7ed0-4426-ad34-e49fb1017ebc tempest-VolumeDependencyTests-476558810 None] Deleted volume successfully.
Apr 09 12:48:26 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-30111298-7ed0-4426-ad34-e49fb1017ebc tempest-VolumeDependencyTests-476558810 None] Lock "cinder-7092806f-102c-4b3e-9f6d-949d9f6be992-delete_volume" released by "delete_volume" :: held 1.887s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:48:26 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c3cd8ca-073c-4594-b1ec-7a4f7d656bee tempest-VolumeTypesAccessTest-975729668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:48:26 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4c3cd8ca-073c-4594-b1ec-7a4f7d656bee tempest-VolumeTypesAccessTest-975729668 None] Flow 'volume_create_manager' (cb5d3a7c-4f10-4166-932b-e0993a50d2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:48:26 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4c3cd8ca-073c-4594-b1ec-7a4f7d656bee tempest-VolumeTypesAccessTest-975729668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11d6373c-868b-4f2e-8b2d-4ef052beb21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:48:26 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4c3cd8ca-073c-4594-b1ec-7a4f7d656bee tempest-VolumeTypesAccessTest-975729668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11d6373c-868b-4f2e-8b2d-4ef052beb21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:48:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1303074771',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6931fd52-4922-4f0b-95a0-74fa6b6c00bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='562b87eeca8d4cd49b61082c5640450b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:48:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:48:27Z,use_quota=True,user_id='74694ee08e39466892b9352344653687',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f9d5bf69-5bd6-4e2c-8b9d-1007f69503a4),volume_type_id=f9d5bf69-5bd6-4e2c-8b9d-1007f69503a4)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:48:26 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4c3cd8ca-073c-4594-b1ec-7a4f7d656bee tempest-VolumeTypesAccessTest-975729668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e5ee63c-0021-40b3-8094-104dd5090bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:48:26 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4c3cd8ca-073c-4594-b1ec-7a4f7d656bee tempest-VolumeTypesAccessTest-975729668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e5ee63c-0021-40b3-8094-104dd5090bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:48:26 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4c3cd8ca-073c-4594-b1ec-7a4f7d656bee tempest-VolumeTypesAccessTest-975729668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8718bee-15c9-4d24-aa0b-ebd3742a9ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:48:26 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4c3cd8ca-073c-4594-b1ec-7a4f7d656bee tempest-VolumeTypesAccessTest-975729668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8718bee-15c9-4d24-aa0b-ebd3742a9ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6931fd52-4922-4f0b-95a0-74fa6b6c00bb', 'volume_name': 'volume-6931fd52-4922-4f0b-95a0-74fa6b6c00bb', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:48:26 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4c3cd8ca-073c-4594-b1ec-7a4f7d656bee tempest-VolumeTypesAccessTest-975729668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ebdfdf7-94e0-418a-9676-ff0363fcd108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:48:26 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4c3cd8ca-073c-4594-b1ec-7a4f7d656bee tempest-VolumeTypesAccessTest-975729668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ebdfdf7-94e0-418a-9676-ff0363fcd108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:48:26 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4c3cd8ca-073c-4594-b1ec-7a4f7d656bee tempest-VolumeTypesAccessTest-975729668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (668ad2fb-2121-4df7-b91c-abd79778cbb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:48:26 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-4c3cd8ca-073c-4594-b1ec-7a4f7d656bee tempest-VolumeTypesAccessTest-975729668 None] Volume 6931fd52-4922-4f0b-95a0-74fa6b6c00bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6931fd52-4922-4f0b-95a0-74fa6b6c00bb', 'volume_size': 1}
Apr 09 12:48:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-4c3cd8ca-073c-4594-b1ec-7a4f7d656bee tempest-VolumeTypesAccessTest-975729668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:48:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-4c3cd8ca-073c-4594-b1ec-7a4f7d656bee tempest-VolumeTypesAccessTest-975729668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:48:26 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-4c3cd8ca-073c-4594-b1ec-7a4f7d656bee tempest-VolumeTypesAccessTest-975729668 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:48:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1303074771',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6931fd52-4922-4f0b-95a0-74fa6b6c00bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='562b87eeca8d4cd49b61082c5640450b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:48:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:48:27Z,use_quota=True,user_id='74694ee08e39466892b9352344653687',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f9d5bf69-5bd6-4e2c-8b9d-1007f69503a4),volume_type_id=f9d5bf69-5bd6-4e2c-8b9d-1007f69503a4)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:48:26 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-4c3cd8ca-073c-4594-b1ec-7a4f7d656bee tempest-VolumeTypesAccessTest-975729668 None] Creating volume 6931fd52-4922-4f0b-95a0-74fa6b6c00bb {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:48:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-4c3cd8ca-073c-4594-b1ec-7a4f7d656bee tempest-VolumeTypesAccessTest-975729668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:48:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-4c3cd8ca-073c-4594-b1ec-7a4f7d656bee tempest-VolumeTypesAccessTest-975729668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:48:26 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-4c3cd8ca-073c-4594-b1ec-7a4f7d656bee tempest-VolumeTypesAccessTest-975729668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:48:26 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-4c3cd8ca-073c-4594-b1ec-7a4f7d656bee tempest-VolumeTypesAccessTest-975729668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:48:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-4c3cd8ca-073c-4594-b1ec-7a4f7d656bee tempest-VolumeTypesAccessTest-975729668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:48:26 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-4c3cd8ca-073c-4594-b1ec-7a4f7d656bee tempest-VolumeTypesAccessTest-975729668 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:48:26 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-4c3cd8ca-073c-4594-b1ec-7a4f7d656bee tempest-VolumeTypesAccessTest-975729668 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:48:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-4c3cd8ca-073c-4594-b1ec-7a4f7d656bee tempest-VolumeTypesAccessTest-975729668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6931fd52-4922-4f0b-95a0-74fa6b6c00bb 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:26 devstack sudo[88108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6931fd52-4922-4f0b-95a0-74fa6b6c00bb 1073741824
Apr 09 12:48:26 devstack sudo[88108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:27 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-fc1d14a8-e474-4808-b276-6d6d99746942 tempest-VolumeDependencyTests-476558810 None] Acquiring lock "cinder-fcdd4787-4bfe-4621-ae68-d01b8e7d0eb0-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:48:27 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-fc1d14a8-e474-4808-b276-6d6d99746942 tempest-VolumeDependencyTests-476558810 None] Lock "cinder-fcdd4787-4bfe-4621-ae68-d01b8e7d0eb0-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:48:27 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-fc1d14a8-e474-4808-b276-6d6d99746942 tempest-VolumeDependencyTests-476558810 None] Acquiring lock "cinder-quobyte-fcdd4787-4bfe-4621-ae68-d01b8e7d0eb0" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:48:27 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-fc1d14a8-e474-4808-b276-6d6d99746942 tempest-VolumeDependencyTests-476558810 None] Lock "cinder-quobyte-fcdd4787-4bfe-4621-ae68-d01b8e7d0eb0" acquired by "delete_volume" :: waited 0.013s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:48:27 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[4231a301-f308-4fa6-8040-af29dd23bf85]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:48:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-fc1d14a8-e474-4808-b276-6d6d99746942 tempest-VolumeDependencyTests-476558810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-fcdd4787-4bfe-4621-ae68-d01b8e7d0eb0 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:27 devstack sudo[88110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-fcdd4787-4bfe-4621-ae68-d01b8e7d0eb0
Apr 09 12:48:27 devstack sudo[88110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:27 devstack sudo[88108]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-4c3cd8ca-073c-4594-b1ec-7a4f7d656bee tempest-VolumeTypesAccessTest-975729668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6931fd52-4922-4f0b-95a0-74fa6b6c00bb 1073741824" returned: 0 in 0.625s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-4c3cd8ca-073c-4594-b1ec-7a4f7d656bee tempest-VolumeTypesAccessTest-975729668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6931fd52-4922-4f0b-95a0-74fa6b6c00bb {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:27 devstack sudo[88115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6931fd52-4922-4f0b-95a0-74fa6b6c00bb
Apr 09 12:48:27 devstack sudo[88115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:27 devstack sudo[88110]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-fc1d14a8-e474-4808-b276-6d6d99746942 tempest-VolumeDependencyTests-476558810 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-fcdd4787-4bfe-4621-ae68-d01b8e7d0eb0" returned: 0 in 0.604s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-fc1d14a8-e474-4808-b276-6d6d99746942 tempest-VolumeDependencyTests-476558810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-fcdd4787-4bfe-4621-ae68-d01b8e7d0eb0 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:27 devstack sudo[88120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-fcdd4787-4bfe-4621-ae68-d01b8e7d0eb0
Apr 09 12:48:27 devstack sudo[88120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:28 devstack sudo[88115]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:28 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-4c3cd8ca-073c-4594-b1ec-7a4f7d656bee tempest-VolumeTypesAccessTest-975729668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6931fd52-4922-4f0b-95a0-74fa6b6c00bb" returned: 0 in 0.497s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:28 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-4c3cd8ca-073c-4594-b1ec-7a4f7d656bee tempest-VolumeTypesAccessTest-975729668 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:48:28 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-4c3cd8ca-073c-4594-b1ec-7a4f7d656bee tempest-VolumeTypesAccessTest-975729668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:48:28 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4c3cd8ca-073c-4594-b1ec-7a4f7d656bee tempest-VolumeTypesAccessTest-975729668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (668ad2fb-2121-4df7-b91c-abd79778cbb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6931fd52-4922-4f0b-95a0-74fa6b6c00bb', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:48:28 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4c3cd8ca-073c-4594-b1ec-7a4f7d656bee tempest-VolumeTypesAccessTest-975729668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (def6346a-06e1-4178-ae24-f747efe05d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:48:28 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-4c3cd8ca-073c-4594-b1ec-7a4f7d656bee tempest-VolumeTypesAccessTest-975729668 None] Volume volume-6931fd52-4922-4f0b-95a0-74fa6b6c00bb (6931fd52-4922-4f0b-95a0-74fa6b6c00bb): created successfully
Apr 09 12:48:28 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4c3cd8ca-073c-4594-b1ec-7a4f7d656bee tempest-VolumeTypesAccessTest-975729668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (def6346a-06e1-4178-ae24-f747efe05d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:48:28 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4c3cd8ca-073c-4594-b1ec-7a4f7d656bee tempest-VolumeTypesAccessTest-975729668 None] Flow 'volume_create_manager' (cb5d3a7c-4f10-4166-932b-e0993a50d2b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:48:28 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-4c3cd8ca-073c-4594-b1ec-7a4f7d656bee tempest-VolumeTypesAccessTest-975729668 None] Created volume successfully.
Apr 09 12:48:28 devstack sudo[88120]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:28 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-fc1d14a8-e474-4808-b276-6d6d99746942 tempest-VolumeDependencyTests-476558810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-fcdd4787-4bfe-4621-ae68-d01b8e7d0eb0" returned: 0 in 0.535s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:28 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-fc1d14a8-e474-4808-b276-6d6d99746942 tempest-VolumeDependencyTests-476558810 None] Lock "cinder-quobyte-fcdd4787-4bfe-4621-ae68-d01b8e7d0eb0" released by "delete_volume" :: held 1.169s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:48:28 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-fc1d14a8-e474-4808-b276-6d6d99746942 tempest-VolumeDependencyTests-476558810 None] Created reservations ['d504a491-47b5-4b17-99ec-80e280059b9b', '441e21f8-b4b5-429e-a203-efe535b910ce', 'aff1c2ad-7757-4574-a952-1c6c01bd9091', '64d8937b-25f5-49d0-a7e3-a56c6bc68d9a'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:48:28 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-fc1d14a8-e474-4808-b276-6d6d99746942 tempest-VolumeDependencyTests-476558810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:48:28 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-fc1d14a8-e474-4808-b276-6d6d99746942 tempest-VolumeDependencyTests-476558810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:48:28 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-fc1d14a8-e474-4808-b276-6d6d99746942 tempest-VolumeDependencyTests-476558810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:48:28 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-fc1d14a8-e474-4808-b276-6d6d99746942 tempest-VolumeDependencyTests-476558810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:48:28 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-fc1d14a8-e474-4808-b276-6d6d99746942 tempest-VolumeDependencyTests-476558810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:48:28 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-fc1d14a8-e474-4808-b276-6d6d99746942 tempest-VolumeDependencyTests-476558810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:28 devstack sudo[88124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:48:28 devstack sudo[88124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:28 devstack sudo[88124]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:28 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-fc1d14a8-e474-4808-b276-6d6d99746942 tempest-VolumeDependencyTests-476558810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.435s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:28 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-fc1d14a8-e474-4808-b276-6d6d99746942 tempest-VolumeDependencyTests-476558810 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:48:28 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-fc1d14a8-e474-4808-b276-6d6d99746942 tempest-VolumeDependencyTests-476558810 None] Deleted volume successfully.
Apr 09 12:48:28 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-fc1d14a8-e474-4808-b276-6d6d99746942 tempest-VolumeDependencyTests-476558810 None] Lock "cinder-fcdd4787-4bfe-4621-ae68-d01b8e7d0eb0-delete_volume" released by "delete_volume" :: held 1.761s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:48:28 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-e65d0dce-c302-41ff-b952-eff3be643ec6 tempest-VolumesListTestJSON-47761830 None] Acquiring lock "cinder-3e6baaa8-bdd9-44df-9701-b4f0f8da4f7e-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:48:28 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-e65d0dce-c302-41ff-b952-eff3be643ec6 tempest-VolumesListTestJSON-47761830 None] Lock "cinder-3e6baaa8-bdd9-44df-9701-b4f0f8da4f7e-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:48:28 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-e65d0dce-c302-41ff-b952-eff3be643ec6 tempest-VolumesListTestJSON-47761830 None] Acquiring lock "cinder-quobyte-3e6baaa8-bdd9-44df-9701-b4f0f8da4f7e" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:48:28 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-e65d0dce-c302-41ff-b952-eff3be643ec6 tempest-VolumesListTestJSON-47761830 None] Lock "cinder-quobyte-3e6baaa8-bdd9-44df-9701-b4f0f8da4f7e" acquired by "delete_volume" :: waited 0.007s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:48:29 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b419ba-bef8-462b-93ef-42322393c933]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:48:29 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e65d0dce-c302-41ff-b952-eff3be643ec6 tempest-VolumesListTestJSON-47761830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3e6baaa8-bdd9-44df-9701-b4f0f8da4f7e {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:29 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-6d3a1f4f-519e-4b87-9254-b79515d86aac tempest-VolumeTypesAccessTest-975729668 None] Acquiring lock "cinder-6931fd52-4922-4f0b-95a0-74fa6b6c00bb-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:48:29 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-6d3a1f4f-519e-4b87-9254-b79515d86aac tempest-VolumeTypesAccessTest-975729668 None] Lock "cinder-6931fd52-4922-4f0b-95a0-74fa6b6c00bb-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:48:29 devstack sudo[88127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3e6baaa8-bdd9-44df-9701-b4f0f8da4f7e
Apr 09 12:48:29 devstack sudo[88127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:29 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-6d3a1f4f-519e-4b87-9254-b79515d86aac tempest-VolumeTypesAccessTest-975729668 None] Acquiring lock "cinder-quobyte-6931fd52-4922-4f0b-95a0-74fa6b6c00bb" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:48:29 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-6d3a1f4f-519e-4b87-9254-b79515d86aac tempest-VolumeTypesAccessTest-975729668 None] Lock "cinder-quobyte-6931fd52-4922-4f0b-95a0-74fa6b6c00bb" acquired by "delete_volume" :: waited 0.009s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:48:29 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc664b5b-cf95-491d-8671-c08c2d9daca9]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:48:29 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6d3a1f4f-519e-4b87-9254-b79515d86aac tempest-VolumeTypesAccessTest-975729668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6931fd52-4922-4f0b-95a0-74fa6b6c00bb {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:29 devstack sudo[88129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6931fd52-4922-4f0b-95a0-74fa6b6c00bb
Apr 09 12:48:29 devstack sudo[88129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:29 devstack sudo[88127]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:29 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e65d0dce-c302-41ff-b952-eff3be643ec6 tempest-VolumesListTestJSON-47761830 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3e6baaa8-bdd9-44df-9701-b4f0f8da4f7e" returned: 0 in 0.610s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:29 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e65d0dce-c302-41ff-b952-eff3be643ec6 tempest-VolumesListTestJSON-47761830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3e6baaa8-bdd9-44df-9701-b4f0f8da4f7e {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:29 devstack sudo[88134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3e6baaa8-bdd9-44df-9701-b4f0f8da4f7e
Apr 09 12:48:29 devstack sudo[88134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:29 devstack sudo[88129]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:29 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6d3a1f4f-519e-4b87-9254-b79515d86aac tempest-VolumeTypesAccessTest-975729668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6931fd52-4922-4f0b-95a0-74fa6b6c00bb" returned: 0 in 0.703s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:29 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6d3a1f4f-519e-4b87-9254-b79515d86aac tempest-VolumeTypesAccessTest-975729668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6931fd52-4922-4f0b-95a0-74fa6b6c00bb {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:29 devstack sudo[88139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6931fd52-4922-4f0b-95a0-74fa6b6c00bb
Apr 09 12:48:29 devstack sudo[88139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:30 devstack sudo[88134]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:30 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e65d0dce-c302-41ff-b952-eff3be643ec6 tempest-VolumesListTestJSON-47761830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3e6baaa8-bdd9-44df-9701-b4f0f8da4f7e" returned: 0 in 0.571s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:30 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-e65d0dce-c302-41ff-b952-eff3be643ec6 tempest-VolumesListTestJSON-47761830 None] Lock "cinder-quobyte-3e6baaa8-bdd9-44df-9701-b4f0f8da4f7e" released by "delete_volume" :: held 1.219s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:48:30 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-e65d0dce-c302-41ff-b952-eff3be643ec6 tempest-VolumesListTestJSON-47761830 None] Created reservations ['8466fb26-50ed-48db-9b50-a6fec7e14a4c', '80be412e-3179-4398-9d2a-6625307d5b1b', 'd86070ab-5dfd-41ab-8ae8-860d09fef1a5', 'b111ab21-a96e-4faf-99b8-9f66ce283e36'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:48:30 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-e65d0dce-c302-41ff-b952-eff3be643ec6 tempest-VolumesListTestJSON-47761830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:48:30 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-e65d0dce-c302-41ff-b952-eff3be643ec6 tempest-VolumesListTestJSON-47761830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:48:30 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-e65d0dce-c302-41ff-b952-eff3be643ec6 tempest-VolumesListTestJSON-47761830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:48:30 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-e65d0dce-c302-41ff-b952-eff3be643ec6 tempest-VolumesListTestJSON-47761830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:48:30 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-e65d0dce-c302-41ff-b952-eff3be643ec6 tempest-VolumesListTestJSON-47761830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:48:30 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e65d0dce-c302-41ff-b952-eff3be643ec6 tempest-VolumesListTestJSON-47761830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:30 devstack sudo[88142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:48:30 devstack sudo[88142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:30 devstack sudo[88139]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:30 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6d3a1f4f-519e-4b87-9254-b79515d86aac tempest-VolumeTypesAccessTest-975729668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6931fd52-4922-4f0b-95a0-74fa6b6c00bb" returned: 0 in 0.613s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:30 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-6d3a1f4f-519e-4b87-9254-b79515d86aac tempest-VolumeTypesAccessTest-975729668 None] Lock "cinder-quobyte-6931fd52-4922-4f0b-95a0-74fa6b6c00bb" released by "delete_volume" :: held 1.343s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:48:30 devstack cinder-volume[82760]: WARNING cinder.quota [None req-6d3a1f4f-519e-4b87-9254-b79515d86aac tempest-VolumeTypesAccessTest-975729668 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-388780588 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-388780588, it is now deprecated. Please use the default quota class for default quota.
Apr 09 12:48:30 devstack cinder-volume[82760]: WARNING cinder.quota [None req-6d3a1f4f-519e-4b87-9254-b79515d86aac tempest-VolumeTypesAccessTest-975729668 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-388780588 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-388780588, it is now deprecated. Please use the default quota class for default quota.
Apr 09 12:48:30 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-6d3a1f4f-519e-4b87-9254-b79515d86aac tempest-VolumeTypesAccessTest-975729668 None] Created reservations ['b0181928-dd69-43cb-a629-76a343ce4e81', '7b0b9dee-a64f-4147-a9b9-90780d374498', '13635eee-8241-44f9-be98-b2690b5a245a', '419ff302-efb3-485f-9bff-62fd0947d732'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:48:30 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-6d3a1f4f-519e-4b87-9254-b79515d86aac tempest-VolumeTypesAccessTest-975729668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:48:30 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-6d3a1f4f-519e-4b87-9254-b79515d86aac tempest-VolumeTypesAccessTest-975729668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:48:30 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-6d3a1f4f-519e-4b87-9254-b79515d86aac tempest-VolumeTypesAccessTest-975729668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:48:30 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-6d3a1f4f-519e-4b87-9254-b79515d86aac tempest-VolumeTypesAccessTest-975729668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:48:30 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-6d3a1f4f-519e-4b87-9254-b79515d86aac tempest-VolumeTypesAccessTest-975729668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:48:30 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6d3a1f4f-519e-4b87-9254-b79515d86aac tempest-VolumeTypesAccessTest-975729668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:30 devstack sudo[88145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:48:30 devstack sudo[88145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:30 devstack sudo[88142]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:30 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e65d0dce-c302-41ff-b952-eff3be643ec6 tempest-VolumesListTestJSON-47761830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.544s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:30 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-e65d0dce-c302-41ff-b952-eff3be643ec6 tempest-VolumesListTestJSON-47761830 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:48:30 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-e65d0dce-c302-41ff-b952-eff3be643ec6 tempest-VolumesListTestJSON-47761830 None] Deleted volume successfully.
Apr 09 12:48:30 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-e65d0dce-c302-41ff-b952-eff3be643ec6 tempest-VolumesListTestJSON-47761830 None] Lock "cinder-3e6baaa8-bdd9-44df-9701-b4f0f8da4f7e-delete_volume" released by "delete_volume" :: held 1.945s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:48:31 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-aae30fdd-7f18-48e3-ac3e-0d0713fb17b0 tempest-VolumesListTestJSON-47761830 None] Acquiring lock "cinder-bd6226d6-e439-4a72-ba59-d17e9172991b-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:48:31 devstack sudo[88145]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:31 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-aae30fdd-7f18-48e3-ac3e-0d0713fb17b0 tempest-VolumesListTestJSON-47761830 None] Lock "cinder-bd6226d6-e439-4a72-ba59-d17e9172991b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:48:31 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6d3a1f4f-519e-4b87-9254-b79515d86aac tempest-VolumeTypesAccessTest-975729668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.531s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:31 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-6d3a1f4f-519e-4b87-9254-b79515d86aac tempest-VolumeTypesAccessTest-975729668 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:48:31 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-6d3a1f4f-519e-4b87-9254-b79515d86aac tempest-VolumeTypesAccessTest-975729668 None] Deleted volume successfully.
Apr 09 12:48:31 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-aae30fdd-7f18-48e3-ac3e-0d0713fb17b0 tempest-VolumesListTestJSON-47761830 None] Acquiring lock "cinder-quobyte-bd6226d6-e439-4a72-ba59-d17e9172991b" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:48:31 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-aae30fdd-7f18-48e3-ac3e-0d0713fb17b0 tempest-VolumesListTestJSON-47761830 None] Lock "cinder-quobyte-bd6226d6-e439-4a72-ba59-d17e9172991b" acquired by "delete_volume" :: waited 0.017s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:48:31 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5e2747-9587-4bc2-9091-a8640baeb9e0]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:48:31 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-6d3a1f4f-519e-4b87-9254-b79515d86aac tempest-VolumeTypesAccessTest-975729668 None] Lock "cinder-6931fd52-4922-4f0b-95a0-74fa6b6c00bb-delete_volume" released by "delete_volume" :: held 2.199s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:48:31 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-aae30fdd-7f18-48e3-ac3e-0d0713fb17b0 tempest-VolumesListTestJSON-47761830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bd6226d6-e439-4a72-ba59-d17e9172991b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:31 devstack sudo[88149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bd6226d6-e439-4a72-ba59-d17e9172991b
Apr 09 12:48:31 devstack sudo[88149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:31 devstack sudo[88149]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:31 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-aae30fdd-7f18-48e3-ac3e-0d0713fb17b0 tempest-VolumesListTestJSON-47761830 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bd6226d6-e439-4a72-ba59-d17e9172991b" returned: 0 in 0.620s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:31 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-aae30fdd-7f18-48e3-ac3e-0d0713fb17b0 tempest-VolumesListTestJSON-47761830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bd6226d6-e439-4a72-ba59-d17e9172991b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:31 devstack sudo[88170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bd6226d6-e439-4a72-ba59-d17e9172991b
Apr 09 12:48:31 devstack sudo[88170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:32 devstack sudo[88170]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-aae30fdd-7f18-48e3-ac3e-0d0713fb17b0 tempest-VolumesListTestJSON-47761830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bd6226d6-e439-4a72-ba59-d17e9172991b" returned: 0 in 0.497s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:32 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-aae30fdd-7f18-48e3-ac3e-0d0713fb17b0 tempest-VolumesListTestJSON-47761830 None] Lock "cinder-quobyte-bd6226d6-e439-4a72-ba59-d17e9172991b" released by "delete_volume" :: held 1.160s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:48:32 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-aae30fdd-7f18-48e3-ac3e-0d0713fb17b0 tempest-VolumesListTestJSON-47761830 None] Created reservations ['65a3a164-0c72-4b69-bcd7-22d4b30c4b5a', '8c227c1c-a049-4722-b55a-24a522147376', '9ea8621c-57e2-44ce-942e-91ce5acab4e9', '2f252b90-e6d2-4bae-9e79-8666fbfd3aa0'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:48:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-aae30fdd-7f18-48e3-ac3e-0d0713fb17b0 tempest-VolumesListTestJSON-47761830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:48:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-aae30fdd-7f18-48e3-ac3e-0d0713fb17b0 tempest-VolumesListTestJSON-47761830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:48:32 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-aae30fdd-7f18-48e3-ac3e-0d0713fb17b0 tempest-VolumesListTestJSON-47761830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:48:32 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-aae30fdd-7f18-48e3-ac3e-0d0713fb17b0 tempest-VolumesListTestJSON-47761830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:48:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-aae30fdd-7f18-48e3-ac3e-0d0713fb17b0 tempest-VolumesListTestJSON-47761830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:48:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-aae30fdd-7f18-48e3-ac3e-0d0713fb17b0 tempest-VolumesListTestJSON-47761830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:32 devstack sudo[88174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:48:32 devstack sudo[88174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:33 devstack sudo[88174]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:33 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-aae30fdd-7f18-48e3-ac3e-0d0713fb17b0 tempest-VolumesListTestJSON-47761830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.541s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:33 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-aae30fdd-7f18-48e3-ac3e-0d0713fb17b0 tempest-VolumesListTestJSON-47761830 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:48:33 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-aae30fdd-7f18-48e3-ac3e-0d0713fb17b0 tempest-VolumesListTestJSON-47761830 None] Deleted volume successfully.
Apr 09 12:48:33 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-aae30fdd-7f18-48e3-ac3e-0d0713fb17b0 tempest-VolumesListTestJSON-47761830 None] Lock "cinder-bd6226d6-e439-4a72-ba59-d17e9172991b-delete_volume" released by "delete_volume" :: held 1.878s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:48:33 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-72d381ef-d844-4f5c-8ce1-9b811f5d79a2 tempest-VolumesListTestJSON-47761830 None] Acquiring lock "cinder-e675bb62-b976-40f7-b368-2ee5a0173388-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:48:33 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-72d381ef-d844-4f5c-8ce1-9b811f5d79a2 tempest-VolumesListTestJSON-47761830 None] Lock "cinder-e675bb62-b976-40f7-b368-2ee5a0173388-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:48:33 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-72d381ef-d844-4f5c-8ce1-9b811f5d79a2 tempest-VolumesListTestJSON-47761830 None] Acquiring lock "cinder-quobyte-e675bb62-b976-40f7-b368-2ee5a0173388" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:48:33 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-72d381ef-d844-4f5c-8ce1-9b811f5d79a2 tempest-VolumesListTestJSON-47761830 None] Lock "cinder-quobyte-e675bb62-b976-40f7-b368-2ee5a0173388" acquired by "delete_volume" :: waited 0.012s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:48:33 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[2182e2b8-6fe2-4a11-802e-67e13abebdd7]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:48:33 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-72d381ef-d844-4f5c-8ce1-9b811f5d79a2 tempest-VolumesListTestJSON-47761830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e675bb62-b976-40f7-b368-2ee5a0173388 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:33 devstack sudo[88177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e675bb62-b976-40f7-b368-2ee5a0173388
Apr 09 12:48:33 devstack sudo[88177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:34 devstack sudo[88177]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:34 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-72d381ef-d844-4f5c-8ce1-9b811f5d79a2 tempest-VolumesListTestJSON-47761830 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e675bb62-b976-40f7-b368-2ee5a0173388" returned: 0 in 0.576s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:34 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-72d381ef-d844-4f5c-8ce1-9b811f5d79a2 tempest-VolumesListTestJSON-47761830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e675bb62-b976-40f7-b368-2ee5a0173388 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:34 devstack sudo[88182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e675bb62-b976-40f7-b368-2ee5a0173388
Apr 09 12:48:34 devstack sudo[88182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:34 devstack sudo[88182]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:34 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-72d381ef-d844-4f5c-8ce1-9b811f5d79a2 tempest-VolumesListTestJSON-47761830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e675bb62-b976-40f7-b368-2ee5a0173388" returned: 0 in 0.515s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:34 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-72d381ef-d844-4f5c-8ce1-9b811f5d79a2 tempest-VolumesListTestJSON-47761830 None] Lock "cinder-quobyte-e675bb62-b976-40f7-b368-2ee5a0173388" released by "delete_volume" :: held 1.140s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:48:34 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-72d381ef-d844-4f5c-8ce1-9b811f5d79a2 tempest-VolumesListTestJSON-47761830 None] Created reservations ['86afe1f9-7868-43ad-875c-29769e88f841', 'dcc5807e-dad9-4725-9ab6-4c15c9b41c49', '45f887db-50ce-4af3-8dd6-aad910ab8a7b', 'e453630f-a7f6-4741-bafd-69e7586bc1f2'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:48:34 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-72d381ef-d844-4f5c-8ce1-9b811f5d79a2 tempest-VolumesListTestJSON-47761830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:48:34 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-72d381ef-d844-4f5c-8ce1-9b811f5d79a2 tempest-VolumesListTestJSON-47761830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:48:34 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-72d381ef-d844-4f5c-8ce1-9b811f5d79a2 tempest-VolumesListTestJSON-47761830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:48:34 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-72d381ef-d844-4f5c-8ce1-9b811f5d79a2 tempest-VolumesListTestJSON-47761830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:48:34 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-72d381ef-d844-4f5c-8ce1-9b811f5d79a2 tempest-VolumesListTestJSON-47761830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:48:34 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-72d381ef-d844-4f5c-8ce1-9b811f5d79a2 tempest-VolumesListTestJSON-47761830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:34 devstack sudo[88188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:48:34 devstack sudo[88188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:35 devstack sudo[88188]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-72d381ef-d844-4f5c-8ce1-9b811f5d79a2 tempest-VolumesListTestJSON-47761830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.451s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:35 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-72d381ef-d844-4f5c-8ce1-9b811f5d79a2 tempest-VolumesListTestJSON-47761830 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:48:35 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-72d381ef-d844-4f5c-8ce1-9b811f5d79a2 tempest-VolumesListTestJSON-47761830 None] Deleted volume successfully.
Apr 09 12:48:35 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-72d381ef-d844-4f5c-8ce1-9b811f5d79a2 tempest-VolumesListTestJSON-47761830 None] Lock "cinder-e675bb62-b976-40f7-b368-2ee5a0173388-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:48:38 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-39e3f7f2-28a4-4cf9-979a-24c806d9260a tempest-VolumesSnapshotListTestJSON-1862510598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:48:38 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-39e3f7f2-28a4-4cf9-979a-24c806d9260a tempest-VolumesSnapshotListTestJSON-1862510598 None] Flow 'volume_create_manager' (a18ce1bc-5dd8-479a-895c-9171761233ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:48:38 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-39e3f7f2-28a4-4cf9-979a-24c806d9260a tempest-VolumesSnapshotListTestJSON-1862510598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (405f13bf-1425-41e1-867b-2a006ad4a89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:48:38 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-bfbda134-b959-4093-a49c-0b7205fc6115 tempest-VolumesActionsTest-2093358557 None] Acquiring lock "cinder-ca2d894e-5587-4797-9daa-d4fe29c9414d" by "attach_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:48:38 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-39e3f7f2-28a4-4cf9-979a-24c806d9260a tempest-VolumesSnapshotListTestJSON-1862510598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (405f13bf-1425-41e1-867b-2a006ad4a89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:48:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1338330063',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6959cf50-f1df-40e5-9629-71b4777f8b49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3824850eac444358af769b789f3c93b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:48:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:48:38Z,use_quota=True,user_id='8e07d47546404cce94ad40c111784dab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:48:38 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-39e3f7f2-28a4-4cf9-979a-24c806d9260a tempest-VolumesSnapshotListTestJSON-1862510598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (001fbfa0-4548-4abb-af06-7f7579b756dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:48:38 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-39e3f7f2-28a4-4cf9-979a-24c806d9260a tempest-VolumesSnapshotListTestJSON-1862510598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (001fbfa0-4548-4abb-af06-7f7579b756dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:48:38 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-39e3f7f2-28a4-4cf9-979a-24c806d9260a tempest-VolumesSnapshotListTestJSON-1862510598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddf11faf-8360-499c-b492-fe98eebe49f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:48:38 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-39e3f7f2-28a4-4cf9-979a-24c806d9260a tempest-VolumesSnapshotListTestJSON-1862510598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddf11faf-8360-499c-b492-fe98eebe49f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6959cf50-f1df-40e5-9629-71b4777f8b49', 'volume_name': 'volume-6959cf50-f1df-40e5-9629-71b4777f8b49', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:48:38 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-39e3f7f2-28a4-4cf9-979a-24c806d9260a tempest-VolumesSnapshotListTestJSON-1862510598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c316aeb0-578b-46c7-9fd0-7fe18dbe75b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:48:38 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-39e3f7f2-28a4-4cf9-979a-24c806d9260a tempest-VolumesSnapshotListTestJSON-1862510598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c316aeb0-578b-46c7-9fd0-7fe18dbe75b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:48:38 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-39e3f7f2-28a4-4cf9-979a-24c806d9260a tempest-VolumesSnapshotListTestJSON-1862510598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ab7263a-a742-4ab1-9e6c-edafa57569cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:48:38 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-39e3f7f2-28a4-4cf9-979a-24c806d9260a tempest-VolumesSnapshotListTestJSON-1862510598 None] Volume 6959cf50-f1df-40e5-9629-71b4777f8b49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6959cf50-f1df-40e5-9629-71b4777f8b49', 'volume_size': 1}
Apr 09 12:48:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-39e3f7f2-28a4-4cf9-979a-24c806d9260a tempest-VolumesSnapshotListTestJSON-1862510598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:48:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-39e3f7f2-28a4-4cf9-979a-24c806d9260a tempest-VolumesSnapshotListTestJSON-1862510598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:48:38 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-39e3f7f2-28a4-4cf9-979a-24c806d9260a tempest-VolumesSnapshotListTestJSON-1862510598 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:48:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1338330063',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6959cf50-f1df-40e5-9629-71b4777f8b49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3824850eac444358af769b789f3c93b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:48:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:48:38Z,use_quota=True,user_id='8e07d47546404cce94ad40c111784dab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:48:38 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-39e3f7f2-28a4-4cf9-979a-24c806d9260a tempest-VolumesSnapshotListTestJSON-1862510598 None] Creating volume 6959cf50-f1df-40e5-9629-71b4777f8b49 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:48:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-39e3f7f2-28a4-4cf9-979a-24c806d9260a tempest-VolumesSnapshotListTestJSON-1862510598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:48:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-39e3f7f2-28a4-4cf9-979a-24c806d9260a tempest-VolumesSnapshotListTestJSON-1862510598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:48:38 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-39e3f7f2-28a4-4cf9-979a-24c806d9260a tempest-VolumesSnapshotListTestJSON-1862510598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:48:38 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-39e3f7f2-28a4-4cf9-979a-24c806d9260a tempest-VolumesSnapshotListTestJSON-1862510598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:48:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-39e3f7f2-28a4-4cf9-979a-24c806d9260a tempest-VolumesSnapshotListTestJSON-1862510598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:48:38 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-39e3f7f2-28a4-4cf9-979a-24c806d9260a tempest-VolumesSnapshotListTestJSON-1862510598 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:48:38 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-39e3f7f2-28a4-4cf9-979a-24c806d9260a tempest-VolumesSnapshotListTestJSON-1862510598 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:48:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-39e3f7f2-28a4-4cf9-979a-24c806d9260a tempest-VolumesSnapshotListTestJSON-1862510598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:38 devstack sudo[88219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49 1073741824
Apr 09 12:48:38 devstack sudo[88219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:38 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-bfbda134-b959-4093-a49c-0b7205fc6115 tempest-VolumesActionsTest-2093358557 None] Lock "cinder-ca2d894e-5587-4797-9daa-d4fe29c9414d" acquired by "attach_volume" :: waited 0.078s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:48:38 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-bfbda134-b959-4093-a49c-0b7205fc6115 tempest-VolumesActionsTest-2093358557 None] Attaching volume ca2d894e-5587-4797-9daa-d4fe29c9414d to instance 3718f8b6-0409-41fd-992e-b54addd2e95d at mountpoint /dev/vdb on host None.
Apr 09 12:48:38 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-bfbda134-b959-4093-a49c-0b7205fc6115 tempest-VolumesActionsTest-2093358557 None] Attach volume completed successfully.
Apr 09 12:48:38 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-bfbda134-b959-4093-a49c-0b7205fc6115 tempest-VolumesActionsTest-2093358557 None] Lock "cinder-ca2d894e-5587-4797-9daa-d4fe29c9414d" released by "attach_volume" :: held 0.074s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:48:39 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-14286629-12e1-4f88-9b38-4633b4c7fd81 tempest-VolumesActionsTest-2093358557 None] Acquiring lock "cinder-ca2d894e-5587-4797-9daa-d4fe29c9414d-detach_volume" by "detach_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:48:39 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-14286629-12e1-4f88-9b38-4633b4c7fd81 tempest-VolumesActionsTest-2093358557 None] Lock "cinder-ca2d894e-5587-4797-9daa-d4fe29c9414d-detach_volume" acquired by "detach_volume" :: waited 0.011s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:48:39 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-14286629-12e1-4f88-9b38-4633b4c7fd81 tempest-VolumesActionsTest-2093358557 None] Detaching volume ca2d894e-5587-4797-9daa-d4fe29c9414d from instance 3718f8b6-0409-41fd-992e-b54addd2e95d.
Apr 09 12:48:39 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-14286629-12e1-4f88-9b38-4633b4c7fd81 tempest-VolumesActionsTest-2093358557 None] Detach volume completed successfully.
Apr 09 12:48:39 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-14286629-12e1-4f88-9b38-4633b4c7fd81 tempest-VolumesActionsTest-2093358557 None] Lock "cinder-ca2d894e-5587-4797-9daa-d4fe29c9414d-detach_volume" released by "detach_volume" :: held 0.047s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:48:39 devstack sudo[88219]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-39e3f7f2-28a4-4cf9-979a-24c806d9260a tempest-VolumesSnapshotListTestJSON-1862510598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49 1073741824" returned: 0 in 0.696s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-39e3f7f2-28a4-4cf9-979a-24c806d9260a tempest-VolumesSnapshotListTestJSON-1862510598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:39 devstack sudo[88224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49
Apr 09 12:48:39 devstack sudo[88224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:40 devstack sudo[88224]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:40 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-39e3f7f2-28a4-4cf9-979a-24c806d9260a tempest-VolumesSnapshotListTestJSON-1862510598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49" returned: 0 in 0.763s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:40 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-39e3f7f2-28a4-4cf9-979a-24c806d9260a tempest-VolumesSnapshotListTestJSON-1862510598 None] <== create_volume: return (1490ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:48:40 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-39e3f7f2-28a4-4cf9-979a-24c806d9260a tempest-VolumesSnapshotListTestJSON-1862510598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.493s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:48:40 devstack cinder-volume[82760]: DEBUG dbcounter [-] [82760] Writing DB stats cinder:UPDATE=193,cinder:DELETE=18,cinder:SELECT=140,cinder:INSERT=56 {{(pid=82760) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 12:48:40 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-39e3f7f2-28a4-4cf9-979a-24c806d9260a tempest-VolumesSnapshotListTestJSON-1862510598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ab7263a-a742-4ab1-9e6c-edafa57569cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6959cf50-f1df-40e5-9629-71b4777f8b49', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:48:40 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-39e3f7f2-28a4-4cf9-979a-24c806d9260a tempest-VolumesSnapshotListTestJSON-1862510598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d72bb075-3a31-484b-8970-444b3293f1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:48:40 devstack cinder-volume[82760]: DEBUG dbcounter [-] [82760] Writing DB stats cinder:SELECT=191,cinder:UPDATE=220,cinder:INSERT=60,cinder:DELETE=17 {{(pid=82760) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 12:48:40 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-39e3f7f2-28a4-4cf9-979a-24c806d9260a tempest-VolumesSnapshotListTestJSON-1862510598 None] Volume volume-6959cf50-f1df-40e5-9629-71b4777f8b49 (6959cf50-f1df-40e5-9629-71b4777f8b49): created successfully
Apr 09 12:48:40 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-39e3f7f2-28a4-4cf9-979a-24c806d9260a tempest-VolumesSnapshotListTestJSON-1862510598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d72bb075-3a31-484b-8970-444b3293f1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:48:40 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-39e3f7f2-28a4-4cf9-979a-24c806d9260a tempest-VolumesSnapshotListTestJSON-1862510598 None] Flow 'volume_create_manager' (a18ce1bc-5dd8-479a-895c-9171761233ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:48:40 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-39e3f7f2-28a4-4cf9-979a-24c806d9260a tempest-VolumesSnapshotListTestJSON-1862510598 None] Created volume successfully.
Apr 09 12:48:40 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-eb4b9376-883f-4c20-be1c-4930388d2a72 tempest-VolumesSnapshotListTestJSON-1862510598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:48:40 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-eb4b9376-883f-4c20-be1c-4930388d2a72 tempest-VolumesSnapshotListTestJSON-1862510598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:48:40 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-eb4b9376-883f-4c20-be1c-4930388d2a72 tempest-VolumesSnapshotListTestJSON-1862510598 None] Creating offline snapshot 0f882072-6f26-49ab-9bce-5091669a6092 of volume 6959cf50-f1df-40e5-9629-71b4777f8b49 {{(pid=82760) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 12:48:40 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[287c00c6-1991-4f04-9279-d17d0ea752e9]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:48:40 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-eb4b9376-883f-4c20-be1c-4930388d2a72 tempest-VolumesSnapshotListTestJSON-1862510598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:40 devstack sudo[88262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49
Apr 09 12:48:40 devstack sudo[88262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:41 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-395f6f0d-0c13-4c3d-adc7-9f44a073db5f tempest-VolumesDeleteCascade-90985742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:48:41 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-395f6f0d-0c13-4c3d-adc7-9f44a073db5f tempest-VolumesDeleteCascade-90985742 None] Flow 'volume_create_manager' (74af3408-e614-4962-9e71-e4c73af92ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:48:41 devstack sudo[88262]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:41 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-395f6f0d-0c13-4c3d-adc7-9f44a073db5f tempest-VolumesDeleteCascade-90985742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (133c9809-4567-480d-8591-d90e07c2546c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:48:41 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-eb4b9376-883f-4c20-be1c-4930388d2a72 tempest-VolumesSnapshotListTestJSON-1862510598 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49" returned: 0 in 0.607s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:41 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-eb4b9376-883f-4c20-be1c-4930388d2a72 tempest-VolumesSnapshotListTestJSON-1862510598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.0f882072-6f26-49ab-9bce-5091669a6092 1G {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:41 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-395f6f0d-0c13-4c3d-adc7-9f44a073db5f tempest-VolumesDeleteCascade-90985742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (133c9809-4567-480d-8591-d90e07c2546c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:48:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-437262284',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=088393ba-9ee1-4f25-9508-d03ba90c65f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be0c74dc200343909e5e2d9b7998aac9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:48:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:48:41Z,use_quota=True,user_id='0d0197bc85c7490c9024554e23e4aa42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:48:41 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-395f6f0d-0c13-4c3d-adc7-9f44a073db5f tempest-VolumesDeleteCascade-90985742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (831e739d-cfae-468b-a232-44a8f5c85e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:48:41 devstack sudo[88295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.0f882072-6f26-49ab-9bce-5091669a6092 1G
Apr 09 12:48:41 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-395f6f0d-0c13-4c3d-adc7-9f44a073db5f tempest-VolumesDeleteCascade-90985742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (831e739d-cfae-468b-a232-44a8f5c85e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:48:41 devstack sudo[88295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:41 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-395f6f0d-0c13-4c3d-adc7-9f44a073db5f tempest-VolumesDeleteCascade-90985742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7789d12-66c1-48ae-a216-ca7691e49afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:48:41 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-395f6f0d-0c13-4c3d-adc7-9f44a073db5f tempest-VolumesDeleteCascade-90985742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7789d12-66c1-48ae-a216-ca7691e49afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '088393ba-9ee1-4f25-9508-d03ba90c65f0', 'volume_name': 'volume-088393ba-9ee1-4f25-9508-d03ba90c65f0', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:48:41 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-395f6f0d-0c13-4c3d-adc7-9f44a073db5f tempest-VolumesDeleteCascade-90985742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6a14eba-eb59-4349-b166-68653a30d794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:48:41 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-395f6f0d-0c13-4c3d-adc7-9f44a073db5f tempest-VolumesDeleteCascade-90985742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6a14eba-eb59-4349-b166-68653a30d794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:48:41 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-395f6f0d-0c13-4c3d-adc7-9f44a073db5f tempest-VolumesDeleteCascade-90985742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5b45034-a148-4038-8e7d-cb1249d9bda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:48:41 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-395f6f0d-0c13-4c3d-adc7-9f44a073db5f tempest-VolumesDeleteCascade-90985742 None] Volume 088393ba-9ee1-4f25-9508-d03ba90c65f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-088393ba-9ee1-4f25-9508-d03ba90c65f0', 'volume_size': 1}
Apr 09 12:48:41 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-395f6f0d-0c13-4c3d-adc7-9f44a073db5f tempest-VolumesDeleteCascade-90985742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:48:41 devstack sudo[88295]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:41 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-eb4b9376-883f-4c20-be1c-4930388d2a72 tempest-VolumesSnapshotListTestJSON-1862510598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.0f882072-6f26-49ab-9bce-5091669a6092 1G" returned: 0 in 0.510s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:41 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-eb4b9376-883f-4c20-be1c-4930388d2a72 tempest-VolumesSnapshotListTestJSON-1862510598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6959cf50-f1df-40e5-9629-71b4777f8b49 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.0f882072-6f26-49ab-9bce-5091669a6092 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:41 devstack sudo[88301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6959cf50-f1df-40e5-9629-71b4777f8b49 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.0f882072-6f26-49ab-9bce-5091669a6092
Apr 09 12:48:41 devstack sudo[88301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:42 devstack sudo[88301]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:42 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-eb4b9376-883f-4c20-be1c-4930388d2a72 tempest-VolumesSnapshotListTestJSON-1862510598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6959cf50-f1df-40e5-9629-71b4777f8b49 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.0f882072-6f26-49ab-9bce-5091669a6092" returned: 0 in 0.456s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:42 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-eb4b9376-883f-4c20-be1c-4930388d2a72 tempest-VolumesSnapshotListTestJSON-1862510598 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.0f882072-6f26-49ab-9bce-5091669a6092 is being set with open permissions: ugo+rw
Apr 09 12:48:42 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-eb4b9376-883f-4c20-be1c-4930388d2a72 tempest-VolumesSnapshotListTestJSON-1862510598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.0f882072-6f26-49ab-9bce-5091669a6092 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:42 devstack sudo[88307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.0f882072-6f26-49ab-9bce-5091669a6092
Apr 09 12:48:42 devstack sudo[88307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:42 devstack sudo[88307]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:42 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-eb4b9376-883f-4c20-be1c-4930388d2a72 tempest-VolumesSnapshotListTestJSON-1862510598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.0f882072-6f26-49ab-9bce-5091669a6092" returned: 0 in 0.496s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:42 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-eb4b9376-883f-4c20-be1c-4930388d2a72 tempest-VolumesSnapshotListTestJSON-1862510598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:42 devstack sudo[88312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.info
Apr 09 12:48:42 devstack sudo[88312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:43 devstack sudo[88312]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:43 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-eb4b9376-883f-4c20-be1c-4930388d2a72 tempest-VolumesSnapshotListTestJSON-1862510598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.info" returned: 0 in 0.423s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:43 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-eb4b9376-883f-4c20-be1c-4930388d2a72 tempest-VolumesSnapshotListTestJSON-1862510598 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.info is being set with open permissions: ugo+rw
Apr 09 12:48:43 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-eb4b9376-883f-4c20-be1c-4930388d2a72 tempest-VolumesSnapshotListTestJSON-1862510598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:43 devstack sudo[88315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.info
Apr 09 12:48:43 devstack sudo[88315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:43 devstack sudo[88315]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:43 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-eb4b9376-883f-4c20-be1c-4930388d2a72 tempest-VolumesSnapshotListTestJSON-1862510598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.info" returned: 0 in 0.421s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:43 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-eb4b9376-883f-4c20-be1c-4930388d2a72 tempest-VolumesSnapshotListTestJSON-1862510598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.973s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:48:43 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-395f6f0d-0c13-4c3d-adc7-9f44a073db5f tempest-VolumesDeleteCascade-90985742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.308s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:48:43 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-395f6f0d-0c13-4c3d-adc7-9f44a073db5f tempest-VolumesDeleteCascade-90985742 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:48:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-437262284',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=088393ba-9ee1-4f25-9508-d03ba90c65f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be0c74dc200343909e5e2d9b7998aac9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:48:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:48:41Z,use_quota=True,user_id='0d0197bc85c7490c9024554e23e4aa42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:48:43 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-395f6f0d-0c13-4c3d-adc7-9f44a073db5f tempest-VolumesDeleteCascade-90985742 None] Creating volume 088393ba-9ee1-4f25-9508-d03ba90c65f0 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:48:43 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-395f6f0d-0c13-4c3d-adc7-9f44a073db5f tempest-VolumesDeleteCascade-90985742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:48:43 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-395f6f0d-0c13-4c3d-adc7-9f44a073db5f tempest-VolumesDeleteCascade-90985742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:48:43 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-395f6f0d-0c13-4c3d-adc7-9f44a073db5f tempest-VolumesDeleteCascade-90985742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:48:43 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-395f6f0d-0c13-4c3d-adc7-9f44a073db5f tempest-VolumesDeleteCascade-90985742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:48:43 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-395f6f0d-0c13-4c3d-adc7-9f44a073db5f tempest-VolumesDeleteCascade-90985742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:48:43 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-395f6f0d-0c13-4c3d-adc7-9f44a073db5f tempest-VolumesDeleteCascade-90985742 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:48:43 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-395f6f0d-0c13-4c3d-adc7-9f44a073db5f tempest-VolumesDeleteCascade-90985742 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:48:43 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-395f6f0d-0c13-4c3d-adc7-9f44a073db5f tempest-VolumesDeleteCascade-90985742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:43 devstack sudo[88318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0 1073741824
Apr 09 12:48:43 devstack sudo[88318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:43 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-eb4b9376-883f-4c20-be1c-4930388d2a72 tempest-VolumesSnapshotListTestJSON-1862510598 None] Create snapshot completed successfully
Apr 09 12:48:44 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-7fcb8256-11f5-48d1-83c5-c439867a4e78 tempest-VolumesSnapshotListTestJSON-1862510598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:48:44 devstack sudo[88318]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:44 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-395f6f0d-0c13-4c3d-adc7-9f44a073db5f tempest-VolumesDeleteCascade-90985742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0 1073741824" returned: 0 in 0.599s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:44 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-395f6f0d-0c13-4c3d-adc7-9f44a073db5f tempest-VolumesDeleteCascade-90985742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:44 devstack sudo[88323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0
Apr 09 12:48:44 devstack sudo[88323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:44 devstack sudo[88323]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:44 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-395f6f0d-0c13-4c3d-adc7-9f44a073db5f tempest-VolumesDeleteCascade-90985742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0" returned: 0 in 0.460s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:44 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-395f6f0d-0c13-4c3d-adc7-9f44a073db5f tempest-VolumesDeleteCascade-90985742 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:48:44 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-395f6f0d-0c13-4c3d-adc7-9f44a073db5f tempest-VolumesDeleteCascade-90985742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:48:44 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-7fcb8256-11f5-48d1-83c5-c439867a4e78 tempest-VolumesSnapshotListTestJSON-1862510598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.854s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:48:44 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-7fcb8256-11f5-48d1-83c5-c439867a4e78 tempest-VolumesSnapshotListTestJSON-1862510598 None] Creating offline snapshot 87f9490d-4166-4273-a1c3-a0814396768f of volume 6959cf50-f1df-40e5-9629-71b4777f8b49 {{(pid=82760) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 12:48:44 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-395f6f0d-0c13-4c3d-adc7-9f44a073db5f tempest-VolumesDeleteCascade-90985742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5b45034-a148-4038-8e7d-cb1249d9bda7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-088393ba-9ee1-4f25-9508-d03ba90c65f0', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:48:44 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-395f6f0d-0c13-4c3d-adc7-9f44a073db5f tempest-VolumesDeleteCascade-90985742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee6c334c-eff2-4adf-abb3-fa3f520d3179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:48:44 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[9013fb6b-a60e-474c-9537-25bfafa98166]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:48:44 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-7fcb8256-11f5-48d1-83c5-c439867a4e78 tempest-VolumesSnapshotListTestJSON-1862510598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.0f882072-6f26-49ab-9bce-5091669a6092 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:44 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-395f6f0d-0c13-4c3d-adc7-9f44a073db5f tempest-VolumesDeleteCascade-90985742 None] Volume volume-088393ba-9ee1-4f25-9508-d03ba90c65f0 (088393ba-9ee1-4f25-9508-d03ba90c65f0): created successfully
Apr 09 12:48:44 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-395f6f0d-0c13-4c3d-adc7-9f44a073db5f tempest-VolumesDeleteCascade-90985742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee6c334c-eff2-4adf-abb3-fa3f520d3179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:48:44 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-395f6f0d-0c13-4c3d-adc7-9f44a073db5f tempest-VolumesDeleteCascade-90985742 None] Flow 'volume_create_manager' (74af3408-e614-4962-9e71-e4c73af92ec1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:48:44 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-395f6f0d-0c13-4c3d-adc7-9f44a073db5f tempest-VolumesDeleteCascade-90985742 None] Created volume successfully.
Apr 09 12:48:44 devstack sudo[88326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.0f882072-6f26-49ab-9bce-5091669a6092
Apr 09 12:48:45 devstack sudo[88326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:45 devstack sudo[88326]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:45 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-7fcb8256-11f5-48d1-83c5-c439867a4e78 tempest-VolumesSnapshotListTestJSON-1862510598 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.0f882072-6f26-49ab-9bce-5091669a6092" returned: 0 in 0.551s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:45 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-7fcb8256-11f5-48d1-83c5-c439867a4e78 tempest-VolumesSnapshotListTestJSON-1862510598 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6959cf50-f1df-40e5-9629-71b4777f8b49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:48:45 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-7fcb8256-11f5-48d1-83c5-c439867a4e78 tempest-VolumesSnapshotListTestJSON-1862510598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.0f882072-6f26-49ab-9bce-5091669a6092,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.87f9490d-4166-4273-a1c3-a0814396768f 1G {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:45 devstack sudo[88331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.0f882072-6f26-49ab-9bce-5091669a6092,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.87f9490d-4166-4273-a1c3-a0814396768f 1G
Apr 09 12:48:45 devstack sudo[88331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:45 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d505dc5f-3311-4073-bb32-602aac248b99 tempest-VolumesDeleteCascade-90985742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:48:46 devstack sudo[88331]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-7fcb8256-11f5-48d1-83c5-c439867a4e78 tempest-VolumesSnapshotListTestJSON-1862510598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.0f882072-6f26-49ab-9bce-5091669a6092,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.87f9490d-4166-4273-a1c3-a0814396768f 1G" returned: 0 in 0.606s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-7fcb8256-11f5-48d1-83c5-c439867a4e78 tempest-VolumesSnapshotListTestJSON-1862510598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6959cf50-f1df-40e5-9629-71b4777f8b49.0f882072-6f26-49ab-9bce-5091669a6092 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.87f9490d-4166-4273-a1c3-a0814396768f {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:46 devstack sudo[88336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6959cf50-f1df-40e5-9629-71b4777f8b49.0f882072-6f26-49ab-9bce-5091669a6092 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.87f9490d-4166-4273-a1c3-a0814396768f
Apr 09 12:48:46 devstack sudo[88336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:46 devstack sudo[88336]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-7fcb8256-11f5-48d1-83c5-c439867a4e78 tempest-VolumesSnapshotListTestJSON-1862510598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6959cf50-f1df-40e5-9629-71b4777f8b49.0f882072-6f26-49ab-9bce-5091669a6092 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.87f9490d-4166-4273-a1c3-a0814396768f" returned: 0 in 0.487s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:46 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-7fcb8256-11f5-48d1-83c5-c439867a4e78 tempest-VolumesSnapshotListTestJSON-1862510598 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.87f9490d-4166-4273-a1c3-a0814396768f is being set with open permissions: ugo+rw
Apr 09 12:48:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-7fcb8256-11f5-48d1-83c5-c439867a4e78 tempest-VolumesSnapshotListTestJSON-1862510598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.87f9490d-4166-4273-a1c3-a0814396768f {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:46 devstack sudo[88341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.87f9490d-4166-4273-a1c3-a0814396768f
Apr 09 12:48:46 devstack sudo[88341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:47 devstack sudo[88341]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:47 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-7fcb8256-11f5-48d1-83c5-c439867a4e78 tempest-VolumesSnapshotListTestJSON-1862510598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.87f9490d-4166-4273-a1c3-a0814396768f" returned: 0 in 0.543s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:47 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-7fcb8256-11f5-48d1-83c5-c439867a4e78 tempest-VolumesSnapshotListTestJSON-1862510598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.264s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:48:47 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d505dc5f-3311-4073-bb32-602aac248b99 tempest-VolumesDeleteCascade-90985742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.464s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:48:47 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-d505dc5f-3311-4073-bb32-602aac248b99 tempest-VolumesDeleteCascade-90985742 None] Creating offline snapshot 994828b7-15f4-460d-a999-416f71218711 of volume 088393ba-9ee1-4f25-9508-d03ba90c65f0 {{(pid=82760) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 12:48:47 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-7fcb8256-11f5-48d1-83c5-c439867a4e78 tempest-VolumesSnapshotListTestJSON-1862510598 None] Create snapshot completed successfully
Apr 09 12:48:47 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b224e1f-3e09-4457-9084-4ae09a370fbb]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:48:47 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d505dc5f-3311-4073-bb32-602aac248b99 tempest-VolumesDeleteCascade-90985742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:47 devstack sudo[88347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0
Apr 09 12:48:47 devstack sudo[88347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:47 devstack sudo[88347]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:47 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d505dc5f-3311-4073-bb32-602aac248b99 tempest-VolumesDeleteCascade-90985742 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0" returned: 0 in 0.501s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:47 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d505dc5f-3311-4073-bb32-602aac248b99 tempest-VolumesDeleteCascade-90985742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.994828b7-15f4-460d-a999-416f71218711 1G {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:47 devstack sudo[88353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.994828b7-15f4-460d-a999-416f71218711 1G
Apr 09 12:48:47 devstack sudo[88353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:48 devstack sudo[88353]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:48 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d505dc5f-3311-4073-bb32-602aac248b99 tempest-VolumesDeleteCascade-90985742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.994828b7-15f4-460d-a999-416f71218711 1G" returned: 0 in 0.543s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:48 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d505dc5f-3311-4073-bb32-602aac248b99 tempest-VolumesDeleteCascade-90985742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-088393ba-9ee1-4f25-9508-d03ba90c65f0 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.994828b7-15f4-460d-a999-416f71218711 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:48 devstack sudo[88358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-088393ba-9ee1-4f25-9508-d03ba90c65f0 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.994828b7-15f4-460d-a999-416f71218711
Apr 09 12:48:48 devstack sudo[88358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:48 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-92197552-9c73-44d4-b346-887808715ce5 tempest-VolumesSnapshotListTestJSON-1862510598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:48:48 devstack sudo[88358]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:48 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d505dc5f-3311-4073-bb32-602aac248b99 tempest-VolumesDeleteCascade-90985742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-088393ba-9ee1-4f25-9508-d03ba90c65f0 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.994828b7-15f4-460d-a999-416f71218711" returned: 0 in 0.465s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:48 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-d505dc5f-3311-4073-bb32-602aac248b99 tempest-VolumesDeleteCascade-90985742 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.994828b7-15f4-460d-a999-416f71218711 is being set with open permissions: ugo+rw
Apr 09 12:48:48 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d505dc5f-3311-4073-bb32-602aac248b99 tempest-VolumesDeleteCascade-90985742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.994828b7-15f4-460d-a999-416f71218711 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:48 devstack sudo[88363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.994828b7-15f4-460d-a999-416f71218711
Apr 09 12:48:48 devstack sudo[88363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:49 devstack sudo[88363]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:49 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d505dc5f-3311-4073-bb32-602aac248b99 tempest-VolumesDeleteCascade-90985742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.994828b7-15f4-460d-a999-416f71218711" returned: 0 in 0.470s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:49 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d505dc5f-3311-4073-bb32-602aac248b99 tempest-VolumesDeleteCascade-90985742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:49 devstack sudo[88366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.info
Apr 09 12:48:49 devstack sudo[88366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:49 devstack sudo[88366]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:49 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d505dc5f-3311-4073-bb32-602aac248b99 tempest-VolumesDeleteCascade-90985742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.info" returned: 0 in 0.446s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:49 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-d505dc5f-3311-4073-bb32-602aac248b99 tempest-VolumesDeleteCascade-90985742 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.info is being set with open permissions: ugo+rw
Apr 09 12:48:49 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d505dc5f-3311-4073-bb32-602aac248b99 tempest-VolumesDeleteCascade-90985742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:49 devstack sudo[88369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.info
Apr 09 12:48:49 devstack sudo[88369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:50 devstack sudo[88369]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d505dc5f-3311-4073-bb32-602aac248b99 tempest-VolumesDeleteCascade-90985742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.info" returned: 0 in 0.501s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d505dc5f-3311-4073-bb32-602aac248b99 tempest-VolumesDeleteCascade-90985742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.992s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:48:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-92197552-9c73-44d4-b346-887808715ce5 tempest-VolumesSnapshotListTestJSON-1862510598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.803s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:48:50 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-d505dc5f-3311-4073-bb32-602aac248b99 tempest-VolumesDeleteCascade-90985742 None] Create snapshot completed successfully
Apr 09 12:48:50 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-92197552-9c73-44d4-b346-887808715ce5 tempest-VolumesSnapshotListTestJSON-1862510598 None] Creating offline snapshot cbd0c226-8fac-4d42-82cd-197c994bc18a of volume 6959cf50-f1df-40e5-9629-71b4777f8b49 {{(pid=82760) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 12:48:50 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[560bbdf2-e354-4b8f-908c-b3865fee1414]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:48:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-92197552-9c73-44d4-b346-887808715ce5 tempest-VolumesSnapshotListTestJSON-1862510598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.87f9490d-4166-4273-a1c3-a0814396768f {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:50 devstack sudo[88372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.87f9490d-4166-4273-a1c3-a0814396768f
Apr 09 12:48:50 devstack sudo[88372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:50 devstack sudo[88372]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-92197552-9c73-44d4-b346-887808715ce5 tempest-VolumesSnapshotListTestJSON-1862510598 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.87f9490d-4166-4273-a1c3-a0814396768f" returned: 0 in 0.578s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:50 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-92197552-9c73-44d4-b346-887808715ce5 tempest-VolumesSnapshotListTestJSON-1862510598 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6959cf50-f1df-40e5-9629-71b4777f8b49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:48:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-92197552-9c73-44d4-b346-887808715ce5 tempest-VolumesSnapshotListTestJSON-1862510598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.87f9490d-4166-4273-a1c3-a0814396768f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.cbd0c226-8fac-4d42-82cd-197c994bc18a 1G {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:50 devstack sudo[88377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.87f9490d-4166-4273-a1c3-a0814396768f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.cbd0c226-8fac-4d42-82cd-197c994bc18a 1G
Apr 09 12:48:50 devstack sudo[88377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d5d9373f-a185-48b7-b4f2-5a0eae6052fa tempest-VolumesDeleteCascade-90985742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:48:51 devstack sudo[88377]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-92197552-9c73-44d4-b346-887808715ce5 tempest-VolumesSnapshotListTestJSON-1862510598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.87f9490d-4166-4273-a1c3-a0814396768f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.cbd0c226-8fac-4d42-82cd-197c994bc18a 1G" returned: 0 in 0.640s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-92197552-9c73-44d4-b346-887808715ce5 tempest-VolumesSnapshotListTestJSON-1862510598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6959cf50-f1df-40e5-9629-71b4777f8b49.87f9490d-4166-4273-a1c3-a0814396768f -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.cbd0c226-8fac-4d42-82cd-197c994bc18a {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:51 devstack sudo[88382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6959cf50-f1df-40e5-9629-71b4777f8b49.87f9490d-4166-4273-a1c3-a0814396768f -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.cbd0c226-8fac-4d42-82cd-197c994bc18a
Apr 09 12:48:51 devstack sudo[88382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:52 devstack sudo[88382]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-92197552-9c73-44d4-b346-887808715ce5 tempest-VolumesSnapshotListTestJSON-1862510598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6959cf50-f1df-40e5-9629-71b4777f8b49.87f9490d-4166-4273-a1c3-a0814396768f -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.cbd0c226-8fac-4d42-82cd-197c994bc18a" returned: 0 in 0.603s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:52 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-92197552-9c73-44d4-b346-887808715ce5 tempest-VolumesSnapshotListTestJSON-1862510598 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.cbd0c226-8fac-4d42-82cd-197c994bc18a is being set with open permissions: ugo+rw
Apr 09 12:48:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-92197552-9c73-44d4-b346-887808715ce5 tempest-VolumesSnapshotListTestJSON-1862510598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.cbd0c226-8fac-4d42-82cd-197c994bc18a {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:52 devstack sudo[88387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.cbd0c226-8fac-4d42-82cd-197c994bc18a
Apr 09 12:48:52 devstack sudo[88387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:52 devstack sudo[88387]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-92197552-9c73-44d4-b346-887808715ce5 tempest-VolumesSnapshotListTestJSON-1862510598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.cbd0c226-8fac-4d42-82cd-197c994bc18a" returned: 0 in 0.506s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-92197552-9c73-44d4-b346-887808715ce5 tempest-VolumesSnapshotListTestJSON-1862510598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.424s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:48:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d5d9373f-a185-48b7-b4f2-5a0eae6052fa tempest-VolumesDeleteCascade-90985742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.535s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:48:52 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-92197552-9c73-44d4-b346-887808715ce5 tempest-VolumesSnapshotListTestJSON-1862510598 None] Create snapshot completed successfully
Apr 09 12:48:52 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-d5d9373f-a185-48b7-b4f2-5a0eae6052fa tempest-VolumesDeleteCascade-90985742 None] Creating offline snapshot 91c5c93f-bf70-4dbb-8b80-1b9bfdda1807 of volume 088393ba-9ee1-4f25-9508-d03ba90c65f0 {{(pid=82760) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 12:48:52 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[22bc9140-ae4c-404c-886d-43c88aded79a]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:48:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d5d9373f-a185-48b7-b4f2-5a0eae6052fa tempest-VolumesDeleteCascade-90985742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.994828b7-15f4-460d-a999-416f71218711 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:52 devstack sudo[88391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.994828b7-15f4-460d-a999-416f71218711
Apr 09 12:48:52 devstack sudo[88391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:53 devstack sudo[88391]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d5d9373f-a185-48b7-b4f2-5a0eae6052fa tempest-VolumesDeleteCascade-90985742 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.994828b7-15f4-460d-a999-416f71218711" returned: 0 in 0.598s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:53 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-d5d9373f-a185-48b7-b4f2-5a0eae6052fa tempest-VolumesDeleteCascade-90985742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-088393ba-9ee1-4f25-9508-d03ba90c65f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:48:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d5d9373f-a185-48b7-b4f2-5a0eae6052fa tempest-VolumesDeleteCascade-90985742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.994828b7-15f4-460d-a999-416f71218711,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.91c5c93f-bf70-4dbb-8b80-1b9bfdda1807 1G {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:53 devstack sudo[88399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.994828b7-15f4-460d-a999-416f71218711,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.91c5c93f-bf70-4dbb-8b80-1b9bfdda1807 1G
Apr 09 12:48:53 devstack sudo[88399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:53 devstack sudo[88399]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d5d9373f-a185-48b7-b4f2-5a0eae6052fa tempest-VolumesDeleteCascade-90985742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.994828b7-15f4-460d-a999-416f71218711,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.91c5c93f-bf70-4dbb-8b80-1b9bfdda1807 1G" returned: 0 in 0.741s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d5d9373f-a185-48b7-b4f2-5a0eae6052fa tempest-VolumesDeleteCascade-90985742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.994828b7-15f4-460d-a999-416f71218711 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.91c5c93f-bf70-4dbb-8b80-1b9bfdda1807 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:54 devstack sudo[88418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.994828b7-15f4-460d-a999-416f71218711 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.91c5c93f-bf70-4dbb-8b80-1b9bfdda1807
Apr 09 12:48:54 devstack sudo[88418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:54 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-0ea17309-09ed-4e45-bede-b77380130585 tempest-VolumesSnapshotListTestJSON-1862510598 None] Acquiring lock "cinder-cbd0c226-8fac-4d42-82cd-197c994bc18a-delete_snapshot" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:48:54 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-0ea17309-09ed-4e45-bede-b77380130585 tempest-VolumesSnapshotListTestJSON-1862510598 None] Lock "cinder-cbd0c226-8fac-4d42-82cd-197c994bc18a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:48:54 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-0ea17309-09ed-4e45-bede-b77380130585 tempest-VolumesSnapshotListTestJSON-1862510598 None] Acquiring lock "cinder-quobyte-6959cf50-f1df-40e5-9629-71b4777f8b49" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:48:54 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-0ea17309-09ed-4e45-bede-b77380130585 tempest-VolumesSnapshotListTestJSON-1862510598 None] Lock "cinder-quobyte-6959cf50-f1df-40e5-9629-71b4777f8b49" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:48:54 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-0ea17309-09ed-4e45-bede-b77380130585 tempest-VolumesSnapshotListTestJSON-1862510598 None] Acquiring lock "cinder-quobyte-cbd0c226-8fac-4d42-82cd-197c994bc18a" by "_delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:48:54 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-0ea17309-09ed-4e45-bede-b77380130585 tempest-VolumesSnapshotListTestJSON-1862510598 None] Lock "cinder-quobyte-cbd0c226-8fac-4d42-82cd-197c994bc18a" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:48:54 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-0ea17309-09ed-4e45-bede-b77380130585 tempest-VolumesSnapshotListTestJSON-1862510598 None] Deleting offline snapshot cbd0c226-8fac-4d42-82cd-197c994bc18a of volume 6959cf50-f1df-40e5-9629-71b4777f8b49 {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 12:48:54 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-0ea17309-09ed-4e45-bede-b77380130585 tempest-VolumesSnapshotListTestJSON-1862510598 None] snapshot_file for this snap is: volume-6959cf50-f1df-40e5-9629-71b4777f8b49.cbd0c226-8fac-4d42-82cd-197c994bc18a {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 12:48:54 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ca6039-92d4-4bc9-988e-6c9899927892]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:48:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-0ea17309-09ed-4e45-bede-b77380130585 tempest-VolumesSnapshotListTestJSON-1862510598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.cbd0c226-8fac-4d42-82cd-197c994bc18a {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:54 devstack sudo[88420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.cbd0c226-8fac-4d42-82cd-197c994bc18a
Apr 09 12:48:54 devstack sudo[88420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:54 devstack sudo[88418]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d5d9373f-a185-48b7-b4f2-5a0eae6052fa tempest-VolumesDeleteCascade-90985742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.994828b7-15f4-460d-a999-416f71218711 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.91c5c93f-bf70-4dbb-8b80-1b9bfdda1807" returned: 0 in 0.525s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:54 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-d5d9373f-a185-48b7-b4f2-5a0eae6052fa tempest-VolumesDeleteCascade-90985742 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.91c5c93f-bf70-4dbb-8b80-1b9bfdda1807 is being set with open permissions: ugo+rw
Apr 09 12:48:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d5d9373f-a185-48b7-b4f2-5a0eae6052fa tempest-VolumesDeleteCascade-90985742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.91c5c93f-bf70-4dbb-8b80-1b9bfdda1807 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:54 devstack sudo[88425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.91c5c93f-bf70-4dbb-8b80-1b9bfdda1807
Apr 09 12:48:54 devstack sudo[88425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:54 devstack sudo[88420]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-0ea17309-09ed-4e45-bede-b77380130585 tempest-VolumesSnapshotListTestJSON-1862510598 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.cbd0c226-8fac-4d42-82cd-197c994bc18a" returned: 0 in 0.615s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:54 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-0ea17309-09ed-4e45-bede-b77380130585 tempest-VolumesSnapshotListTestJSON-1862510598 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6959cf50-f1df-40e5-9629-71b4777f8b49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:48:54 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[142fa058-0a9f-455d-bc36-e1f74ba0c9aa]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:48:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-0ea17309-09ed-4e45-bede-b77380130585 tempest-VolumesSnapshotListTestJSON-1862510598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.87f9490d-4166-4273-a1c3-a0814396768f {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:55 devstack sudo[88425]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d5d9373f-a185-48b7-b4f2-5a0eae6052fa tempest-VolumesDeleteCascade-90985742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.91c5c93f-bf70-4dbb-8b80-1b9bfdda1807" returned: 0 in 0.496s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d5d9373f-a185-48b7-b4f2-5a0eae6052fa tempest-VolumesDeleteCascade-90985742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.451s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:48:55 devstack sudo[88431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.87f9490d-4166-4273-a1c3-a0814396768f
Apr 09 12:48:55 devstack sudo[88431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:55 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-d5d9373f-a185-48b7-b4f2-5a0eae6052fa tempest-VolumesDeleteCascade-90985742 None] Create snapshot completed successfully
Apr 09 12:48:55 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] Acquiring lock "cinder-088393ba-9ee1-4f25-9508-d03ba90c65f0-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:48:55 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] Lock "cinder-088393ba-9ee1-4f25-9508-d03ba90c65f0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:48:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] Performing cascade delete. {{(pid=82760) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 09 12:48:55 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] Acquiring lock "cinder-91c5c93f-bf70-4dbb-8b80-1b9bfdda1807-delete_snapshot" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:48:55 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] Lock "cinder-91c5c93f-bf70-4dbb-8b80-1b9bfdda1807-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:48:55 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] Acquiring lock "cinder-quobyte-088393ba-9ee1-4f25-9508-d03ba90c65f0" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:48:55 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] Lock "cinder-quobyte-088393ba-9ee1-4f25-9508-d03ba90c65f0" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:48:55 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] Acquiring lock "cinder-quobyte-91c5c93f-bf70-4dbb-8b80-1b9bfdda1807" by "_delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:48:55 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] Lock "cinder-quobyte-91c5c93f-bf70-4dbb-8b80-1b9bfdda1807" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:48:55 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] Deleting offline snapshot 91c5c93f-bf70-4dbb-8b80-1b9bfdda1807 of volume 088393ba-9ee1-4f25-9508-d03ba90c65f0 {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 12:48:55 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] snapshot_file for this snap is: volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.91c5c93f-bf70-4dbb-8b80-1b9bfdda1807 {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 12:48:55 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ebb57b-6d77-4fa7-aa86-f26a00e62824]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:48:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.91c5c93f-bf70-4dbb-8b80-1b9bfdda1807 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:55 devstack sudo[88431]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:55 devstack sudo[88433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.91c5c93f-bf70-4dbb-8b80-1b9bfdda1807
Apr 09 12:48:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-0ea17309-09ed-4e45-bede-b77380130585 tempest-VolumesSnapshotListTestJSON-1862510598 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.87f9490d-4166-4273-a1c3-a0814396768f" returned: 0 in 0.578s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:55 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-0ea17309-09ed-4e45-bede-b77380130585 tempest-VolumesSnapshotListTestJSON-1862510598 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6959cf50-f1df-40e5-9629-71b4777f8b49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:48:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-0ea17309-09ed-4e45-bede-b77380130585 tempest-VolumesSnapshotListTestJSON-1862510598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.cbd0c226-8fac-4d42-82cd-197c994bc18a {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:55 devstack sudo[88433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:55 devstack sudo[88438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.cbd0c226-8fac-4d42-82cd-197c994bc18a
Apr 09 12:48:55 devstack sudo[88438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:56 devstack sudo[88433]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.91c5c93f-bf70-4dbb-8b80-1b9bfdda1807" returned: 0 in 0.637s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:56 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-088393ba-9ee1-4f25-9508-d03ba90c65f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:48:56 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13e30d7-4990-4d29-bb52-485bd566a7f6]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:48:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.994828b7-15f4-460d-a999-416f71218711 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:56 devstack sudo[88438]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-0ea17309-09ed-4e45-bede-b77380130585 tempest-VolumesSnapshotListTestJSON-1862510598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.cbd0c226-8fac-4d42-82cd-197c994bc18a" returned: 0 in 0.615s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-0ea17309-09ed-4e45-bede-b77380130585 tempest-VolumesSnapshotListTestJSON-1862510598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.cbd0c226-8fac-4d42-82cd-197c994bc18a {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:56 devstack sudo[88447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.cbd0c226-8fac-4d42-82cd-197c994bc18a
Apr 09 12:48:56 devstack sudo[88447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:56 devstack sudo[88446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.994828b7-15f4-460d-a999-416f71218711
Apr 09 12:48:56 devstack sudo[88446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:56 devstack sudo[88446]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.994828b7-15f4-460d-a999-416f71218711" returned: 0 in 0.637s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:56 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-088393ba-9ee1-4f25-9508-d03ba90c65f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:48:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.91c5c93f-bf70-4dbb-8b80-1b9bfdda1807 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:56 devstack sudo[88457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.91c5c93f-bf70-4dbb-8b80-1b9bfdda1807
Apr 09 12:48:56 devstack sudo[88457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:56 devstack sudo[88447]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-0ea17309-09ed-4e45-bede-b77380130585 tempest-VolumesSnapshotListTestJSON-1862510598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.cbd0c226-8fac-4d42-82cd-197c994bc18a" returned: 0 in 0.627s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:56 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-0ea17309-09ed-4e45-bede-b77380130585 tempest-VolumesSnapshotListTestJSON-1862510598 None] Lock "cinder-quobyte-cbd0c226-8fac-4d42-82cd-197c994bc18a" released by "_delete_snapshot" :: held 2.507s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:48:56 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-0ea17309-09ed-4e45-bede-b77380130585 tempest-VolumesSnapshotListTestJSON-1862510598 None] Lock "cinder-quobyte-6959cf50-f1df-40e5-9629-71b4777f8b49" released by "delete_snapshot" :: held 2.523s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:48:56 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-0ea17309-09ed-4e45-bede-b77380130585 tempest-VolumesSnapshotListTestJSON-1862510598 None] Created reservations ['e1237c1f-18bd-4e82-9223-b7cd0d7e1d15', '72f0a8de-1810-4c6e-bd7c-3e4c555614ee', '26b3f6e7-4a4b-42f7-8acb-77679177a5e6', 'c0fa617b-979c-4e8c-a5a2-3f116e858c2c'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:48:56 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-0ea17309-09ed-4e45-bede-b77380130585 tempest-VolumesSnapshotListTestJSON-1862510598 None] Delete snapshot completed successfully.
Apr 09 12:48:56 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-0ea17309-09ed-4e45-bede-b77380130585 tempest-VolumesSnapshotListTestJSON-1862510598 None] Lock "cinder-cbd0c226-8fac-4d42-82cd-197c994bc18a-delete_snapshot" released by "delete_snapshot" :: held 2.654s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:48:57 devstack sudo[88457]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.91c5c93f-bf70-4dbb-8b80-1b9bfdda1807" returned: 0 in 0.607s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.91c5c93f-bf70-4dbb-8b80-1b9bfdda1807 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:57 devstack sudo[88462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.91c5c93f-bf70-4dbb-8b80-1b9bfdda1807
Apr 09 12:48:57 devstack sudo[88462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:57 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-9f668267-bdef-46ed-8f82-b7515490770a tempest-VolumesSnapshotListTestJSON-1862510598 None] Acquiring lock "cinder-87f9490d-4166-4273-a1c3-a0814396768f-delete_snapshot" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:48:57 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-9f668267-bdef-46ed-8f82-b7515490770a tempest-VolumesSnapshotListTestJSON-1862510598 None] Lock "cinder-87f9490d-4166-4273-a1c3-a0814396768f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:48:57 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-9f668267-bdef-46ed-8f82-b7515490770a tempest-VolumesSnapshotListTestJSON-1862510598 None] Acquiring lock "cinder-quobyte-6959cf50-f1df-40e5-9629-71b4777f8b49" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:48:57 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-9f668267-bdef-46ed-8f82-b7515490770a tempest-VolumesSnapshotListTestJSON-1862510598 None] Lock "cinder-quobyte-6959cf50-f1df-40e5-9629-71b4777f8b49" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:48:57 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-9f668267-bdef-46ed-8f82-b7515490770a tempest-VolumesSnapshotListTestJSON-1862510598 None] Acquiring lock "cinder-quobyte-87f9490d-4166-4273-a1c3-a0814396768f" by "_delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:48:57 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-9f668267-bdef-46ed-8f82-b7515490770a tempest-VolumesSnapshotListTestJSON-1862510598 None] Lock "cinder-quobyte-87f9490d-4166-4273-a1c3-a0814396768f" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:48:57 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-9f668267-bdef-46ed-8f82-b7515490770a tempest-VolumesSnapshotListTestJSON-1862510598 None] Deleting offline snapshot 87f9490d-4166-4273-a1c3-a0814396768f of volume 6959cf50-f1df-40e5-9629-71b4777f8b49 {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 12:48:57 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-9f668267-bdef-46ed-8f82-b7515490770a tempest-VolumesSnapshotListTestJSON-1862510598 None] snapshot_file for this snap is: volume-6959cf50-f1df-40e5-9629-71b4777f8b49.87f9490d-4166-4273-a1c3-a0814396768f {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 12:48:57 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77cbf79-42d0-4f47-948e-8d2e38d3c140]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:48:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9f668267-bdef-46ed-8f82-b7515490770a tempest-VolumesSnapshotListTestJSON-1862510598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.87f9490d-4166-4273-a1c3-a0814396768f {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:57 devstack sudo[88464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.87f9490d-4166-4273-a1c3-a0814396768f
Apr 09 12:48:57 devstack sudo[88464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:57 devstack sudo[88462]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.91c5c93f-bf70-4dbb-8b80-1b9bfdda1807" returned: 0 in 0.454s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:57 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] Lock "cinder-quobyte-91c5c93f-bf70-4dbb-8b80-1b9bfdda1807" released by "_delete_snapshot" :: held 2.403s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:48:57 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] Lock "cinder-quobyte-088393ba-9ee1-4f25-9508-d03ba90c65f0" released by "delete_snapshot" :: held 2.422s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:48:57 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] Created reservations ['02df98ff-24af-46e9-8474-7884b50a29ff', '06998675-af04-4419-a3b4-59893ad375e4', 'd2975b80-4712-4aed-bc29-79d3cdb74770', 'bafb21f9-2460-4de1-b9d8-6bd484150418'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:48:57 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] Delete snapshot completed successfully.
Apr 09 12:48:57 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] Lock "cinder-91c5c93f-bf70-4dbb-8b80-1b9bfdda1807-delete_snapshot" released by "delete_snapshot" :: held 2.573s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:48:57 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] Acquiring lock "cinder-994828b7-15f4-460d-a999-416f71218711-delete_snapshot" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:48:57 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] Lock "cinder-994828b7-15f4-460d-a999-416f71218711-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:48:57 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] Acquiring lock "cinder-quobyte-088393ba-9ee1-4f25-9508-d03ba90c65f0" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:48:57 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] Lock "cinder-quobyte-088393ba-9ee1-4f25-9508-d03ba90c65f0" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:48:57 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] Acquiring lock "cinder-quobyte-994828b7-15f4-460d-a999-416f71218711" by "_delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:48:57 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] Lock "cinder-quobyte-994828b7-15f4-460d-a999-416f71218711" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:48:57 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] Deleting offline snapshot 994828b7-15f4-460d-a999-416f71218711 of volume 088393ba-9ee1-4f25-9508-d03ba90c65f0 {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 12:48:57 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] snapshot_file for this snap is: volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.994828b7-15f4-460d-a999-416f71218711 {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 12:48:57 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44bbd40-38b4-403e-aa3b-0fc46b9d117f]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:48:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.994828b7-15f4-460d-a999-416f71218711 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:58 devstack sudo[88468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.994828b7-15f4-460d-a999-416f71218711
Apr 09 12:48:58 devstack sudo[88468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:58 devstack sudo[88464]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9f668267-bdef-46ed-8f82-b7515490770a tempest-VolumesSnapshotListTestJSON-1862510598 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.87f9490d-4166-4273-a1c3-a0814396768f" returned: 0 in 0.638s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:58 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-9f668267-bdef-46ed-8f82-b7515490770a tempest-VolumesSnapshotListTestJSON-1862510598 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6959cf50-f1df-40e5-9629-71b4777f8b49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:48:58 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eadf814-1e2d-444c-b0d8-eb9537893fa1]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:48:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9f668267-bdef-46ed-8f82-b7515490770a tempest-VolumesSnapshotListTestJSON-1862510598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.0f882072-6f26-49ab-9bce-5091669a6092 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:58 devstack sudo[88497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.0f882072-6f26-49ab-9bce-5091669a6092
Apr 09 12:48:58 devstack sudo[88497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:58 devstack sudo[88468]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.994828b7-15f4-460d-a999-416f71218711" returned: 0 in 0.808s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:58 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-088393ba-9ee1-4f25-9508-d03ba90c65f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:48:58 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4a9041-387a-44ca-80a6-1d80ac8597a6]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:48:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:58 devstack sudo[88508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0
Apr 09 12:48:58 devstack sudo[88508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:58 devstack sudo[88497]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9f668267-bdef-46ed-8f82-b7515490770a tempest-VolumesSnapshotListTestJSON-1862510598 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.0f882072-6f26-49ab-9bce-5091669a6092" returned: 0 in 0.740s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:58 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-9f668267-bdef-46ed-8f82-b7515490770a tempest-VolumesSnapshotListTestJSON-1862510598 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6959cf50-f1df-40e5-9629-71b4777f8b49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:48:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9f668267-bdef-46ed-8f82-b7515490770a tempest-VolumesSnapshotListTestJSON-1862510598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.87f9490d-4166-4273-a1c3-a0814396768f {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:59 devstack sudo[88510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.87f9490d-4166-4273-a1c3-a0814396768f
Apr 09 12:48:59 devstack sudo[88510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:59 devstack sudo[88508]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:59 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0" returned: 0 in 0.627s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:59 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.994828b7-15f4-460d-a999-416f71218711 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:59 devstack sudo[88518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.994828b7-15f4-460d-a999-416f71218711
Apr 09 12:48:59 devstack sudo[88518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:48:59 devstack sudo[88510]: pam_unix(sudo:session): session closed for user root
Apr 09 12:48:59 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9f668267-bdef-46ed-8f82-b7515490770a tempest-VolumesSnapshotListTestJSON-1862510598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.87f9490d-4166-4273-a1c3-a0814396768f" returned: 0 in 0.557s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:48:59 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9f668267-bdef-46ed-8f82-b7515490770a tempest-VolumesSnapshotListTestJSON-1862510598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.87f9490d-4166-4273-a1c3-a0814396768f {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:48:59 devstack sudo[88520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.87f9490d-4166-4273-a1c3-a0814396768f
Apr 09 12:48:59 devstack sudo[88520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:00 devstack sudo[88518]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.994828b7-15f4-460d-a999-416f71218711" returned: 0 in 0.566s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.994828b7-15f4-460d-a999-416f71218711 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:00 devstack sudo[88526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.994828b7-15f4-460d-a999-416f71218711
Apr 09 12:49:00 devstack sudo[88526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:00 devstack sudo[88520]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9f668267-bdef-46ed-8f82-b7515490770a tempest-VolumesSnapshotListTestJSON-1862510598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.87f9490d-4166-4273-a1c3-a0814396768f" returned: 0 in 0.579s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:00 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-9f668267-bdef-46ed-8f82-b7515490770a tempest-VolumesSnapshotListTestJSON-1862510598 None] Lock "cinder-quobyte-87f9490d-4166-4273-a1c3-a0814396768f" released by "_delete_snapshot" :: held 2.602s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:49:00 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-9f668267-bdef-46ed-8f82-b7515490770a tempest-VolumesSnapshotListTestJSON-1862510598 None] Lock "cinder-quobyte-6959cf50-f1df-40e5-9629-71b4777f8b49" released by "delete_snapshot" :: held 2.617s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:49:00 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-9f668267-bdef-46ed-8f82-b7515490770a tempest-VolumesSnapshotListTestJSON-1862510598 None] Created reservations ['6f66505b-b4c6-4520-8f5e-f9795aed4aae', 'e47329b7-16ca-42e1-83f4-8e747a823f85', '24dcf260-c29e-4325-87e7-d65186773c5b', 'b8904d9f-618c-4918-8e82-3b0b872e6d60'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:49:00 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-9f668267-bdef-46ed-8f82-b7515490770a tempest-VolumesSnapshotListTestJSON-1862510598 None] Delete snapshot completed successfully.
Apr 09 12:49:00 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-9f668267-bdef-46ed-8f82-b7515490770a tempest-VolumesSnapshotListTestJSON-1862510598 None] Lock "cinder-87f9490d-4166-4273-a1c3-a0814396768f-delete_snapshot" released by "delete_snapshot" :: held 2.717s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:49:00 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-2fb3c393-789d-4232-b28d-1f4fd8602796 tempest-VolumesActionsTest-2093358557 None] Acquiring lock "cinder-ca2d894e-5587-4797-9daa-d4fe29c9414d" by "attach_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:49:00 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-2fb3c393-789d-4232-b28d-1f4fd8602796 tempest-VolumesActionsTest-2093358557 None] Lock "cinder-ca2d894e-5587-4797-9daa-d4fe29c9414d" acquired by "attach_volume" :: waited 0.008s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:49:00 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-2fb3c393-789d-4232-b28d-1f4fd8602796 tempest-VolumesActionsTest-2093358557 None] Attaching volume ca2d894e-5587-4797-9daa-d4fe29c9414d to instance 0dbf95cf-277c-49a6-9f6a-0eed8f8ea719 at mountpoint /dev/vdb on host None.
Apr 09 12:49:00 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-2fb3c393-789d-4232-b28d-1f4fd8602796 tempest-VolumesActionsTest-2093358557 None] Attach volume completed successfully.
Apr 09 12:49:00 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-2fb3c393-789d-4232-b28d-1f4fd8602796 tempest-VolumesActionsTest-2093358557 None] Lock "cinder-ca2d894e-5587-4797-9daa-d4fe29c9414d" released by "attach_volume" :: held 0.057s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:49:00 devstack sudo[88526]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0.994828b7-15f4-460d-a999-416f71218711" returned: 0 in 0.482s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:00 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] Lock "cinder-quobyte-994828b7-15f4-460d-a999-416f71218711" released by "_delete_snapshot" :: held 2.553s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:49:00 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] Lock "cinder-quobyte-088393ba-9ee1-4f25-9508-d03ba90c65f0" released by "delete_snapshot" :: held 2.567s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:49:00 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] Created reservations ['80fb8b40-41f6-4da0-9afa-07b01a922bbf', '639efcb7-0c91-41b6-b178-72ab19e6737c', 'd16a9ca3-a222-427e-aa8f-c6395a9adfb6', 'baeb1fe2-3256-484f-a030-3200e5ccc0dd'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:49:00 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] Delete snapshot completed successfully.
Apr 09 12:49:00 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] Lock "cinder-994828b7-15f4-460d-a999-416f71218711-delete_snapshot" released by "delete_snapshot" :: held 2.660s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:49:00 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] Snapshots deleted, issuing volume delete {{(pid=82760) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 09 12:49:00 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] Acquiring lock "cinder-quobyte-088393ba-9ee1-4f25-9508-d03ba90c65f0" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:49:00 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] Lock "cinder-quobyte-088393ba-9ee1-4f25-9508-d03ba90c65f0" acquired by "delete_volume" :: waited 0.007s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:49:00 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[72287f0d-deb8-465a-a626-07bd5ce89f01]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:49:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:00 devstack sudo[88529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0
Apr 09 12:49:00 devstack sudo[88529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:00 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ec490d5e-fdde-4f8f-b1d2-c6a22c6210fb tempest-VolumesSnapshotListTestJSON-1862510598 None] Acquiring lock "cinder-0f882072-6f26-49ab-9bce-5091669a6092-delete_snapshot" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:49:00 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ec490d5e-fdde-4f8f-b1d2-c6a22c6210fb tempest-VolumesSnapshotListTestJSON-1862510598 None] Lock "cinder-0f882072-6f26-49ab-9bce-5091669a6092-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:49:00 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ec490d5e-fdde-4f8f-b1d2-c6a22c6210fb tempest-VolumesSnapshotListTestJSON-1862510598 None] Acquiring lock "cinder-quobyte-6959cf50-f1df-40e5-9629-71b4777f8b49" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:49:00 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ec490d5e-fdde-4f8f-b1d2-c6a22c6210fb tempest-VolumesSnapshotListTestJSON-1862510598 None] Lock "cinder-quobyte-6959cf50-f1df-40e5-9629-71b4777f8b49" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:49:00 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ec490d5e-fdde-4f8f-b1d2-c6a22c6210fb tempest-VolumesSnapshotListTestJSON-1862510598 None] Acquiring lock "cinder-quobyte-0f882072-6f26-49ab-9bce-5091669a6092" by "_delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:49:00 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ec490d5e-fdde-4f8f-b1d2-c6a22c6210fb tempest-VolumesSnapshotListTestJSON-1862510598 None] Lock "cinder-quobyte-0f882072-6f26-49ab-9bce-5091669a6092" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:49:00 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-ec490d5e-fdde-4f8f-b1d2-c6a22c6210fb tempest-VolumesSnapshotListTestJSON-1862510598 None] Deleting offline snapshot 0f882072-6f26-49ab-9bce-5091669a6092 of volume 6959cf50-f1df-40e5-9629-71b4777f8b49 {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 12:49:00 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-ec490d5e-fdde-4f8f-b1d2-c6a22c6210fb tempest-VolumesSnapshotListTestJSON-1862510598 None] snapshot_file for this snap is: volume-6959cf50-f1df-40e5-9629-71b4777f8b49.0f882072-6f26-49ab-9bce-5091669a6092 {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 12:49:00 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d8fcae-9777-4114-9b08-1a1962fbdd9b]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:49:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ec490d5e-fdde-4f8f-b1d2-c6a22c6210fb tempest-VolumesSnapshotListTestJSON-1862510598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.0f882072-6f26-49ab-9bce-5091669a6092 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:00 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-e75d498a-1ce7-441c-b62c-826a7b819994 tempest-VolumesActionsTest-2093358557 None] Acquiring lock "cinder-ca2d894e-5587-4797-9daa-d4fe29c9414d-detach_volume" by "detach_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:49:00 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-e75d498a-1ce7-441c-b62c-826a7b819994 tempest-VolumesActionsTest-2093358557 None] Lock "cinder-ca2d894e-5587-4797-9daa-d4fe29c9414d-detach_volume" acquired by "detach_volume" :: waited 0.011s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:49:00 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-e75d498a-1ce7-441c-b62c-826a7b819994 tempest-VolumesActionsTest-2093358557 None] Detaching volume ca2d894e-5587-4797-9daa-d4fe29c9414d from instance 0dbf95cf-277c-49a6-9f6a-0eed8f8ea719.
Apr 09 12:49:00 devstack sudo[88531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.0f882072-6f26-49ab-9bce-5091669a6092
Apr 09 12:49:00 devstack sudo[88531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:00 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-e75d498a-1ce7-441c-b62c-826a7b819994 tempest-VolumesActionsTest-2093358557 None] Detach volume completed successfully.
Apr 09 12:49:00 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-e75d498a-1ce7-441c-b62c-826a7b819994 tempest-VolumesActionsTest-2093358557 None] Lock "cinder-ca2d894e-5587-4797-9daa-d4fe29c9414d-detach_volume" released by "detach_volume" :: held 0.041s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:49:01 devstack sudo[88529]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0" returned: 0 in 0.676s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:01 devstack sudo[88539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0
Apr 09 12:49:01 devstack sudo[88539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:01 devstack sudo[88531]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ec490d5e-fdde-4f8f-b1d2-c6a22c6210fb tempest-VolumesSnapshotListTestJSON-1862510598 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.0f882072-6f26-49ab-9bce-5091669a6092" returned: 0 in 0.483s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:01 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-ec490d5e-fdde-4f8f-b1d2-c6a22c6210fb tempest-VolumesSnapshotListTestJSON-1862510598 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6959cf50-f1df-40e5-9629-71b4777f8b49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:49:01 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[282935c4-e574-4bfc-a88d-48a095e21bea]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:49:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ec490d5e-fdde-4f8f-b1d2-c6a22c6210fb tempest-VolumesSnapshotListTestJSON-1862510598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:01 devstack sudo[88541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49
Apr 09 12:49:01 devstack sudo[88541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:01 devstack sudo[88539]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-088393ba-9ee1-4f25-9508-d03ba90c65f0" returned: 0 in 0.512s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:01 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] Lock "cinder-quobyte-088393ba-9ee1-4f25-9508-d03ba90c65f0" released by "delete_volume" :: held 1.224s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:49:01 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] Created reservations ['d461ac51-eaff-48d4-b2fc-dd2ce02e303d', 'be2b4635-0ed0-48a9-9b8b-f6f1d034b42b', '10451f26-9d46-456a-a2cc-04e0edf9f1b3', 'd3a989b8-97e5-42ff-8aab-22404f186f74'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:49:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:49:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:49:01 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:49:01 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:49:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:49:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:01 devstack sudo[88547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:49:01 devstack sudo[88547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:02 devstack sudo[88541]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ec490d5e-fdde-4f8f-b1d2-c6a22c6210fb tempest-VolumesSnapshotListTestJSON-1862510598 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49" returned: 0 in 0.714s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ec490d5e-fdde-4f8f-b1d2-c6a22c6210fb tempest-VolumesSnapshotListTestJSON-1862510598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.0f882072-6f26-49ab-9bce-5091669a6092 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:02 devstack sudo[88550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.0f882072-6f26-49ab-9bce-5091669a6092
Apr 09 12:49:02 devstack sudo[88550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:02 devstack sudo[88547]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.459s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:02 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:49:02 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] Deleted volume successfully.
Apr 09 12:49:02 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-4e441612-5d20-45a9-a1f3-ab7844d272fb tempest-VolumesDeleteCascade-90985742 None] Lock "cinder-088393ba-9ee1-4f25-9508-d03ba90c65f0-delete_volume" released by "delete_volume" :: held 7.122s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:49:02 devstack sudo[88550]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ec490d5e-fdde-4f8f-b1d2-c6a22c6210fb tempest-VolumesSnapshotListTestJSON-1862510598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.0f882072-6f26-49ab-9bce-5091669a6092" returned: 0 in 0.506s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ec490d5e-fdde-4f8f-b1d2-c6a22c6210fb tempest-VolumesSnapshotListTestJSON-1862510598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.0f882072-6f26-49ab-9bce-5091669a6092 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:02 devstack sudo[88557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.0f882072-6f26-49ab-9bce-5091669a6092
Apr 09 12:49:02 devstack sudo[88557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:03 devstack sudo[88557]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ec490d5e-fdde-4f8f-b1d2-c6a22c6210fb tempest-VolumesSnapshotListTestJSON-1862510598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49.0f882072-6f26-49ab-9bce-5091669a6092" returned: 0 in 0.507s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:03 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ec490d5e-fdde-4f8f-b1d2-c6a22c6210fb tempest-VolumesSnapshotListTestJSON-1862510598 None] Lock "cinder-quobyte-0f882072-6f26-49ab-9bce-5091669a6092" released by "_delete_snapshot" :: held 2.309s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:49:03 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ec490d5e-fdde-4f8f-b1d2-c6a22c6210fb tempest-VolumesSnapshotListTestJSON-1862510598 None] Lock "cinder-quobyte-6959cf50-f1df-40e5-9629-71b4777f8b49" released by "delete_snapshot" :: held 2.343s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:49:03 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-ec490d5e-fdde-4f8f-b1d2-c6a22c6210fb tempest-VolumesSnapshotListTestJSON-1862510598 None] Created reservations ['7acc7219-5394-45b5-8e28-25c0c36e453a', '0e290faa-b6e5-4558-bce0-28629cd50fbc', 'd1ad2987-e69d-418d-a03f-5b9543721006', '896c54c7-449a-4beb-83dd-6cc5beac1928'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:49:03 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-ec490d5e-fdde-4f8f-b1d2-c6a22c6210fb tempest-VolumesSnapshotListTestJSON-1862510598 None] Delete snapshot completed successfully.
Apr 09 12:49:03 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ec490d5e-fdde-4f8f-b1d2-c6a22c6210fb tempest-VolumesSnapshotListTestJSON-1862510598 None] Lock "cinder-0f882072-6f26-49ab-9bce-5091669a6092-delete_snapshot" released by "delete_snapshot" :: held 2.456s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:49:03 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-62d43b56-0238-4bf4-bb8d-f8b334de4720 tempest-VolumesDeleteCascade-90985742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:49:03 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-62d43b56-0238-4bf4-bb8d-f8b334de4720 tempest-VolumesDeleteCascade-90985742 None] Flow 'volume_create_manager' (f67866b7-468f-4552-87cf-72a57380c12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:49:03 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-62d43b56-0238-4bf4-bb8d-f8b334de4720 tempest-VolumesDeleteCascade-90985742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90701f4f-ce86-4321-b0fd-aea0d553a7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:03 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-62d43b56-0238-4bf4-bb8d-f8b334de4720 tempest-VolumesDeleteCascade-90985742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90701f4f-ce86-4321-b0fd-aea0d553a7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:49:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2012150061',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbbb6a16-b42b-4555-9ffe-54e525299d63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be0c74dc200343909e5e2d9b7998aac9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:49:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:49:03Z,use_quota=True,user_id='0d0197bc85c7490c9024554e23e4aa42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:03 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-62d43b56-0238-4bf4-bb8d-f8b334de4720 tempest-VolumesDeleteCascade-90985742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7f89252-7644-491b-8a1b-29e3792a029e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:03 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-62d43b56-0238-4bf4-bb8d-f8b334de4720 tempest-VolumesDeleteCascade-90985742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7f89252-7644-491b-8a1b-29e3792a029e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:03 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-62d43b56-0238-4bf4-bb8d-f8b334de4720 tempest-VolumesDeleteCascade-90985742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf35df81-271f-42eb-b737-0e4fc24b83ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:03 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-62d43b56-0238-4bf4-bb8d-f8b334de4720 tempest-VolumesDeleteCascade-90985742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf35df81-271f-42eb-b737-0e4fc24b83ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbbb6a16-b42b-4555-9ffe-54e525299d63', 'volume_name': 'volume-bbbb6a16-b42b-4555-9ffe-54e525299d63', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:03 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-62d43b56-0238-4bf4-bb8d-f8b334de4720 tempest-VolumesDeleteCascade-90985742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bdd5391-c492-4bf0-9136-75d86b91190e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:03 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-62d43b56-0238-4bf4-bb8d-f8b334de4720 tempest-VolumesDeleteCascade-90985742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bdd5391-c492-4bf0-9136-75d86b91190e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:03 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-62d43b56-0238-4bf4-bb8d-f8b334de4720 tempest-VolumesDeleteCascade-90985742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b3b48fe-4d38-41f1-88d5-d33b88915c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:03 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-62d43b56-0238-4bf4-bb8d-f8b334de4720 tempest-VolumesDeleteCascade-90985742 None] Volume bbbb6a16-b42b-4555-9ffe-54e525299d63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbbb6a16-b42b-4555-9ffe-54e525299d63', 'volume_size': 1}
Apr 09 12:49:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-62d43b56-0238-4bf4-bb8d-f8b334de4720 tempest-VolumesDeleteCascade-90985742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:49:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-62d43b56-0238-4bf4-bb8d-f8b334de4720 tempest-VolumesDeleteCascade-90985742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:49:03 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-62d43b56-0238-4bf4-bb8d-f8b334de4720 tempest-VolumesDeleteCascade-90985742 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:49:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2012150061',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbbb6a16-b42b-4555-9ffe-54e525299d63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be0c74dc200343909e5e2d9b7998aac9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:49:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:49:03Z,use_quota=True,user_id='0d0197bc85c7490c9024554e23e4aa42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:49:03 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-62d43b56-0238-4bf4-bb8d-f8b334de4720 tempest-VolumesDeleteCascade-90985742 None] Creating volume bbbb6a16-b42b-4555-9ffe-54e525299d63 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:49:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-62d43b56-0238-4bf4-bb8d-f8b334de4720 tempest-VolumesDeleteCascade-90985742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:49:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-62d43b56-0238-4bf4-bb8d-f8b334de4720 tempest-VolumesDeleteCascade-90985742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:49:03 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-62d43b56-0238-4bf4-bb8d-f8b334de4720 tempest-VolumesDeleteCascade-90985742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:49:03 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-62d43b56-0238-4bf4-bb8d-f8b334de4720 tempest-VolumesDeleteCascade-90985742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:49:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-62d43b56-0238-4bf4-bb8d-f8b334de4720 tempest-VolumesDeleteCascade-90985742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:49:03 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-62d43b56-0238-4bf4-bb8d-f8b334de4720 tempest-VolumesDeleteCascade-90985742 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:49:03 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-62d43b56-0238-4bf4-bb8d-f8b334de4720 tempest-VolumesDeleteCascade-90985742 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:49:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-62d43b56-0238-4bf4-bb8d-f8b334de4720 tempest-VolumesDeleteCascade-90985742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:03 devstack sudo[88589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63 1073741824
Apr 09 12:49:03 devstack sudo[88589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:04 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-d19e3cc7-8a6f-4415-912c-641cc5691566 tempest-VolumesSnapshotListTestJSON-1862510598 None] Acquiring lock "cinder-6959cf50-f1df-40e5-9629-71b4777f8b49-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:49:04 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-d19e3cc7-8a6f-4415-912c-641cc5691566 tempest-VolumesSnapshotListTestJSON-1862510598 None] Lock "cinder-6959cf50-f1df-40e5-9629-71b4777f8b49-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:49:04 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-d19e3cc7-8a6f-4415-912c-641cc5691566 tempest-VolumesSnapshotListTestJSON-1862510598 None] Acquiring lock "cinder-quobyte-6959cf50-f1df-40e5-9629-71b4777f8b49" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:49:04 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-d19e3cc7-8a6f-4415-912c-641cc5691566 tempest-VolumesSnapshotListTestJSON-1862510598 None] Lock "cinder-quobyte-6959cf50-f1df-40e5-9629-71b4777f8b49" acquired by "delete_volume" :: waited 0.008s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:49:04 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[c595fe32-292c-426a-adfc-9ce83f1baf8a]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:49:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d19e3cc7-8a6f-4415-912c-641cc5691566 tempest-VolumesSnapshotListTestJSON-1862510598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:04 devstack sudo[88589]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-62d43b56-0238-4bf4-bb8d-f8b334de4720 tempest-VolumesDeleteCascade-90985742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63 1073741824" returned: 0 in 0.699s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:04 devstack sudo[88595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49
Apr 09 12:49:04 devstack sudo[88595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-62d43b56-0238-4bf4-bb8d-f8b334de4720 tempest-VolumesDeleteCascade-90985742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:04 devstack sudo[88597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63
Apr 09 12:49:04 devstack sudo[88597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:04 devstack sudo[88597]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-62d43b56-0238-4bf4-bb8d-f8b334de4720 tempest-VolumesDeleteCascade-90985742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63" returned: 0 in 0.502s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:04 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-62d43b56-0238-4bf4-bb8d-f8b334de4720 tempest-VolumesDeleteCascade-90985742 None] <== create_volume: return (1239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:49:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-62d43b56-0238-4bf4-bb8d-f8b334de4720 tempest-VolumesDeleteCascade-90985742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:49:04 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-62d43b56-0238-4bf4-bb8d-f8b334de4720 tempest-VolumesDeleteCascade-90985742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b3b48fe-4d38-41f1-88d5-d33b88915c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbbb6a16-b42b-4555-9ffe-54e525299d63', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:04 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-62d43b56-0238-4bf4-bb8d-f8b334de4720 tempest-VolumesDeleteCascade-90985742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6de44d9-64e9-47eb-a988-2219304606a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:04 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-62d43b56-0238-4bf4-bb8d-f8b334de4720 tempest-VolumesDeleteCascade-90985742 None] Volume volume-bbbb6a16-b42b-4555-9ffe-54e525299d63 (bbbb6a16-b42b-4555-9ffe-54e525299d63): created successfully
Apr 09 12:49:04 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-62d43b56-0238-4bf4-bb8d-f8b334de4720 tempest-VolumesDeleteCascade-90985742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6de44d9-64e9-47eb-a988-2219304606a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:04 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-62d43b56-0238-4bf4-bb8d-f8b334de4720 tempest-VolumesDeleteCascade-90985742 None] Flow 'volume_create_manager' (f67866b7-468f-4552-87cf-72a57380c12a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:49:04 devstack sudo[88595]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d19e3cc7-8a6f-4415-912c-641cc5691566 tempest-VolumesSnapshotListTestJSON-1862510598 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49" returned: 0 in 0.639s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d19e3cc7-8a6f-4415-912c-641cc5691566 tempest-VolumesSnapshotListTestJSON-1862510598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:04 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-62d43b56-0238-4bf4-bb8d-f8b334de4720 tempest-VolumesDeleteCascade-90985742 None] Created volume successfully.
Apr 09 12:49:04 devstack sudo[88604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49
Apr 09 12:49:04 devstack sudo[88604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:05 devstack sudo[88604]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d19e3cc7-8a6f-4415-912c-641cc5691566 tempest-VolumesSnapshotListTestJSON-1862510598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6959cf50-f1df-40e5-9629-71b4777f8b49" returned: 0 in 0.498s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:05 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-d19e3cc7-8a6f-4415-912c-641cc5691566 tempest-VolumesSnapshotListTestJSON-1862510598 None] Lock "cinder-quobyte-6959cf50-f1df-40e5-9629-71b4777f8b49" released by "delete_volume" :: held 1.196s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:49:05 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-d19e3cc7-8a6f-4415-912c-641cc5691566 tempest-VolumesSnapshotListTestJSON-1862510598 None] Created reservations ['d7f62ff0-b019-4052-aa3e-3a8bed47ebbd', '8bff1259-7a03-41a5-a556-3444b641986d', '0bf69070-c1ec-4e19-b140-751523d4894f', '53a285dc-dd0f-4794-b1ad-7e8d080054f1'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:49:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d19e3cc7-8a6f-4415-912c-641cc5691566 tempest-VolumesSnapshotListTestJSON-1862510598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:49:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d19e3cc7-8a6f-4415-912c-641cc5691566 tempest-VolumesSnapshotListTestJSON-1862510598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:49:05 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-d19e3cc7-8a6f-4415-912c-641cc5691566 tempest-VolumesSnapshotListTestJSON-1862510598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:49:05 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-d19e3cc7-8a6f-4415-912c-641cc5691566 tempest-VolumesSnapshotListTestJSON-1862510598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:49:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d19e3cc7-8a6f-4415-912c-641cc5691566 tempest-VolumesSnapshotListTestJSON-1862510598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:49:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d19e3cc7-8a6f-4415-912c-641cc5691566 tempest-VolumesSnapshotListTestJSON-1862510598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:05 devstack sudo[88607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:49:05 devstack sudo[88607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-3c706544-b54d-4397-9d7b-1d3d619eff59 tempest-VolumesDeleteCascade-90985742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:49:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-3c706544-b54d-4397-9d7b-1d3d619eff59 tempest-VolumesDeleteCascade-90985742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:49:05 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-3c706544-b54d-4397-9d7b-1d3d619eff59 tempest-VolumesDeleteCascade-90985742 None] Creating offline snapshot 666a9630-5e07-4bce-b8ff-0b92574849f9 of volume bbbb6a16-b42b-4555-9ffe-54e525299d63 {{(pid=82760) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 12:49:05 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf10d75-8f59-4188-b7c1-534405c09190]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:49:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-3c706544-b54d-4397-9d7b-1d3d619eff59 tempest-VolumesDeleteCascade-90985742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:05 devstack sudo[88609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63
Apr 09 12:49:05 devstack sudo[88609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:05 devstack sudo[88607]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d19e3cc7-8a6f-4415-912c-641cc5691566 tempest-VolumesSnapshotListTestJSON-1862510598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.541s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:05 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-d19e3cc7-8a6f-4415-912c-641cc5691566 tempest-VolumesSnapshotListTestJSON-1862510598 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:49:05 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-d19e3cc7-8a6f-4415-912c-641cc5691566 tempest-VolumesSnapshotListTestJSON-1862510598 None] Deleted volume successfully.
Apr 09 12:49:05 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-d19e3cc7-8a6f-4415-912c-641cc5691566 tempest-VolumesSnapshotListTestJSON-1862510598 None] Lock "cinder-6959cf50-f1df-40e5-9629-71b4777f8b49-delete_volume" released by "delete_volume" :: held 1.896s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:49:06 devstack sudo[88609]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:06 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-3c706544-b54d-4397-9d7b-1d3d619eff59 tempest-VolumesDeleteCascade-90985742 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63" returned: 0 in 0.602s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:06 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-3c706544-b54d-4397-9d7b-1d3d619eff59 tempest-VolumesDeleteCascade-90985742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63.666a9630-5e07-4bce-b8ff-0b92574849f9 1G {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:06 devstack sudo[88615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63.666a9630-5e07-4bce-b8ff-0b92574849f9 1G
Apr 09 12:49:06 devstack sudo[88615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:07 devstack sudo[88615]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:07 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-3c706544-b54d-4397-9d7b-1d3d619eff59 tempest-VolumesDeleteCascade-90985742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63.666a9630-5e07-4bce-b8ff-0b92574849f9 1G" returned: 0 in 0.653s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:07 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-3c706544-b54d-4397-9d7b-1d3d619eff59 tempest-VolumesDeleteCascade-90985742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbbb6a16-b42b-4555-9ffe-54e525299d63 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63.666a9630-5e07-4bce-b8ff-0b92574849f9 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:07 devstack sudo[88620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbbb6a16-b42b-4555-9ffe-54e525299d63 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63.666a9630-5e07-4bce-b8ff-0b92574849f9
Apr 09 12:49:07 devstack sudo[88620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:07 devstack sudo[88620]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:07 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-3c706544-b54d-4397-9d7b-1d3d619eff59 tempest-VolumesDeleteCascade-90985742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbbb6a16-b42b-4555-9ffe-54e525299d63 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63.666a9630-5e07-4bce-b8ff-0b92574849f9" returned: 0 in 0.659s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:07 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-3c706544-b54d-4397-9d7b-1d3d619eff59 tempest-VolumesDeleteCascade-90985742 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63.666a9630-5e07-4bce-b8ff-0b92574849f9 is being set with open permissions: ugo+rw
Apr 09 12:49:07 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-3c706544-b54d-4397-9d7b-1d3d619eff59 tempest-VolumesDeleteCascade-90985742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63.666a9630-5e07-4bce-b8ff-0b92574849f9 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:07 devstack sudo[88625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63.666a9630-5e07-4bce-b8ff-0b92574849f9
Apr 09 12:49:07 devstack sudo[88625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:08 devstack sudo[88625]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-3c706544-b54d-4397-9d7b-1d3d619eff59 tempest-VolumesDeleteCascade-90985742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63.666a9630-5e07-4bce-b8ff-0b92574849f9" returned: 0 in 0.570s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-3c706544-b54d-4397-9d7b-1d3d619eff59 tempest-VolumesDeleteCascade-90985742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:08 devstack sudo[88628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63.info
Apr 09 12:49:08 devstack sudo[88628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:08 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8777d01-1a88-455c-8b4e-8b5caf69965c tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:49:08 devstack sudo[88628]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:08 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b8777d01-1a88-455c-8b4e-8b5caf69965c tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Flow 'volume_create_manager' (73f82fac-9be9-40fd-99ee-8515b5e23173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:49:08 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b8777d01-1a88-455c-8b4e-8b5caf69965c tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cddf19bf-8906-49ae-9e0c-c0221945c101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-3c706544-b54d-4397-9d7b-1d3d619eff59 tempest-VolumesDeleteCascade-90985742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63.info" returned: 0 in 0.579s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:08 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-3c706544-b54d-4397-9d7b-1d3d619eff59 tempest-VolumesDeleteCascade-90985742 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63.info is being set with open permissions: ugo+rw
Apr 09 12:49:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-3c706544-b54d-4397-9d7b-1d3d619eff59 tempest-VolumesDeleteCascade-90985742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:08 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b8777d01-1a88-455c-8b4e-8b5caf69965c tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cddf19bf-8906-49ae-9e0c-c0221945c101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:49:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1732695075',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e78cdf44-cc6f-450c-8a42-0dc72f1dff0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5783252fd50a4888bfd55759a36ff0b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:49:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:49:09Z,use_quota=True,user_id='50919db9f7174fddb354ad27a4d3f88c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:08 devstack sudo[88631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63.info
Apr 09 12:49:08 devstack sudo[88631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:08 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b8777d01-1a88-455c-8b4e-8b5caf69965c tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bba2800d-427d-4da2-aebb-abf2022d06e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:08 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b8777d01-1a88-455c-8b4e-8b5caf69965c tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bba2800d-427d-4da2-aebb-abf2022d06e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:08 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b8777d01-1a88-455c-8b4e-8b5caf69965c tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33cfd18d-ff9b-4fe3-80f9-5f535e875e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:08 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b8777d01-1a88-455c-8b4e-8b5caf69965c tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33cfd18d-ff9b-4fe3-80f9-5f535e875e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e78cdf44-cc6f-450c-8a42-0dc72f1dff0b', 'volume_name': 'volume-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b', 'volume_size': 2}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:08 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b8777d01-1a88-455c-8b4e-8b5caf69965c tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d36e80dc-8755-45c0-b49d-8845e6865086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:08 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b8777d01-1a88-455c-8b4e-8b5caf69965c tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d36e80dc-8755-45c0-b49d-8845e6865086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:08 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b8777d01-1a88-455c-8b4e-8b5caf69965c tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96ff6200-f2e6-4497-9150-61b23e6e4c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:08 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-b8777d01-1a88-455c-8b4e-8b5caf69965c tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Volume e78cdf44-cc6f-450c-8a42-0dc72f1dff0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b', 'volume_size': 2}
Apr 09 12:49:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b8777d01-1a88-455c-8b4e-8b5caf69965c tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:49:09 devstack sudo[88631]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-3c706544-b54d-4397-9d7b-1d3d619eff59 tempest-VolumesDeleteCascade-90985742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63.info" returned: 0 in 0.441s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-3c706544-b54d-4397-9d7b-1d3d619eff59 tempest-VolumesDeleteCascade-90985742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.571s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:49:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b8777d01-1a88-455c-8b4e-8b5caf69965c tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.415s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:49:09 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-b8777d01-1a88-455c-8b4e-8b5caf69965c tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:49:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1732695075',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e78cdf44-cc6f-450c-8a42-0dc72f1dff0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5783252fd50a4888bfd55759a36ff0b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:49:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:49:09Z,use_quota=True,user_id='50919db9f7174fddb354ad27a4d3f88c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:49:09 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-b8777d01-1a88-455c-8b4e-8b5caf69965c tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Creating volume e78cdf44-cc6f-450c-8a42-0dc72f1dff0b {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:49:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b8777d01-1a88-455c-8b4e-8b5caf69965c tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:49:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b8777d01-1a88-455c-8b4e-8b5caf69965c tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:49:09 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-b8777d01-1a88-455c-8b4e-8b5caf69965c tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:49:09 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-b8777d01-1a88-455c-8b4e-8b5caf69965c tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:49:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b8777d01-1a88-455c-8b4e-8b5caf69965c tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:49:09 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-b8777d01-1a88-455c-8b4e-8b5caf69965c tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:49:09 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-b8777d01-1a88-455c-8b4e-8b5caf69965c tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:49:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b8777d01-1a88-455c-8b4e-8b5caf69965c tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b 2147483648 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:09 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-3c706544-b54d-4397-9d7b-1d3d619eff59 tempest-VolumesDeleteCascade-90985742 None] Create snapshot completed successfully
Apr 09 12:49:09 devstack sudo[88634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b 2147483648
Apr 09 12:49:09 devstack sudo[88634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:09 devstack cinder-volume[82760]: DEBUG oslo_service.periodic_task [None req-f8337202-8290-4658-916e-19cfa929172e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82760) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 09 12:49:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f8337202-8290-4658-916e-19cfa929172e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:49:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f8337202-8290-4658-916e-19cfa929172e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:49:09 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f8337202-8290-4658-916e-19cfa929172e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:49:09 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f8337202-8290-4658-916e-19cfa929172e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:49:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f8337202-8290-4658-916e-19cfa929172e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:49:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f8337202-8290-4658-916e-19cfa929172e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:09 devstack sudo[88636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:49:09 devstack sudo[88636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:09 devstack sudo[88636]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f8337202-8290-4658-916e-19cfa929172e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.527s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:09 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-f8337202-8290-4658-916e-19cfa929172e None None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:49:10 devstack sudo[88634]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b8777d01-1a88-455c-8b4e-8b5caf69965c tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b 2147483648" returned: 0 in 0.703s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b8777d01-1a88-455c-8b4e-8b5caf69965c tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:10 devstack sudo[88642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b
Apr 09 12:49:10 devstack sudo[88642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-36c64a05-e344-42cb-959f-ac905fd4bca1 tempest-VolumesActionsTest-2093358557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:49:10 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b76378b-6d42-4d9f-baf6-283f9f69f235 tempest-VolumesDeleteCascade-90985742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:49:10 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-0b76378b-6d42-4d9f-baf6-283f9f69f235 tempest-VolumesDeleteCascade-90985742 None] Flow 'volume_create_manager' (de48a300-742e-4f9a-93da-a7a0fd8dfa39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:49:10 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-0b76378b-6d42-4d9f-baf6-283f9f69f235 tempest-VolumesDeleteCascade-90985742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2e1f884-c8dd-41a0-a475-79962f19070e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:10 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-0b76378b-6d42-4d9f-baf6-283f9f69f235 tempest-VolumesDeleteCascade-90985742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2e1f884-c8dd-41a0-a475-79962f19070e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-458348707',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d725556-be00-40e1-b1e7-7a50f999a52c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be0c74dc200343909e5e2d9b7998aac9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:49:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=666a9630-5e07-4bce-b8ff-0b92574849f9,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:49:10Z,use_quota=True,user_id='0d0197bc85c7490c9024554e23e4aa42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:10 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-0b76378b-6d42-4d9f-baf6-283f9f69f235 tempest-VolumesDeleteCascade-90985742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6f6c906-9923-424d-9055-1f53b22b9b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:10 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-0b76378b-6d42-4d9f-baf6-283f9f69f235 tempest-VolumesDeleteCascade-90985742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6f6c906-9923-424d-9055-1f53b22b9b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:10 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-0b76378b-6d42-4d9f-baf6-283f9f69f235 tempest-VolumesDeleteCascade-90985742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab98d655-794f-4375-b609-e30022a224aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:10 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-0b76378b-6d42-4d9f-baf6-283f9f69f235 tempest-VolumesDeleteCascade-90985742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab98d655-794f-4375-b609-e30022a224aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2d725556-be00-40e1-b1e7-7a50f999a52c', 'volume_name': 'volume-2d725556-be00-40e1-b1e7-7a50f999a52c', 'volume_size': 1, 'snapshot_id': '666a9630-5e07-4bce-b8ff-0b92574849f9'}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:10 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-0b76378b-6d42-4d9f-baf6-283f9f69f235 tempest-VolumesDeleteCascade-90985742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08c5f3e5-b37d-4abe-98b7-bc1a5a324251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:10 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-0b76378b-6d42-4d9f-baf6-283f9f69f235 tempest-VolumesDeleteCascade-90985742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08c5f3e5-b37d-4abe-98b7-bc1a5a324251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:10 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-0b76378b-6d42-4d9f-baf6-283f9f69f235 tempest-VolumesDeleteCascade-90985742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e26e8e9-8a91-4d16-84a6-7fe76308669f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:10 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-0b76378b-6d42-4d9f-baf6-283f9f69f235 tempest-VolumesDeleteCascade-90985742 None] Volume 2d725556-be00-40e1-b1e7-7a50f999a52c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2d725556-be00-40e1-b1e7-7a50f999a52c', 'volume_size': 1, 'snapshot_id': '666a9630-5e07-4bce-b8ff-0b92574849f9'}
Apr 09 12:49:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-0b76378b-6d42-4d9f-baf6-283f9f69f235 tempest-VolumesDeleteCascade-90985742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:49:10 devstack sudo[88642]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b8777d01-1a88-455c-8b4e-8b5caf69965c tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b" returned: 0 in 0.414s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:10 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-b8777d01-1a88-455c-8b4e-8b5caf69965c tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:49:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b8777d01-1a88-455c-8b4e-8b5caf69965c tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:49:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-36c64a05-e344-42cb-959f-ac905fd4bca1 tempest-VolumesActionsTest-2093358557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.182s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:49:10 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b8777d01-1a88-455c-8b4e-8b5caf69965c tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96ff6200-f2e6-4497-9150-61b23e6e4c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b', 'volume_size': 2}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:10 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b8777d01-1a88-455c-8b4e-8b5caf69965c tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d1974c8-97db-41b0-945e-24e739f30ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:10 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84f1ab6-a5ab-4c6d-a905-4908414206db]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:49:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-36c64a05-e344-42cb-959f-ac905fd4bca1 tempest-VolumesActionsTest-2093358557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ca2d894e-5587-4797-9daa-d4fe29c9414d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:10 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-b8777d01-1a88-455c-8b4e-8b5caf69965c tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Volume volume-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b (e78cdf44-cc6f-450c-8a42-0dc72f1dff0b): created successfully
Apr 09 12:49:10 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b8777d01-1a88-455c-8b4e-8b5caf69965c tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d1974c8-97db-41b0-945e-24e739f30ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:10 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b8777d01-1a88-455c-8b4e-8b5caf69965c tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Flow 'volume_create_manager' (73f82fac-9be9-40fd-99ee-8515b5e23173) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:49:10 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-b8777d01-1a88-455c-8b4e-8b5caf69965c tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Created volume successfully.
Apr 09 12:49:10 devstack sudo[88645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ca2d894e-5587-4797-9daa-d4fe29c9414d
Apr 09 12:49:10 devstack sudo[88645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:11 devstack sudo[88645]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:11 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-36c64a05-e344-42cb-959f-ac905fd4bca1 tempest-VolumesActionsTest-2093358557 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ca2d894e-5587-4797-9daa-d4fe29c9414d" returned: 0 in 0.550s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:11 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[764f4305-f826-4bbc-91ec-fbd381ced489]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:49:11 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-36c64a05-e344-42cb-959f-ac905fd4bca1 tempest-VolumesActionsTest-2093358557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ca2d894e-5587-4797-9daa-d4fe29c9414d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:11 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-19b7c40a-19ae-423b-9b5b-3a3d8844a132 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:49:11 devstack sudo[88650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ca2d894e-5587-4797-9daa-d4fe29c9414d
Apr 09 12:49:11 devstack sudo[88650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:11 devstack sudo[88650]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:11 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-36c64a05-e344-42cb-959f-ac905fd4bca1 tempest-VolumesActionsTest-2093358557 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ca2d894e-5587-4797-9daa-d4fe29c9414d" returned: 0 in 0.611s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:11 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-36c64a05-e344-42cb-959f-ac905fd4bca1 tempest-VolumesActionsTest-2093358557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ca2d894e-5587-4797-9daa-d4fe29c9414d /opt/stack/data/cinder/conversion/ca2d894e-5587-4797-9daa-d4fe29c9414d.temp_image.d573c251-7e89-47e5-b5bc-e82d7528b8ebcc7nhs9i.img {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:11 devstack sudo[88656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ca2d894e-5587-4797-9daa-d4fe29c9414d /opt/stack/data/cinder/conversion/ca2d894e-5587-4797-9daa-d4fe29c9414d.temp_image.d573c251-7e89-47e5-b5bc-e82d7528b8ebcc7nhs9i.img
Apr 09 12:49:11 devstack sudo[88656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:14 devstack sudo[88656]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-36c64a05-e344-42cb-959f-ac905fd4bca1 tempest-VolumesActionsTest-2093358557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ca2d894e-5587-4797-9daa-d4fe29c9414d /opt/stack/data/cinder/conversion/ca2d894e-5587-4797-9daa-d4fe29c9414d.temp_image.d573c251-7e89-47e5-b5bc-e82d7528b8ebcc7nhs9i.img" returned: 0 in 2.386s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:14 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[c737d1a3-d273-49ff-a12d-8aee9e1041ff]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:49:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-36c64a05-e344-42cb-959f-ac905fd4bca1 tempest-VolumesActionsTest-2093358557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ca2d894e-5587-4797-9daa-d4fe29c9414d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:14 devstack sudo[88669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ca2d894e-5587-4797-9daa-d4fe29c9414d
Apr 09 12:49:14 devstack sudo[88669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:14 devstack sudo[88669]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-36c64a05-e344-42cb-959f-ac905fd4bca1 tempest-VolumesActionsTest-2093358557 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ca2d894e-5587-4797-9daa-d4fe29c9414d" returned: 0 in 0.616s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:14 devstack cinder-volume[82760]: DEBUG cinder.image.image_utils [None req-36c64a05-e344-42cb-959f-ac905fd4bca1 tempest-VolumesActionsTest-2093358557 None] Image conversion details: src /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ca2d894e-5587-4797-9daa-d4fe29c9414d, size 1024.00 MB, duration 2.39 sec, destination /opt/stack/data/cinder/conversion/ca2d894e-5587-4797-9daa-d4fe29c9414d.temp_image.d573c251-7e89-47e5-b5bc-e82d7528b8ebcc7nhs9i.img {{(pid=82760) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 12:49:14 devstack cinder-volume[82760]: INFO cinder.image.image_utils [None req-36c64a05-e344-42cb-959f-ac905fd4bca1 tempest-VolumesActionsTest-2093358557 None] Converted 1024.00 MB image at 428.93 MB/s
Apr 09 12:49:14 devstack cinder-volume[82760]: DEBUG cinder.image.image_utils [None req-36c64a05-e344-42cb-959f-ac905fd4bca1 tempest-VolumesActionsTest-2093358557 None] d573c251-7e89-47e5-b5bc-e82d7528b8eb was raw, no need to convert to raw {{(pid=82760) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}}
Apr 09 12:49:20 devstack cinder-volume[82760]: DEBUG dbcounter [-] [82760] Writing DB stats cinder:UPDATE=66,cinder:DELETE=6,cinder:SELECT=66,cinder:INSERT=24 {{(pid=82760) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 12:49:24 devstack cinder-volume[82760]: DEBUG dbcounter [-] [82760] Writing DB stats cinder:SELECT=72,cinder:INSERT=12,cinder:UPDATE=63,cinder:DELETE=6 {{(pid=82760) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 12:49:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-36c64a05-e344-42cb-959f-ac905fd4bca1 tempest-VolumesActionsTest-2093358557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 14.362s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:49:24 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-36c64a05-e344-42cb-959f-ac905fd4bca1 tempest-VolumesActionsTest-2093358557 None] Uploaded volume to glance image-id: d573c251-7e89-47e5-b5bc-e82d7528b8eb. {{(pid=82760) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 09 12:49:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-0b76378b-6d42-4d9f-baf6-283f9f69f235 tempest-VolumesDeleteCascade-90985742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 14.448s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:49:24 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-0b76378b-6d42-4d9f-baf6-283f9f69f235 tempest-VolumesDeleteCascade-90985742 None] Acquiring lock "cinder-quobyte-666a9630-5e07-4bce-b8ff-0b92574849f9-2d725556-be00-40e1-b1e7-7a50f999a52c" by "_create_volume_from_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:49:24 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-0b76378b-6d42-4d9f-baf6-283f9f69f235 tempest-VolumesDeleteCascade-90985742 None] Lock "cinder-quobyte-666a9630-5e07-4bce-b8ff-0b92574849f9-2d725556-be00-40e1-b1e7-7a50f999a52c" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:49:24 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-0b76378b-6d42-4d9f-baf6-283f9f69f235 tempest-VolumesDeleteCascade-90985742 None] Creating volume 2d725556-be00-40e1-b1e7-7a50f999a52c from snapshot 666a9630-5e07-4bce-b8ff-0b92574849f9 {{(pid=82760) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 09 12:49:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-0b76378b-6d42-4d9f-baf6-283f9f69f235 tempest-VolumesDeleteCascade-90985742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:49:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-0b76378b-6d42-4d9f-baf6-283f9f69f235 tempest-VolumesDeleteCascade-90985742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:49:24 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-0b76378b-6d42-4d9f-baf6-283f9f69f235 tempest-VolumesDeleteCascade-90985742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:49:24 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-0b76378b-6d42-4d9f-baf6-283f9f69f235 tempest-VolumesDeleteCascade-90985742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:49:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-0b76378b-6d42-4d9f-baf6-283f9f69f235 tempest-VolumesDeleteCascade-90985742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:49:24 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-0b76378b-6d42-4d9f-baf6-283f9f69f235 tempest-VolumesDeleteCascade-90985742 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:49:24 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-0b76378b-6d42-4d9f-baf6-283f9f69f235 tempest-VolumesDeleteCascade-90985742 None] Acquiring lock "cinder-quobyte-2d725556-be00-40e1-b1e7-7a50f999a52c" by "_copy_volume_from_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:49:24 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-36c64a05-e344-42cb-959f-ac905fd4bca1 tempest-VolumesActionsTest-2093358557 None] Copy volume to image completed successfully.
Apr 09 12:49:24 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-0b76378b-6d42-4d9f-baf6-283f9f69f235 tempest-VolumesDeleteCascade-90985742 None] Lock "cinder-quobyte-2d725556-be00-40e1-b1e7-7a50f999a52c" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:49:24 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-0b76378b-6d42-4d9f-baf6-283f9f69f235 tempest-VolumesDeleteCascade-90985742 None] snapshot: 666a9630-5e07-4bce-b8ff-0b92574849f9, volume: 2d725556-be00-40e1-b1e7-7a50f999a52c,  {{(pid=82760) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 09 12:49:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-0b76378b-6d42-4d9f-baf6-283f9f69f235 tempest-VolumesDeleteCascade-90985742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:49:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-0b76378b-6d42-4d9f-baf6-283f9f69f235 tempest-VolumesDeleteCascade-90985742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:49:24 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-0b76378b-6d42-4d9f-baf6-283f9f69f235 tempest-VolumesDeleteCascade-90985742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:49:24 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-0b76378b-6d42-4d9f-baf6-283f9f69f235 tempest-VolumesDeleteCascade-90985742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:49:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-0b76378b-6d42-4d9f-baf6-283f9f69f235 tempest-VolumesDeleteCascade-90985742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:49:24 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4646c4-1af7-4bf2-9e3d-94103df82cc3]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:49:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-0b76378b-6d42-4d9f-baf6-283f9f69f235 tempest-VolumesDeleteCascade-90985742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63.666a9630-5e07-4bce-b8ff-0b92574849f9 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:24 devstack sudo[88683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63.666a9630-5e07-4bce-b8ff-0b92574849f9
Apr 09 12:49:24 devstack sudo[88683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:25 devstack sudo[88683]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-0b76378b-6d42-4d9f-baf6-283f9f69f235 tempest-VolumesDeleteCascade-90985742 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63.666a9630-5e07-4bce-b8ff-0b92574849f9" returned: 0 in 0.525s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:25 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-0b76378b-6d42-4d9f-baf6-283f9f69f235 tempest-VolumesDeleteCascade-90985742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbbb6a16-b42b-4555-9ffe-54e525299d63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:49:25 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-0b76378b-6d42-4d9f-baf6-283f9f69f235 tempest-VolumesDeleteCascade-90985742 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63 {{(pid=82760) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 09 12:49:25 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-0b76378b-6d42-4d9f-baf6-283f9f69f235 tempest-VolumesDeleteCascade-90985742 None] Creating direct copy from snapshot {{(pid=82760) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 09 12:49:25 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f239952-0294-4e40-b903-73cccc531b6e]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:49:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-0b76378b-6d42-4d9f-baf6-283f9f69f235 tempest-VolumesDeleteCascade-90985742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:25 devstack sudo[88688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63
Apr 09 12:49:25 devstack sudo[88688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:26 devstack sudo[88688]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-0b76378b-6d42-4d9f-baf6-283f9f69f235 tempest-VolumesDeleteCascade-90985742 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63" returned: 0 in 0.536s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:26 devstack cinder-volume[82760]: DEBUG cinder.utils [None req-0b76378b-6d42-4d9f-baf6-283f9f69f235 tempest-VolumesDeleteCascade-90985742 None] Path /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2d725556-be00-40e1-b1e7-7a50f999a52c not found in is_blk_device check {{(pid=82760) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 09 12:49:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-0b76378b-6d42-4d9f-baf6-283f9f69f235 tempest-VolumesDeleteCascade-90985742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2d725556-be00-40e1-b1e7-7a50f999a52c {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:26 devstack sudo[88693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2d725556-be00-40e1-b1e7-7a50f999a52c
Apr 09 12:49:26 devstack sudo[88693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-340d1e4e-dfaa-4f9c-a0f8-fd822a155010 tempest-VolumesActionsTest-2093358557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:49:28 devstack sudo[88693]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:28 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-0b76378b-6d42-4d9f-baf6-283f9f69f235 tempest-VolumesDeleteCascade-90985742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2d725556-be00-40e1-b1e7-7a50f999a52c" returned: 0 in 2.174s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:28 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84c4830-b444-4cc5-b88e-bee2761ad0ff]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:49:28 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-0b76378b-6d42-4d9f-baf6-283f9f69f235 tempest-VolumesDeleteCascade-90985742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:28 devstack sudo[88705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63
Apr 09 12:49:28 devstack sudo[88705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:28 devstack sudo[88705]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:28 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-0b76378b-6d42-4d9f-baf6-283f9f69f235 tempest-VolumesDeleteCascade-90985742 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63" returned: 0 in 0.583s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:28 devstack cinder-volume[82760]: DEBUG cinder.image.image_utils [None req-0b76378b-6d42-4d9f-baf6-283f9f69f235 tempest-VolumesDeleteCascade-90985742 None] Image conversion details: src /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63, size 1024.00 MB, duration 2.17 sec, destination /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2d725556-be00-40e1-b1e7-7a50f999a52c {{(pid=82760) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 12:49:28 devstack cinder-volume[82760]: INFO cinder.image.image_utils [None req-0b76378b-6d42-4d9f-baf6-283f9f69f235 tempest-VolumesDeleteCascade-90985742 None] Converted 1024.00 MB image at 470.92 MB/s
Apr 09 12:49:28 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-0b76378b-6d42-4d9f-baf6-283f9f69f235 tempest-VolumesDeleteCascade-90985742 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2d725556-be00-40e1-b1e7-7a50f999a52c is being set with open permissions: ugo+rw
Apr 09 12:49:28 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-0b76378b-6d42-4d9f-baf6-283f9f69f235 tempest-VolumesDeleteCascade-90985742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2d725556-be00-40e1-b1e7-7a50f999a52c {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:28 devstack sudo[88710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2d725556-be00-40e1-b1e7-7a50f999a52c
Apr 09 12:49:28 devstack sudo[88710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:29 devstack sudo[88710]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:29 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-0b76378b-6d42-4d9f-baf6-283f9f69f235 tempest-VolumesDeleteCascade-90985742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2d725556-be00-40e1-b1e7-7a50f999a52c" returned: 0 in 0.414s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:29 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-0b76378b-6d42-4d9f-baf6-283f9f69f235 tempest-VolumesDeleteCascade-90985742 None] Lock "cinder-quobyte-2d725556-be00-40e1-b1e7-7a50f999a52c" released by "_copy_volume_from_snapshot" :: held 4.299s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:49:29 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-0b76378b-6d42-4d9f-baf6-283f9f69f235 tempest-VolumesDeleteCascade-90985742 None] Lock "cinder-quobyte-666a9630-5e07-4bce-b8ff-0b92574849f9-2d725556-be00-40e1-b1e7-7a50f999a52c" released by "_create_volume_from_snapshot" :: held 4.317s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:49:29 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-0b76378b-6d42-4d9f-baf6-283f9f69f235 tempest-VolumesDeleteCascade-90985742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.335s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:49:29 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-19b7c40a-19ae-423b-9b5b-3a3d8844a132 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 18.046s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:49:29 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-19b7c40a-19ae-423b-9b5b-3a3d8844a132 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Creating offline snapshot 6ae0dd87-494a-4acf-a5b9-1ff0fd9eacd9 of volume e78cdf44-cc6f-450c-8a42-0dc72f1dff0b {{(pid=82760) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 12:49:29 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9fb740-3162-410f-a4e4-1cbcaf2e8098]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:49:29 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-19b7c40a-19ae-423b-9b5b-3a3d8844a132 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:29 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-0b76378b-6d42-4d9f-baf6-283f9f69f235 tempest-VolumesDeleteCascade-90985742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e26e8e9-8a91-4d16-84a6-7fe76308669f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d725556-be00-40e1-b1e7-7a50f999a52c', 'volume_size': 1, 'snapshot_id': '666a9630-5e07-4bce-b8ff-0b92574849f9'}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:29 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-0b76378b-6d42-4d9f-baf6-283f9f69f235 tempest-VolumesDeleteCascade-90985742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (401e64d5-2e6e-482e-923c-3186f506fa88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:29 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-0b76378b-6d42-4d9f-baf6-283f9f69f235 tempest-VolumesDeleteCascade-90985742 None] Volume volume-2d725556-be00-40e1-b1e7-7a50f999a52c (2d725556-be00-40e1-b1e7-7a50f999a52c): created successfully
Apr 09 12:49:29 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-0b76378b-6d42-4d9f-baf6-283f9f69f235 tempest-VolumesDeleteCascade-90985742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (401e64d5-2e6e-482e-923c-3186f506fa88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:29 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-0b76378b-6d42-4d9f-baf6-283f9f69f235 tempest-VolumesDeleteCascade-90985742 None] Flow 'volume_create_manager' (de48a300-742e-4f9a-93da-a7a0fd8dfa39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:49:29 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-0b76378b-6d42-4d9f-baf6-283f9f69f235 tempest-VolumesDeleteCascade-90985742 None] Created volume successfully.
Apr 09 12:49:29 devstack sudo[88713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b
Apr 09 12:49:29 devstack sudo[88713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:29 devstack sudo[88713]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:29 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-19b7c40a-19ae-423b-9b5b-3a3d8844a132 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b" returned: 0 in 0.505s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:29 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-19b7c40a-19ae-423b-9b5b-3a3d8844a132 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b.6ae0dd87-494a-4acf-a5b9-1ff0fd9eacd9 2G {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:29 devstack sudo[88718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b.6ae0dd87-494a-4acf-a5b9-1ff0fd9eacd9 2G
Apr 09 12:49:29 devstack sudo[88718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:30 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-19b7c40a-19ae-423b-9b5b-3a3d8844a132 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b.6ae0dd87-494a-4acf-a5b9-1ff0fd9eacd9 2G" returned: 0 in 0.530s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:30 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-19b7c40a-19ae-423b-9b5b-3a3d8844a132 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b.6ae0dd87-494a-4acf-a5b9-1ff0fd9eacd9 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:30 devstack sudo[88718]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:30 devstack sudo[88723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b.6ae0dd87-494a-4acf-a5b9-1ff0fd9eacd9
Apr 09 12:49:30 devstack sudo[88723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:30 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-11ebaccb-4e8c-4adc-bca9-4beb5dc797d5 tempest-VolumesDeleteCascade-90985742 None] Acquiring lock "cinder-bbbb6a16-b42b-4555-9ffe-54e525299d63-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:49:30 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-11ebaccb-4e8c-4adc-bca9-4beb5dc797d5 tempest-VolumesDeleteCascade-90985742 None] Lock "cinder-bbbb6a16-b42b-4555-9ffe-54e525299d63-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:49:30 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-11ebaccb-4e8c-4adc-bca9-4beb5dc797d5 tempest-VolumesDeleteCascade-90985742 None] Performing cascade delete. {{(pid=82760) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 09 12:49:30 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-11ebaccb-4e8c-4adc-bca9-4beb5dc797d5 tempest-VolumesDeleteCascade-90985742 None] Acquiring lock "cinder-666a9630-5e07-4bce-b8ff-0b92574849f9-delete_snapshot" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:49:30 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-11ebaccb-4e8c-4adc-bca9-4beb5dc797d5 tempest-VolumesDeleteCascade-90985742 None] Lock "cinder-666a9630-5e07-4bce-b8ff-0b92574849f9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:49:30 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-11ebaccb-4e8c-4adc-bca9-4beb5dc797d5 tempest-VolumesDeleteCascade-90985742 None] Acquiring lock "cinder-quobyte-bbbb6a16-b42b-4555-9ffe-54e525299d63" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:49:30 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-11ebaccb-4e8c-4adc-bca9-4beb5dc797d5 tempest-VolumesDeleteCascade-90985742 None] Lock "cinder-quobyte-bbbb6a16-b42b-4555-9ffe-54e525299d63" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:49:30 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-11ebaccb-4e8c-4adc-bca9-4beb5dc797d5 tempest-VolumesDeleteCascade-90985742 None] Acquiring lock "cinder-quobyte-666a9630-5e07-4bce-b8ff-0b92574849f9" by "_delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:49:30 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-11ebaccb-4e8c-4adc-bca9-4beb5dc797d5 tempest-VolumesDeleteCascade-90985742 None] Lock "cinder-quobyte-666a9630-5e07-4bce-b8ff-0b92574849f9" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:49:30 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-11ebaccb-4e8c-4adc-bca9-4beb5dc797d5 tempest-VolumesDeleteCascade-90985742 None] Deleting offline snapshot 666a9630-5e07-4bce-b8ff-0b92574849f9 of volume bbbb6a16-b42b-4555-9ffe-54e525299d63 {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 12:49:30 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-11ebaccb-4e8c-4adc-bca9-4beb5dc797d5 tempest-VolumesDeleteCascade-90985742 None] snapshot_file for this snap is: volume-bbbb6a16-b42b-4555-9ffe-54e525299d63.666a9630-5e07-4bce-b8ff-0b92574849f9 {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 12:49:30 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b529e2-c6a0-47e8-ae34-11c13b4c8fc1]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:49:30 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-11ebaccb-4e8c-4adc-bca9-4beb5dc797d5 tempest-VolumesDeleteCascade-90985742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63.666a9630-5e07-4bce-b8ff-0b92574849f9 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:30 devstack sudo[88728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63.666a9630-5e07-4bce-b8ff-0b92574849f9
Apr 09 12:49:30 devstack sudo[88728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:30 devstack sudo[88723]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:30 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-19b7c40a-19ae-423b-9b5b-3a3d8844a132 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b.6ae0dd87-494a-4acf-a5b9-1ff0fd9eacd9" returned: 0 in 0.491s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:30 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-19b7c40a-19ae-423b-9b5b-3a3d8844a132 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b.6ae0dd87-494a-4acf-a5b9-1ff0fd9eacd9 is being set with open permissions: ugo+rw
Apr 09 12:49:30 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-19b7c40a-19ae-423b-9b5b-3a3d8844a132 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b.6ae0dd87-494a-4acf-a5b9-1ff0fd9eacd9 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:30 devstack sudo[88730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b.6ae0dd87-494a-4acf-a5b9-1ff0fd9eacd9
Apr 09 12:49:30 devstack sudo[88730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:31 devstack sudo[88728]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:31 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-11ebaccb-4e8c-4adc-bca9-4beb5dc797d5 tempest-VolumesDeleteCascade-90985742 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63.666a9630-5e07-4bce-b8ff-0b92574849f9" returned: 0 in 0.508s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:31 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-11ebaccb-4e8c-4adc-bca9-4beb5dc797d5 tempest-VolumesDeleteCascade-90985742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbbb6a16-b42b-4555-9ffe-54e525299d63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:49:31 devstack sudo[88730]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:31 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-19b7c40a-19ae-423b-9b5b-3a3d8844a132 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b.6ae0dd87-494a-4acf-a5b9-1ff0fd9eacd9" returned: 0 in 0.433s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:31 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[55db61ef-8326-48f7-8fb5-6f353baa62d0]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:49:31 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-11ebaccb-4e8c-4adc-bca9-4beb5dc797d5 tempest-VolumesDeleteCascade-90985742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:31 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-19b7c40a-19ae-423b-9b5b-3a3d8844a132 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:31 devstack sudo[88737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b.info
Apr 09 12:49:31 devstack sudo[88737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:31 devstack sudo[88736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63
Apr 09 12:49:31 devstack sudo[88736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:31 devstack sudo[88737]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:31 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-19b7c40a-19ae-423b-9b5b-3a3d8844a132 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b.info" returned: 0 in 0.460s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:31 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-19b7c40a-19ae-423b-9b5b-3a3d8844a132 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b.info is being set with open permissions: ugo+rw
Apr 09 12:49:31 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-19b7c40a-19ae-423b-9b5b-3a3d8844a132 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:31 devstack sudo[88744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b.info
Apr 09 12:49:31 devstack sudo[88744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:31 devstack sudo[88736]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:31 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-11ebaccb-4e8c-4adc-bca9-4beb5dc797d5 tempest-VolumesDeleteCascade-90985742 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63" returned: 0 in 0.561s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:31 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-11ebaccb-4e8c-4adc-bca9-4beb5dc797d5 tempest-VolumesDeleteCascade-90985742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63.666a9630-5e07-4bce-b8ff-0b92574849f9 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:31 devstack sudo[88746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63.666a9630-5e07-4bce-b8ff-0b92574849f9
Apr 09 12:49:31 devstack sudo[88746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:32 devstack sudo[88744]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-19b7c40a-19ae-423b-9b5b-3a3d8844a132 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b.info" returned: 0 in 0.493s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-19b7c40a-19ae-423b-9b5b-3a3d8844a132 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.986s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:49:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-340d1e4e-dfaa-4f9c-a0f8-fd822a155010 tempest-VolumesActionsTest-2093358557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 5.610s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:49:32 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2420b82-babf-453d-ab40-807991f9625e]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:49:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-340d1e4e-dfaa-4f9c-a0f8-fd822a155010 tempest-VolumesActionsTest-2093358557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ca2d894e-5587-4797-9daa-d4fe29c9414d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:32 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-19b7c40a-19ae-423b-9b5b-3a3d8844a132 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Create snapshot completed successfully
Apr 09 12:49:32 devstack sudo[88746]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-11ebaccb-4e8c-4adc-bca9-4beb5dc797d5 tempest-VolumesDeleteCascade-90985742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63.666a9630-5e07-4bce-b8ff-0b92574849f9" returned: 0 in 0.511s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-11ebaccb-4e8c-4adc-bca9-4beb5dc797d5 tempest-VolumesDeleteCascade-90985742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63.666a9630-5e07-4bce-b8ff-0b92574849f9 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:32 devstack sudo[88752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ca2d894e-5587-4797-9daa-d4fe29c9414d
Apr 09 12:49:32 devstack sudo[88752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:32 devstack sudo[88753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63.666a9630-5e07-4bce-b8ff-0b92574849f9
Apr 09 12:49:32 devstack sudo[88753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:32 devstack sudo[88752]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-340d1e4e-dfaa-4f9c-a0f8-fd822a155010 tempest-VolumesActionsTest-2093358557 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ca2d894e-5587-4797-9daa-d4fe29c9414d" returned: 0 in 0.530s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:32 devstack sudo[88753]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-11ebaccb-4e8c-4adc-bca9-4beb5dc797d5 tempest-VolumesDeleteCascade-90985742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63.666a9630-5e07-4bce-b8ff-0b92574849f9" returned: 0 in 0.469s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:32 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[635d9dd9-cdb3-49d4-9f78-54c6061c456f]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:49:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-340d1e4e-dfaa-4f9c-a0f8-fd822a155010 tempest-VolumesActionsTest-2093358557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ca2d894e-5587-4797-9daa-d4fe29c9414d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:32 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-11ebaccb-4e8c-4adc-bca9-4beb5dc797d5 tempest-VolumesDeleteCascade-90985742 None] Lock "cinder-quobyte-666a9630-5e07-4bce-b8ff-0b92574849f9" released by "_delete_snapshot" :: held 2.127s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:49:32 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-11ebaccb-4e8c-4adc-bca9-4beb5dc797d5 tempest-VolumesDeleteCascade-90985742 None] Lock "cinder-quobyte-bbbb6a16-b42b-4555-9ffe-54e525299d63" released by "delete_snapshot" :: held 2.143s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:49:32 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-11ebaccb-4e8c-4adc-bca9-4beb5dc797d5 tempest-VolumesDeleteCascade-90985742 None] Created reservations ['d902a465-2c09-48b9-bd8a-1c9862bcafd4', '38306420-a4e4-4989-9ff8-89f3edaacee4', '16da2e96-56ed-4d3b-9d5a-87b0b2d49c74', 'ae479613-7b21-4e91-ab33-b4d2c06f5c24'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:49:32 devstack sudo[88761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ca2d894e-5587-4797-9daa-d4fe29c9414d
Apr 09 12:49:32 devstack sudo[88761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:32 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-11ebaccb-4e8c-4adc-bca9-4beb5dc797d5 tempest-VolumesDeleteCascade-90985742 None] Delete snapshot completed successfully.
Apr 09 12:49:32 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-11ebaccb-4e8c-4adc-bca9-4beb5dc797d5 tempest-VolumesDeleteCascade-90985742 None] Lock "cinder-666a9630-5e07-4bce-b8ff-0b92574849f9-delete_snapshot" released by "delete_snapshot" :: held 2.260s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:49:32 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-11ebaccb-4e8c-4adc-bca9-4beb5dc797d5 tempest-VolumesDeleteCascade-90985742 None] Snapshots deleted, issuing volume delete {{(pid=82760) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 09 12:49:32 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-11ebaccb-4e8c-4adc-bca9-4beb5dc797d5 tempest-VolumesDeleteCascade-90985742 None] Acquiring lock "cinder-quobyte-bbbb6a16-b42b-4555-9ffe-54e525299d63" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:49:32 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-11ebaccb-4e8c-4adc-bca9-4beb5dc797d5 tempest-VolumesDeleteCascade-90985742 None] Lock "cinder-quobyte-bbbb6a16-b42b-4555-9ffe-54e525299d63" acquired by "delete_volume" :: waited 0.007s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:49:32 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[95132513-b00c-4b6f-a89e-1b41d8fe2d78]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:49:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-11ebaccb-4e8c-4adc-bca9-4beb5dc797d5 tempest-VolumesDeleteCascade-90985742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:32 devstack sudo[88763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63
Apr 09 12:49:32 devstack sudo[88763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:33 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ad3fadd7-b021-40bf-9073-4cb2f529bf53 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Acquiring lock "cinder-6ae0dd87-494a-4acf-a5b9-1ff0fd9eacd9-delete_snapshot" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:49:33 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ad3fadd7-b021-40bf-9073-4cb2f529bf53 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Lock "cinder-6ae0dd87-494a-4acf-a5b9-1ff0fd9eacd9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:49:33 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ad3fadd7-b021-40bf-9073-4cb2f529bf53 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Acquiring lock "cinder-quobyte-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:49:33 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ad3fadd7-b021-40bf-9073-4cb2f529bf53 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Lock "cinder-quobyte-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:49:33 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ad3fadd7-b021-40bf-9073-4cb2f529bf53 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Acquiring lock "cinder-quobyte-6ae0dd87-494a-4acf-a5b9-1ff0fd9eacd9" by "_delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:49:33 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ad3fadd7-b021-40bf-9073-4cb2f529bf53 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Lock "cinder-quobyte-6ae0dd87-494a-4acf-a5b9-1ff0fd9eacd9" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:49:33 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-ad3fadd7-b021-40bf-9073-4cb2f529bf53 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Deleting offline snapshot 6ae0dd87-494a-4acf-a5b9-1ff0fd9eacd9 of volume e78cdf44-cc6f-450c-8a42-0dc72f1dff0b {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 12:49:33 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-ad3fadd7-b021-40bf-9073-4cb2f529bf53 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] snapshot_file for this snap is: volume-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b.6ae0dd87-494a-4acf-a5b9-1ff0fd9eacd9 {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 12:49:33 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ca0ca6-1f5a-48bf-b6f2-8a67d7179a1d]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:49:33 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ad3fadd7-b021-40bf-9073-4cb2f529bf53 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b.6ae0dd87-494a-4acf-a5b9-1ff0fd9eacd9 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:33 devstack sudo[88761]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:33 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-340d1e4e-dfaa-4f9c-a0f8-fd822a155010 tempest-VolumesActionsTest-2093358557 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ca2d894e-5587-4797-9daa-d4fe29c9414d" returned: 0 in 0.557s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:33 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-340d1e4e-dfaa-4f9c-a0f8-fd822a155010 tempest-VolumesActionsTest-2093358557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ca2d894e-5587-4797-9daa-d4fe29c9414d /opt/stack/data/cinder/conversion/ca2d894e-5587-4797-9daa-d4fe29c9414d.temp_image.b7fc48c3-ec73-4ebb-aba4-f3973511a328d0xlli1s.img {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:33 devstack sudo[88768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b.6ae0dd87-494a-4acf-a5b9-1ff0fd9eacd9
Apr 09 12:49:33 devstack sudo[88768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:33 devstack sudo[88770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ca2d894e-5587-4797-9daa-d4fe29c9414d /opt/stack/data/cinder/conversion/ca2d894e-5587-4797-9daa-d4fe29c9414d.temp_image.b7fc48c3-ec73-4ebb-aba4-f3973511a328d0xlli1s.img
Apr 09 12:49:33 devstack sudo[88770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:33 devstack sudo[88763]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:33 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-11ebaccb-4e8c-4adc-bca9-4beb5dc797d5 tempest-VolumesDeleteCascade-90985742 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63" returned: 0 in 0.565s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:33 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-11ebaccb-4e8c-4adc-bca9-4beb5dc797d5 tempest-VolumesDeleteCascade-90985742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:33 devstack sudo[88775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63
Apr 09 12:49:33 devstack sudo[88775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:33 devstack sudo[88768]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:33 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ad3fadd7-b021-40bf-9073-4cb2f529bf53 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b.6ae0dd87-494a-4acf-a5b9-1ff0fd9eacd9" returned: 0 in 0.643s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:33 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-ad3fadd7-b021-40bf-9073-4cb2f529bf53 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:49:33 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a73cac-68af-4ab6-a2b9-a54a8fd70a5a]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:49:33 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ad3fadd7-b021-40bf-9073-4cb2f529bf53 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:34 devstack sudo[88792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b
Apr 09 12:49:34 devstack sudo[88792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:35 devstack sudo[88775]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-11ebaccb-4e8c-4adc-bca9-4beb5dc797d5 tempest-VolumesDeleteCascade-90985742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-bbbb6a16-b42b-4555-9ffe-54e525299d63" returned: 0 in 1.598s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:35 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-11ebaccb-4e8c-4adc-bca9-4beb5dc797d5 tempest-VolumesDeleteCascade-90985742 None] Lock "cinder-quobyte-bbbb6a16-b42b-4555-9ffe-54e525299d63" released by "delete_volume" :: held 2.233s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:49:35 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-11ebaccb-4e8c-4adc-bca9-4beb5dc797d5 tempest-VolumesDeleteCascade-90985742 None] Created reservations ['39976da7-aab0-44da-aec5-6fe3115e76ce', '5022e8bf-2cdd-4a14-af68-d43c8f9ba2c9', 'c0d47abe-1507-422f-8dc6-f762a742b6c6', '59b89b41-db84-4400-a9f5-d10e77155229'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:49:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-11ebaccb-4e8c-4adc-bca9-4beb5dc797d5 tempest-VolumesDeleteCascade-90985742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:49:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-11ebaccb-4e8c-4adc-bca9-4beb5dc797d5 tempest-VolumesDeleteCascade-90985742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:49:35 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-11ebaccb-4e8c-4adc-bca9-4beb5dc797d5 tempest-VolumesDeleteCascade-90985742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:49:35 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-11ebaccb-4e8c-4adc-bca9-4beb5dc797d5 tempest-VolumesDeleteCascade-90985742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:49:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-11ebaccb-4e8c-4adc-bca9-4beb5dc797d5 tempest-VolumesDeleteCascade-90985742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:49:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-11ebaccb-4e8c-4adc-bca9-4beb5dc797d5 tempest-VolumesDeleteCascade-90985742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:35 devstack sudo[88798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:49:35 devstack sudo[88798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:35 devstack sudo[88792]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ad3fadd7-b021-40bf-9073-4cb2f529bf53 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b" returned: 0 in 1.693s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ad3fadd7-b021-40bf-9073-4cb2f529bf53 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b.6ae0dd87-494a-4acf-a5b9-1ff0fd9eacd9 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:35 devstack sudo[88800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b.6ae0dd87-494a-4acf-a5b9-1ff0fd9eacd9
Apr 09 12:49:35 devstack sudo[88800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:35 devstack sudo[88770]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-340d1e4e-dfaa-4f9c-a0f8-fd822a155010 tempest-VolumesActionsTest-2093358557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ca2d894e-5587-4797-9daa-d4fe29c9414d /opt/stack/data/cinder/conversion/ca2d894e-5587-4797-9daa-d4fe29c9414d.temp_image.b7fc48c3-ec73-4ebb-aba4-f3973511a328d0xlli1s.img" returned: 0 in 2.358s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:35 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3190fe-c79f-430b-9a6c-8dc46fb9d54c]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:49:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-340d1e4e-dfaa-4f9c-a0f8-fd822a155010 tempest-VolumesActionsTest-2093358557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ca2d894e-5587-4797-9daa-d4fe29c9414d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:35 devstack sudo[88802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ca2d894e-5587-4797-9daa-d4fe29c9414d
Apr 09 12:49:35 devstack sudo[88802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:36 devstack sudo[88798]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:36 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-11ebaccb-4e8c-4adc-bca9-4beb5dc797d5 tempest-VolumesDeleteCascade-90985742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.614s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:36 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-11ebaccb-4e8c-4adc-bca9-4beb5dc797d5 tempest-VolumesDeleteCascade-90985742 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:49:36 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-11ebaccb-4e8c-4adc-bca9-4beb5dc797d5 tempest-VolumesDeleteCascade-90985742 None] Deleted volume successfully.
Apr 09 12:49:36 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-11ebaccb-4e8c-4adc-bca9-4beb5dc797d5 tempest-VolumesDeleteCascade-90985742 None] Lock "cinder-bbbb6a16-b42b-4555-9ffe-54e525299d63-delete_volume" released by "delete_volume" :: held 5.566s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:49:36 devstack sudo[88800]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:36 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ad3fadd7-b021-40bf-9073-4cb2f529bf53 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b.6ae0dd87-494a-4acf-a5b9-1ff0fd9eacd9" returned: 0 in 0.552s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:36 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ad3fadd7-b021-40bf-9073-4cb2f529bf53 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b.6ae0dd87-494a-4acf-a5b9-1ff0fd9eacd9 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:36 devstack sudo[88810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b.6ae0dd87-494a-4acf-a5b9-1ff0fd9eacd9
Apr 09 12:49:36 devstack sudo[88810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:36 devstack sudo[88802]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:36 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-7ee260a0-3a22-43e3-9a35-8892c8795f35 tempest-VolumesDeleteCascade-90985742 None] Acquiring lock "cinder-2d725556-be00-40e1-b1e7-7a50f999a52c-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:49:36 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-340d1e4e-dfaa-4f9c-a0f8-fd822a155010 tempest-VolumesActionsTest-2093358557 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ca2d894e-5587-4797-9daa-d4fe29c9414d" returned: 0 in 0.709s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:36 devstack cinder-volume[82760]: DEBUG cinder.image.image_utils [None req-340d1e4e-dfaa-4f9c-a0f8-fd822a155010 tempest-VolumesActionsTest-2093358557 None] Image conversion details: src /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ca2d894e-5587-4797-9daa-d4fe29c9414d, size 1024.00 MB, duration 2.36 sec, destination /opt/stack/data/cinder/conversion/ca2d894e-5587-4797-9daa-d4fe29c9414d.temp_image.b7fc48c3-ec73-4ebb-aba4-f3973511a328d0xlli1s.img {{(pid=82760) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 12:49:36 devstack cinder-volume[82760]: INFO cinder.image.image_utils [None req-340d1e4e-dfaa-4f9c-a0f8-fd822a155010 tempest-VolumesActionsTest-2093358557 None] Converted 1024.00 MB image at 433.86 MB/s
Apr 09 12:49:36 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-7ee260a0-3a22-43e3-9a35-8892c8795f35 tempest-VolumesDeleteCascade-90985742 None] Lock "cinder-2d725556-be00-40e1-b1e7-7a50f999a52c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:49:36 devstack cinder-volume[82760]: DEBUG cinder.image.image_utils [None req-340d1e4e-dfaa-4f9c-a0f8-fd822a155010 tempest-VolumesActionsTest-2093358557 None] b7fc48c3-ec73-4ebb-aba4-f3973511a328 was raw, converting to qcow2 {{(pid=82760) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}}
Apr 09 12:49:36 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-7ee260a0-3a22-43e3-9a35-8892c8795f35 tempest-VolumesDeleteCascade-90985742 None] Acquiring lock "cinder-quobyte-2d725556-be00-40e1-b1e7-7a50f999a52c" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:49:36 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[12122da6-bf50-4fea-8533-3d1be851f0c7]: (4, 'raw') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:49:36 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-340d1e4e-dfaa-4f9c-a0f8-fd822a155010 tempest-VolumesActionsTest-2093358557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ca2d894e-5587-4797-9daa-d4fe29c9414d.temp_image.b7fc48c3-ec73-4ebb-aba4-f3973511a328d0xlli1s.img {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:36 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-7ee260a0-3a22-43e3-9a35-8892c8795f35 tempest-VolumesDeleteCascade-90985742 None] Lock "cinder-quobyte-2d725556-be00-40e1-b1e7-7a50f999a52c" acquired by "delete_volume" :: waited 0.022s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:49:36 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[43df2c66-bd47-43e4-8e73-f5d1a948c9c8]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:49:36 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-7ee260a0-3a22-43e3-9a35-8892c8795f35 tempest-VolumesDeleteCascade-90985742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2d725556-be00-40e1-b1e7-7a50f999a52c {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:36 devstack sudo[88813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ca2d894e-5587-4797-9daa-d4fe29c9414d.temp_image.b7fc48c3-ec73-4ebb-aba4-f3973511a328d0xlli1s.img
Apr 09 12:49:36 devstack sudo[88813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:36 devstack sudo[88814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2d725556-be00-40e1-b1e7-7a50f999a52c
Apr 09 12:49:36 devstack sudo[88814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:36 devstack sudo[88810]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:36 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ad3fadd7-b021-40bf-9073-4cb2f529bf53 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b.6ae0dd87-494a-4acf-a5b9-1ff0fd9eacd9" returned: 0 in 0.620s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:36 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ad3fadd7-b021-40bf-9073-4cb2f529bf53 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Lock "cinder-quobyte-6ae0dd87-494a-4acf-a5b9-1ff0fd9eacd9" released by "_delete_snapshot" :: held 3.606s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:49:36 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ad3fadd7-b021-40bf-9073-4cb2f529bf53 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Lock "cinder-quobyte-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b" released by "delete_snapshot" :: held 3.623s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:49:36 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-ad3fadd7-b021-40bf-9073-4cb2f529bf53 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Created reservations ['66eb2038-ff6b-4a12-a77f-ebc7b49ba7b8', '772198b6-7b16-41c1-a018-9c5e6751cb18', '98478767-43d2-4b9d-a47a-e6f0c6a71260', '8aeb4bf4-f587-4a84-961f-b5f0cde0d1a1'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:49:36 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-ad3fadd7-b021-40bf-9073-4cb2f529bf53 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Delete snapshot completed successfully.
Apr 09 12:49:36 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ad3fadd7-b021-40bf-9073-4cb2f529bf53 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Lock "cinder-6ae0dd87-494a-4acf-a5b9-1ff0fd9eacd9-delete_snapshot" released by "delete_snapshot" :: held 3.748s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:49:37 devstack sudo[88813]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:37 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-340d1e4e-dfaa-4f9c-a0f8-fd822a155010 tempest-VolumesActionsTest-2093358557 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ca2d894e-5587-4797-9daa-d4fe29c9414d.temp_image.b7fc48c3-ec73-4ebb-aba4-f3973511a328d0xlli1s.img" returned: 0 in 0.586s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:37 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-340d1e4e-dfaa-4f9c-a0f8-fd822a155010 tempest-VolumesActionsTest-2093358557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ca2d894e-5587-4797-9daa-d4fe29c9414d.temp_image.b7fc48c3-ec73-4ebb-aba4-f3973511a328d0xlli1s.img {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:37 devstack sudo[88814]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:37 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-7ee260a0-3a22-43e3-9a35-8892c8795f35 tempest-VolumesDeleteCascade-90985742 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2d725556-be00-40e1-b1e7-7a50f999a52c" returned: 0 in 0.574s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:37 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-7ee260a0-3a22-43e3-9a35-8892c8795f35 tempest-VolumesDeleteCascade-90985742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2d725556-be00-40e1-b1e7-7a50f999a52c {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:37 devstack sudo[88824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2d725556-be00-40e1-b1e7-7a50f999a52c
Apr 09 12:49:37 devstack sudo[88824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:37 devstack sudo[88823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ca2d894e-5587-4797-9daa-d4fe29c9414d.temp_image.b7fc48c3-ec73-4ebb-aba4-f3973511a328d0xlli1s.img
Apr 09 12:49:37 devstack sudo[88823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:37 devstack sudo[88824]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:37 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-7ee260a0-3a22-43e3-9a35-8892c8795f35 tempest-VolumesDeleteCascade-90985742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2d725556-be00-40e1-b1e7-7a50f999a52c" returned: 0 in 0.489s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:37 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-7ee260a0-3a22-43e3-9a35-8892c8795f35 tempest-VolumesDeleteCascade-90985742 None] Lock "cinder-quobyte-2d725556-be00-40e1-b1e7-7a50f999a52c" released by "delete_volume" :: held 1.095s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:49:37 devstack sudo[88823]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:37 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-340d1e4e-dfaa-4f9c-a0f8-fd822a155010 tempest-VolumesActionsTest-2093358557 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ca2d894e-5587-4797-9daa-d4fe29c9414d.temp_image.b7fc48c3-ec73-4ebb-aba4-f3973511a328d0xlli1s.img" returned: 1 in 0.532s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:37 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-340d1e4e-dfaa-4f9c-a0f8-fd822a155010 tempest-VolumesActionsTest-2093358557 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ca2d894e-5587-4797-9daa-d4fe29c9414d.temp_image.b7fc48c3-ec73-4ebb-aba4-f3973511a328d0xlli1s.img' failed. Not Retrying. {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 09 12:49:37 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-340d1e4e-dfaa-4f9c-a0f8-fd822a155010 tempest-VolumesActionsTest-2093358557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ca2d894e-5587-4797-9daa-d4fe29c9414d.temp_image.b7fc48c3-ec73-4ebb-aba4-f3973511a328d0xlli1s.img /opt/stack/data/cinder/conversion/vol_upload_et6l48ps {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:37 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-6c6b93b0-f152-449c-b83e-a5fb7b90c7a2 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Acquiring lock "cinder-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:49:37 devstack sudo[88831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ca2d894e-5587-4797-9daa-d4fe29c9414d.temp_image.b7fc48c3-ec73-4ebb-aba4-f3973511a328d0xlli1s.img /opt/stack/data/cinder/conversion/vol_upload_et6l48ps
Apr 09 12:49:37 devstack sudo[88831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:37 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-6c6b93b0-f152-449c-b83e-a5fb7b90c7a2 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Lock "cinder-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:49:37 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-7ee260a0-3a22-43e3-9a35-8892c8795f35 tempest-VolumesDeleteCascade-90985742 None] Created reservations ['a08fd7ec-f3d3-4fe2-9807-a761f6171f50', 'e751a12d-fdc1-4efe-a9d6-f08a36df4f1a', '38b5602b-62d7-4e7e-a4f7-bf38070b954b', '4d64fad7-3bd2-49c9-a876-6ca056762941'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:49:37 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-6c6b93b0-f152-449c-b83e-a5fb7b90c7a2 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Acquiring lock "cinder-quobyte-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:49:37 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-6c6b93b0-f152-449c-b83e-a5fb7b90c7a2 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Lock "cinder-quobyte-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b" acquired by "delete_volume" :: waited 0.019s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:49:37 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[782ea9e8-74ed-4819-a2d7-e2ef892053df]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:49:37 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6c6b93b0-f152-449c-b83e-a5fb7b90c7a2 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:37 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-7ee260a0-3a22-43e3-9a35-8892c8795f35 tempest-VolumesDeleteCascade-90985742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:49:37 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-7ee260a0-3a22-43e3-9a35-8892c8795f35 tempest-VolumesDeleteCascade-90985742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:49:37 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-7ee260a0-3a22-43e3-9a35-8892c8795f35 tempest-VolumesDeleteCascade-90985742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:49:37 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-7ee260a0-3a22-43e3-9a35-8892c8795f35 tempest-VolumesDeleteCascade-90985742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:49:37 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-7ee260a0-3a22-43e3-9a35-8892c8795f35 tempest-VolumesDeleteCascade-90985742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:49:37 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-7ee260a0-3a22-43e3-9a35-8892c8795f35 tempest-VolumesDeleteCascade-90985742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:37 devstack sudo[88833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b
Apr 09 12:49:37 devstack sudo[88833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:37 devstack sudo[88834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:49:37 devstack sudo[88834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:38 devstack sudo[88831]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-340d1e4e-dfaa-4f9c-a0f8-fd822a155010 tempest-VolumesActionsTest-2093358557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ca2d894e-5587-4797-9daa-d4fe29c9414d.temp_image.b7fc48c3-ec73-4ebb-aba4-f3973511a328d0xlli1s.img /opt/stack/data/cinder/conversion/vol_upload_et6l48ps" returned: 0 in 0.542s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:38 devstack cinder-volume[82760]: DEBUG cinder.image.image_utils [None req-340d1e4e-dfaa-4f9c-a0f8-fd822a155010 tempest-VolumesActionsTest-2093358557 None] Image conversion details: src /opt/stack/data/cinder/conversion/ca2d894e-5587-4797-9daa-d4fe29c9414d.temp_image.b7fc48c3-ec73-4ebb-aba4-f3973511a328d0xlli1s.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_et6l48ps {{(pid=82760) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 12:49:38 devstack cinder-volume[82760]: INFO cinder.image.image_utils [None req-340d1e4e-dfaa-4f9c-a0f8-fd822a155010 tempest-VolumesActionsTest-2093358557 None] Converted 1024.00 MB image at 1024.00 MB/s
Apr 09 12:49:38 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbd6303-94c4-42c4-be46-7e0e1d2434e9]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:49:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-340d1e4e-dfaa-4f9c-a0f8-fd822a155010 tempest-VolumesActionsTest-2093358557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_et6l48ps {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:38 devstack sudo[88840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_et6l48ps
Apr 09 12:49:38 devstack sudo[88840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:38 devstack sudo[88834]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-7ee260a0-3a22-43e3-9a35-8892c8795f35 tempest-VolumesDeleteCascade-90985742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.475s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:38 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-7ee260a0-3a22-43e3-9a35-8892c8795f35 tempest-VolumesDeleteCascade-90985742 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:49:38 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-7ee260a0-3a22-43e3-9a35-8892c8795f35 tempest-VolumesDeleteCascade-90985742 None] Deleted volume successfully.
Apr 09 12:49:38 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-7ee260a0-3a22-43e3-9a35-8892c8795f35 tempest-VolumesDeleteCascade-90985742 None] Lock "cinder-2d725556-be00-40e1-b1e7-7a50f999a52c-delete_volume" released by "delete_volume" :: held 1.871s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:49:38 devstack sudo[88833]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6c6b93b0-f152-449c-b83e-a5fb7b90c7a2 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b" returned: 0 in 0.599s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6c6b93b0-f152-449c-b83e-a5fb7b90c7a2 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:38 devstack sudo[88846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b
Apr 09 12:49:38 devstack sudo[88846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:38 devstack sudo[88840]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-340d1e4e-dfaa-4f9c-a0f8-fd822a155010 tempest-VolumesActionsTest-2093358557 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_et6l48ps" returned: 0 in 0.595s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:38 devstack sudo[88846]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6c6b93b0-f152-449c-b83e-a5fb7b90c7a2 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b" returned: 0 in 0.613s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:38 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-6c6b93b0-f152-449c-b83e-a5fb7b90c7a2 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Lock "cinder-quobyte-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b" released by "delete_volume" :: held 1.258s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:49:38 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-6c6b93b0-f152-449c-b83e-a5fb7b90c7a2 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Created reservations ['7be2510d-c0f6-4a22-9eb7-f63d65f6f2e1', '46c9e349-4cbd-4228-bc5b-734a9ce3c6ff', 'f22f9ceb-d92f-4809-bca4-2f58e28544dd', 'a03fb78e-d1a8-4cfe-8b87-5576fdab5f98'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:49:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-6c6b93b0-f152-449c-b83e-a5fb7b90c7a2 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:49:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-6c6b93b0-f152-449c-b83e-a5fb7b90c7a2 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:49:39 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-6c6b93b0-f152-449c-b83e-a5fb7b90c7a2 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:49:39 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-6c6b93b0-f152-449c-b83e-a5fb7b90c7a2 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:49:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-6c6b93b0-f152-449c-b83e-a5fb7b90c7a2 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:49:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6c6b93b0-f152-449c-b83e-a5fb7b90c7a2 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:39 devstack sudo[88852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:49:39 devstack sudo[88852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:39 devstack sudo[88852]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6c6b93b0-f152-449c-b83e-a5fb7b90c7a2 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.632s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:39 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-6c6b93b0-f152-449c-b83e-a5fb7b90c7a2 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:49:39 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-6c6b93b0-f152-449c-b83e-a5fb7b90c7a2 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Deleted volume successfully.
Apr 09 12:49:39 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-6c6b93b0-f152-449c-b83e-a5fb7b90c7a2 tempest-VolumesSnapshotNegativeTestJSON-1073211932 None] Lock "cinder-e78cdf44-cc6f-450c-8a42-0dc72f1dff0b-delete_volume" released by "delete_volume" :: held 2.082s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:49:40 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-340d1e4e-dfaa-4f9c-a0f8-fd822a155010 tempest-VolumesActionsTest-2093358557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.025s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:49:40 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-340d1e4e-dfaa-4f9c-a0f8-fd822a155010 tempest-VolumesActionsTest-2093358557 None] Uploaded volume to glance image-id: b7fc48c3-ec73-4ebb-aba4-f3973511a328. {{(pid=82760) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 09 12:49:40 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-340d1e4e-dfaa-4f9c-a0f8-fd822a155010 tempest-VolumesActionsTest-2093358557 None] Copy volume to image completed successfully.
Apr 09 12:49:41 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-cde8de52-a6c1-4dae-9904-13d3136f3d5e tempest-VolumesActionsTest-2093358557 None] Acquiring lock "cinder-ca2d894e-5587-4797-9daa-d4fe29c9414d-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:49:41 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-cde8de52-a6c1-4dae-9904-13d3136f3d5e tempest-VolumesActionsTest-2093358557 None] Lock "cinder-ca2d894e-5587-4797-9daa-d4fe29c9414d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:49:41 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-cde8de52-a6c1-4dae-9904-13d3136f3d5e tempest-VolumesActionsTest-2093358557 None] Acquiring lock "cinder-quobyte-ca2d894e-5587-4797-9daa-d4fe29c9414d" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:49:41 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-cde8de52-a6c1-4dae-9904-13d3136f3d5e tempest-VolumesActionsTest-2093358557 None] Lock "cinder-quobyte-ca2d894e-5587-4797-9daa-d4fe29c9414d" acquired by "delete_volume" :: waited 0.011s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:49:41 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc57c00-1216-4986-9da1-2899b90a36d0]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:49:41 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-cde8de52-a6c1-4dae-9904-13d3136f3d5e tempest-VolumesActionsTest-2093358557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ca2d894e-5587-4797-9daa-d4fe29c9414d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:41 devstack sudo[88890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ca2d894e-5587-4797-9daa-d4fe29c9414d
Apr 09 12:49:41 devstack sudo[88890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:42 devstack sudo[88890]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:42 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-cde8de52-a6c1-4dae-9904-13d3136f3d5e tempest-VolumesActionsTest-2093358557 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ca2d894e-5587-4797-9daa-d4fe29c9414d" returned: 0 in 0.662s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:42 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-cde8de52-a6c1-4dae-9904-13d3136f3d5e tempest-VolumesActionsTest-2093358557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ca2d894e-5587-4797-9daa-d4fe29c9414d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:42 devstack sudo[88895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ca2d894e-5587-4797-9daa-d4fe29c9414d
Apr 09 12:49:42 devstack sudo[88895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:42 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-666d2640-a92d-4a10-a361-77d67387f0e2 tempest-CreateVolumesFromImageTest-6362499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:49:42 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-666d2640-a92d-4a10-a361-77d67387f0e2 tempest-CreateVolumesFromImageTest-6362499 None] Flow 'volume_create_manager' (b7b069b9-35a2-4d6a-b0be-3b766b1ec300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:49:42 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-666d2640-a92d-4a10-a361-77d67387f0e2 tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (944f81f9-aebc-442f-bc62-d299cc1ded07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:42 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-666d2640-a92d-4a10-a361-77d67387f0e2 tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (944f81f9-aebc-442f-bc62-d299cc1ded07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:49:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-570149338',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1609aa42-e224-4e62-aa12-b39c762b4007,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab2b284631e842b1990f1772394c671d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:49:43Z,use_quota=True,user_id='ea72235c213d40acadfae81c47ab27b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:42 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-666d2640-a92d-4a10-a361-77d67387f0e2 tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c7a5d84-1f6b-4cfd-8dff-3a79ea437941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:42 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-666d2640-a92d-4a10-a361-77d67387f0e2 tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c7a5d84-1f6b-4cfd-8dff-3a79ea437941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:42 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-666d2640-a92d-4a10-a361-77d67387f0e2 tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3257b0cb-6816-4acb-b653-c77019c3fe37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:42 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-666d2640-a92d-4a10-a361-77d67387f0e2 tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3257b0cb-6816-4acb-b653-c77019c3fe37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1609aa42-e224-4e62-aa12-b39c762b4007', 'volume_name': 'volume-1609aa42-e224-4e62-aa12-b39c762b4007', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:42 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-666d2640-a92d-4a10-a361-77d67387f0e2 tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df040547-3f65-441e-af57-760612faaf5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:42 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-666d2640-a92d-4a10-a361-77d67387f0e2 tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df040547-3f65-441e-af57-760612faaf5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:42 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-666d2640-a92d-4a10-a361-77d67387f0e2 tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce05d181-2632-4dc4-a9bf-d07a91259409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:42 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-666d2640-a92d-4a10-a361-77d67387f0e2 tempest-CreateVolumesFromImageTest-6362499 None] Volume 1609aa42-e224-4e62-aa12-b39c762b4007: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1609aa42-e224-4e62-aa12-b39c762b4007', 'volume_size': 1}
Apr 09 12:49:42 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-666d2640-a92d-4a10-a361-77d67387f0e2 tempest-CreateVolumesFromImageTest-6362499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:49:42 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-666d2640-a92d-4a10-a361-77d67387f0e2 tempest-CreateVolumesFromImageTest-6362499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:49:42 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-666d2640-a92d-4a10-a361-77d67387f0e2 tempest-CreateVolumesFromImageTest-6362499 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:49:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-570149338',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1609aa42-e224-4e62-aa12-b39c762b4007,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab2b284631e842b1990f1772394c671d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:49:43Z,use_quota=True,user_id='ea72235c213d40acadfae81c47ab27b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:49:42 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-666d2640-a92d-4a10-a361-77d67387f0e2 tempest-CreateVolumesFromImageTest-6362499 None] Creating volume 1609aa42-e224-4e62-aa12-b39c762b4007 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:49:42 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-666d2640-a92d-4a10-a361-77d67387f0e2 tempest-CreateVolumesFromImageTest-6362499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:49:42 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-666d2640-a92d-4a10-a361-77d67387f0e2 tempest-CreateVolumesFromImageTest-6362499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:49:42 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-666d2640-a92d-4a10-a361-77d67387f0e2 tempest-CreateVolumesFromImageTest-6362499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:49:42 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-666d2640-a92d-4a10-a361-77d67387f0e2 tempest-CreateVolumesFromImageTest-6362499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:49:42 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-666d2640-a92d-4a10-a361-77d67387f0e2 tempest-CreateVolumesFromImageTest-6362499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:49:42 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-666d2640-a92d-4a10-a361-77d67387f0e2 tempest-CreateVolumesFromImageTest-6362499 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:49:42 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-666d2640-a92d-4a10-a361-77d67387f0e2 tempest-CreateVolumesFromImageTest-6362499 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:49:42 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-666d2640-a92d-4a10-a361-77d67387f0e2 tempest-CreateVolumesFromImageTest-6362499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1609aa42-e224-4e62-aa12-b39c762b4007 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:42 devstack sudo[88898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1609aa42-e224-4e62-aa12-b39c762b4007 1073741824
Apr 09 12:49:42 devstack sudo[88898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:43 devstack sudo[88895]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:43 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-cde8de52-a6c1-4dae-9904-13d3136f3d5e tempest-VolumesActionsTest-2093358557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ca2d894e-5587-4797-9daa-d4fe29c9414d" returned: 0 in 0.603s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:43 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-cde8de52-a6c1-4dae-9904-13d3136f3d5e tempest-VolumesActionsTest-2093358557 None] Lock "cinder-quobyte-ca2d894e-5587-4797-9daa-d4fe29c9414d" released by "delete_volume" :: held 1.327s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:49:43 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f61dadc-badf-41be-8547-fa64985a72c3 tempest-CreateVolumesFromImageTest-6362499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:49:43 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8f61dadc-badf-41be-8547-fa64985a72c3 tempest-CreateVolumesFromImageTest-6362499 None] Flow 'volume_create_manager' (758d32f4-9e81-4a7b-b6f9-25fc3c77067c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:49:43 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8f61dadc-badf-41be-8547-fa64985a72c3 tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02b75307-0654-495d-980d-76886dc82e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:43 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8f61dadc-badf-41be-8547-fa64985a72c3 tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02b75307-0654-495d-980d-76886dc82e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:49:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1405857911',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f920902-2cde-4c55-bb7d-c08431acb7a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab2b284631e842b1990f1772394c671d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:49:43Z,use_quota=True,user_id='ea72235c213d40acadfae81c47ab27b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:43 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8f61dadc-badf-41be-8547-fa64985a72c3 tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c46fe4f0-a026-42f3-9beb-a30b26d3844d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:43 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8f61dadc-badf-41be-8547-fa64985a72c3 tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c46fe4f0-a026-42f3-9beb-a30b26d3844d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:43 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8f61dadc-badf-41be-8547-fa64985a72c3 tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0870a856-83dc-49da-b174-f22787d9c5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:43 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8f61dadc-badf-41be-8547-fa64985a72c3 tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0870a856-83dc-49da-b174-f22787d9c5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f920902-2cde-4c55-bb7d-c08431acb7a2', 'volume_name': 'volume-9f920902-2cde-4c55-bb7d-c08431acb7a2', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:43 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8f61dadc-badf-41be-8547-fa64985a72c3 tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb49955f-767c-4b62-99a9-7a947a1a38eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:43 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8f61dadc-badf-41be-8547-fa64985a72c3 tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb49955f-767c-4b62-99a9-7a947a1a38eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:43 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8f61dadc-badf-41be-8547-fa64985a72c3 tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3ee02a9-df3c-4e83-8675-c4b918f6c900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:43 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-8f61dadc-badf-41be-8547-fa64985a72c3 tempest-CreateVolumesFromImageTest-6362499 None] Volume 9f920902-2cde-4c55-bb7d-c08431acb7a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f920902-2cde-4c55-bb7d-c08431acb7a2', 'volume_size': 1}
Apr 09 12:49:43 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-8f61dadc-badf-41be-8547-fa64985a72c3 tempest-CreateVolumesFromImageTest-6362499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:49:43 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-cde8de52-a6c1-4dae-9904-13d3136f3d5e tempest-VolumesActionsTest-2093358557 None] Created reservations ['9831564b-3649-4ee7-8b99-1f06ca2bf062', '68471938-96af-477d-a3b4-a730261e24be', '430544ba-55b6-4ad4-aab1-0ec0d167aa4e', '2511edfb-a40b-4ea5-ad37-ee033195a6bd'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:49:43 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-cde8de52-a6c1-4dae-9904-13d3136f3d5e tempest-VolumesActionsTest-2093358557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:49:43 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-cde8de52-a6c1-4dae-9904-13d3136f3d5e tempest-VolumesActionsTest-2093358557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:49:43 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-cde8de52-a6c1-4dae-9904-13d3136f3d5e tempest-VolumesActionsTest-2093358557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:49:43 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-cde8de52-a6c1-4dae-9904-13d3136f3d5e tempest-VolumesActionsTest-2093358557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:49:43 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-cde8de52-a6c1-4dae-9904-13d3136f3d5e tempest-VolumesActionsTest-2093358557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:49:43 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-cde8de52-a6c1-4dae-9904-13d3136f3d5e tempest-VolumesActionsTest-2093358557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:43 devstack sudo[88903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:49:43 devstack sudo[88903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:43 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-91cc47eb-a554-43fe-a76a-5d6dda6d439b tempest-CreateVolumesFromImageTest-6362499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:49:43 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-91cc47eb-a554-43fe-a76a-5d6dda6d439b tempest-CreateVolumesFromImageTest-6362499 None] Flow 'volume_create_manager' (dc061fe7-fddb-4b35-8fa2-90243d65135e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:49:43 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-91cc47eb-a554-43fe-a76a-5d6dda6d439b tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6b5b745-e9b2-4465-9cbc-e0637dc5bb16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:43 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-91cc47eb-a554-43fe-a76a-5d6dda6d439b tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6b5b745-e9b2-4465-9cbc-e0637dc5bb16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:49:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-25254340',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=966ae37a-dbfe-411b-a471-c8e135e72a22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab2b284631e842b1990f1772394c671d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:49:43Z,use_quota=True,user_id='ea72235c213d40acadfae81c47ab27b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:43 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-91cc47eb-a554-43fe-a76a-5d6dda6d439b tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed2db611-06d0-4d44-826a-0cb4ca9c79a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:43 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-91cc47eb-a554-43fe-a76a-5d6dda6d439b tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed2db611-06d0-4d44-826a-0cb4ca9c79a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:43 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-91cc47eb-a554-43fe-a76a-5d6dda6d439b tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60b1ea95-aa6d-4c0d-959d-044cf8708e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:43 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-91cc47eb-a554-43fe-a76a-5d6dda6d439b tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60b1ea95-aa6d-4c0d-959d-044cf8708e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '966ae37a-dbfe-411b-a471-c8e135e72a22', 'volume_name': 'volume-966ae37a-dbfe-411b-a471-c8e135e72a22', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:43 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-91cc47eb-a554-43fe-a76a-5d6dda6d439b tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f33656b-c922-45e4-94c9-e3ef6054cc10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:43 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-91cc47eb-a554-43fe-a76a-5d6dda6d439b tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f33656b-c922-45e4-94c9-e3ef6054cc10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:43 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-91cc47eb-a554-43fe-a76a-5d6dda6d439b tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73ce64cd-a97c-4063-986f-817826e0c4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:43 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-91cc47eb-a554-43fe-a76a-5d6dda6d439b tempest-CreateVolumesFromImageTest-6362499 None] Volume 966ae37a-dbfe-411b-a471-c8e135e72a22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-966ae37a-dbfe-411b-a471-c8e135e72a22', 'volume_size': 1}
Apr 09 12:49:43 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-91cc47eb-a554-43fe-a76a-5d6dda6d439b tempest-CreateVolumesFromImageTest-6362499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:49:43 devstack sudo[88898]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:43 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-666d2640-a92d-4a10-a361-77d67387f0e2 tempest-CreateVolumesFromImageTest-6362499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1609aa42-e224-4e62-aa12-b39c762b4007 1073741824" returned: 0 in 0.841s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:43 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-666d2640-a92d-4a10-a361-77d67387f0e2 tempest-CreateVolumesFromImageTest-6362499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1609aa42-e224-4e62-aa12-b39c762b4007 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:43 devstack sudo[88906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1609aa42-e224-4e62-aa12-b39c762b4007
Apr 09 12:49:43 devstack sudo[88906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:43 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a1b1608-7880-4e0b-acd4-b62aacf68ea8 tempest-CreateVolumesFromImageTest-6362499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:49:43 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-9a1b1608-7880-4e0b-acd4-b62aacf68ea8 tempest-CreateVolumesFromImageTest-6362499 None] Flow 'volume_create_manager' (d8ce139a-8b56-424f-8a37-da5f08164920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:49:43 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-9a1b1608-7880-4e0b-acd4-b62aacf68ea8 tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee1fae9e-a560-4508-b974-6c4361a55649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:43 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-9a1b1608-7880-4e0b-acd4-b62aacf68ea8 tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee1fae9e-a560-4508-b974-6c4361a55649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:49:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-159496721',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcb9a11e-9a7a-4c74-85c9-85c093f0d538,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab2b284631e842b1990f1772394c671d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:49:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:49:44Z,use_quota=True,user_id='ea72235c213d40acadfae81c47ab27b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:43 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-9a1b1608-7880-4e0b-acd4-b62aacf68ea8 tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7e1cab2-d0d0-4512-9bbe-238f167b13a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:43 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-9a1b1608-7880-4e0b-acd4-b62aacf68ea8 tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7e1cab2-d0d0-4512-9bbe-238f167b13a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:43 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-9a1b1608-7880-4e0b-acd4-b62aacf68ea8 tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9c5ed3b-f35d-433a-aace-e69d5519e218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:43 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-9a1b1608-7880-4e0b-acd4-b62aacf68ea8 tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9c5ed3b-f35d-433a-aace-e69d5519e218) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcb9a11e-9a7a-4c74-85c9-85c093f0d538', 'volume_name': 'volume-fcb9a11e-9a7a-4c74-85c9-85c093f0d538', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:43 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-9a1b1608-7880-4e0b-acd4-b62aacf68ea8 tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9df02919-6019-4149-acd0-a5aed20f4d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:43 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-9a1b1608-7880-4e0b-acd4-b62aacf68ea8 tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9df02919-6019-4149-acd0-a5aed20f4d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:43 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-9a1b1608-7880-4e0b-acd4-b62aacf68ea8 tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1ef5fd7-84dd-4e5b-9053-8a1d83c5bdad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:43 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-9a1b1608-7880-4e0b-acd4-b62aacf68ea8 tempest-CreateVolumesFromImageTest-6362499 None] Volume fcb9a11e-9a7a-4c74-85c9-85c093f0d538: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcb9a11e-9a7a-4c74-85c9-85c093f0d538', 'volume_size': 1}
Apr 09 12:49:43 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-9a1b1608-7880-4e0b-acd4-b62aacf68ea8 tempest-CreateVolumesFromImageTest-6362499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:49:44 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a7c963d-f015-4ae7-8f79-c164614e694d tempest-CreateVolumesFromImageTest-6362499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:49:44 devstack sudo[88903]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:44 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-9a7c963d-f015-4ae7-8f79-c164614e694d tempest-CreateVolumesFromImageTest-6362499 None] Flow 'volume_create_manager' (d60db8d4-d820-4fe0-9af5-c6f9055f4acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:49:44 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-9a7c963d-f015-4ae7-8f79-c164614e694d tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48afb09d-a6df-41d8-a51c-972ffe2e3b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:44 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-cde8de52-a6c1-4dae-9904-13d3136f3d5e tempest-VolumesActionsTest-2093358557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.690s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:44 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-cde8de52-a6c1-4dae-9904-13d3136f3d5e tempest-VolumesActionsTest-2093358557 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:49:44 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-9a7c963d-f015-4ae7-8f79-c164614e694d tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48afb09d-a6df-41d8-a51c-972ffe2e3b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:49:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-766631807',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56a8d5c3-0723-4607-83c1-5911ac0f080c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab2b284631e842b1990f1772394c671d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:49:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:49:44Z,use_quota=True,user_id='ea72235c213d40acadfae81c47ab27b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:44 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-9a7c963d-f015-4ae7-8f79-c164614e694d tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04771a48-6ff9-4396-b014-bf8b14a82c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:44 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-9a7c963d-f015-4ae7-8f79-c164614e694d tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04771a48-6ff9-4396-b014-bf8b14a82c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:44 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-9a7c963d-f015-4ae7-8f79-c164614e694d tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc8b5a56-3d32-47c7-8a09-b5fc3311923a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:44 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-9a7c963d-f015-4ae7-8f79-c164614e694d tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc8b5a56-3d32-47c7-8a09-b5fc3311923a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56a8d5c3-0723-4607-83c1-5911ac0f080c', 'volume_name': 'volume-56a8d5c3-0723-4607-83c1-5911ac0f080c', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:44 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-9a7c963d-f015-4ae7-8f79-c164614e694d tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90eb0cc1-ddd4-4160-8fec-08f6dd4865b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:44 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-9a7c963d-f015-4ae7-8f79-c164614e694d tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90eb0cc1-ddd4-4160-8fec-08f6dd4865b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:44 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-9a7c963d-f015-4ae7-8f79-c164614e694d tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5d548e8-13fa-442f-a807-45081470d3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:44 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-9a7c963d-f015-4ae7-8f79-c164614e694d tempest-CreateVolumesFromImageTest-6362499 None] Volume 56a8d5c3-0723-4607-83c1-5911ac0f080c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56a8d5c3-0723-4607-83c1-5911ac0f080c', 'volume_size': 1}
Apr 09 12:49:44 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-9a7c963d-f015-4ae7-8f79-c164614e694d tempest-CreateVolumesFromImageTest-6362499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:49:44 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-cde8de52-a6c1-4dae-9904-13d3136f3d5e tempest-VolumesActionsTest-2093358557 None] Deleted volume successfully.
Apr 09 12:49:44 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-cde8de52-a6c1-4dae-9904-13d3136f3d5e tempest-VolumesActionsTest-2093358557 None] Lock "cinder-ca2d894e-5587-4797-9daa-d4fe29c9414d-delete_volume" released by "delete_volume" :: held 2.362s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:49:44 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1b46a65-ad69-4211-bdff-6976d705b3ab tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:49:44 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c1b46a65-ad69-4211-bdff-6976d705b3ab tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Flow 'volume_create_manager' (bb31bda1-123f-41fb-9420-187a50c1cbd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:49:44 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c1b46a65-ad69-4211-bdff-6976d705b3ab tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a645795-aaa8-4e50-b886-00b2b0865cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:44 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c1b46a65-ad69-4211-bdff-6976d705b3ab tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a645795-aaa8-4e50-b886-00b2b0865cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:49:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-283423072',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c59e6968-dd36-43c6-ae9b-6a71302d0442,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c6b80f4139f4edfb96692dbc45d987d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:49:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:49:44Z,use_quota=True,user_id='3beb3b0f083f4d749c98b0ac361d914b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:44 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c1b46a65-ad69-4211-bdff-6976d705b3ab tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8ad7f31-0a51-42ca-8a90-2c7c97fe8d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:44 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c1b46a65-ad69-4211-bdff-6976d705b3ab tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8ad7f31-0a51-42ca-8a90-2c7c97fe8d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:44 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c1b46a65-ad69-4211-bdff-6976d705b3ab tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4fc776f-7322-40a8-a9f3-b83505d3130b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:44 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c1b46a65-ad69-4211-bdff-6976d705b3ab tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4fc776f-7322-40a8-a9f3-b83505d3130b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c59e6968-dd36-43c6-ae9b-6a71302d0442', 'volume_name': 'volume-c59e6968-dd36-43c6-ae9b-6a71302d0442', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:44 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c1b46a65-ad69-4211-bdff-6976d705b3ab tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88582072-4ab9-496c-9b08-d66ce815054e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:44 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c1b46a65-ad69-4211-bdff-6976d705b3ab tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88582072-4ab9-496c-9b08-d66ce815054e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:44 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c1b46a65-ad69-4211-bdff-6976d705b3ab tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (562d75ae-2794-4450-8ddc-85e3303cd956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:44 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-c1b46a65-ad69-4211-bdff-6976d705b3ab tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Volume c59e6968-dd36-43c6-ae9b-6a71302d0442: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c59e6968-dd36-43c6-ae9b-6a71302d0442', 'volume_size': 1}
Apr 09 12:49:44 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c1b46a65-ad69-4211-bdff-6976d705b3ab tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:49:44 devstack sudo[88906]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:44 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-666d2640-a92d-4a10-a361-77d67387f0e2 tempest-CreateVolumesFromImageTest-6362499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1609aa42-e224-4e62-aa12-b39c762b4007" returned: 0 in 0.717s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:44 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-666d2640-a92d-4a10-a361-77d67387f0e2 tempest-CreateVolumesFromImageTest-6362499 None] <== create_volume: return (1594ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:49:44 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-666d2640-a92d-4a10-a361-77d67387f0e2 tempest-CreateVolumesFromImageTest-6362499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.598s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:49:44 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-8f61dadc-badf-41be-8547-fa64985a72c3 tempest-CreateVolumesFromImageTest-6362499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.156s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:49:44 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-8f61dadc-badf-41be-8547-fa64985a72c3 tempest-CreateVolumesFromImageTest-6362499 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:49:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1405857911',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f920902-2cde-4c55-bb7d-c08431acb7a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab2b284631e842b1990f1772394c671d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:49:43Z,use_quota=True,user_id='ea72235c213d40acadfae81c47ab27b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:49:44 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-8f61dadc-badf-41be-8547-fa64985a72c3 tempest-CreateVolumesFromImageTest-6362499 None] Creating volume 9f920902-2cde-4c55-bb7d-c08431acb7a2 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:49:44 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-8f61dadc-badf-41be-8547-fa64985a72c3 tempest-CreateVolumesFromImageTest-6362499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:49:44 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-8f61dadc-badf-41be-8547-fa64985a72c3 tempest-CreateVolumesFromImageTest-6362499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:49:44 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-8f61dadc-badf-41be-8547-fa64985a72c3 tempest-CreateVolumesFromImageTest-6362499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:49:44 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-8f61dadc-badf-41be-8547-fa64985a72c3 tempest-CreateVolumesFromImageTest-6362499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:49:44 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-8f61dadc-badf-41be-8547-fa64985a72c3 tempest-CreateVolumesFromImageTest-6362499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:49:44 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-8f61dadc-badf-41be-8547-fa64985a72c3 tempest-CreateVolumesFromImageTest-6362499 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:49:44 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-8f61dadc-badf-41be-8547-fa64985a72c3 tempest-CreateVolumesFromImageTest-6362499 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:49:44 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-8f61dadc-badf-41be-8547-fa64985a72c3 tempest-CreateVolumesFromImageTest-6362499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9f920902-2cde-4c55-bb7d-c08431acb7a2 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:44 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-666d2640-a92d-4a10-a361-77d67387f0e2 tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce05d181-2632-4dc4-a9bf-d07a91259409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1609aa42-e224-4e62-aa12-b39c762b4007', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:44 devstack sudo[88910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9f920902-2cde-4c55-bb7d-c08431acb7a2 1073741824
Apr 09 12:49:44 devstack sudo[88910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:44 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-666d2640-a92d-4a10-a361-77d67387f0e2 tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (294cc6b2-5860-4f11-a20b-e869c44a038d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:44 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-666d2640-a92d-4a10-a361-77d67387f0e2 tempest-CreateVolumesFromImageTest-6362499 None] Volume volume-1609aa42-e224-4e62-aa12-b39c762b4007 (1609aa42-e224-4e62-aa12-b39c762b4007): created successfully
Apr 09 12:49:44 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-666d2640-a92d-4a10-a361-77d67387f0e2 tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (294cc6b2-5860-4f11-a20b-e869c44a038d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:44 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-666d2640-a92d-4a10-a361-77d67387f0e2 tempest-CreateVolumesFromImageTest-6362499 None] Flow 'volume_create_manager' (b7b069b9-35a2-4d6a-b0be-3b766b1ec300) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:49:44 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-666d2640-a92d-4a10-a361-77d67387f0e2 tempest-CreateVolumesFromImageTest-6362499 None] Created volume successfully.
Apr 09 12:49:45 devstack sudo[88910]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:45 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-8f61dadc-badf-41be-8547-fa64985a72c3 tempest-CreateVolumesFromImageTest-6362499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9f920902-2cde-4c55-bb7d-c08431acb7a2 1073741824" returned: 0 in 0.659s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:45 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-8f61dadc-badf-41be-8547-fa64985a72c3 tempest-CreateVolumesFromImageTest-6362499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9f920902-2cde-4c55-bb7d-c08431acb7a2 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:45 devstack sudo[88915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9f920902-2cde-4c55-bb7d-c08431acb7a2
Apr 09 12:49:45 devstack sudo[88915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:45 devstack sudo[88915]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:45 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-8f61dadc-badf-41be-8547-fa64985a72c3 tempest-CreateVolumesFromImageTest-6362499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9f920902-2cde-4c55-bb7d-c08431acb7a2" returned: 0 in 0.551s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:45 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-8f61dadc-badf-41be-8547-fa64985a72c3 tempest-CreateVolumesFromImageTest-6362499 None] <== create_volume: return (1240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:49:45 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-8f61dadc-badf-41be-8547-fa64985a72c3 tempest-CreateVolumesFromImageTest-6362499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.246s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:49:45 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-91cc47eb-a554-43fe-a76a-5d6dda6d439b tempest-CreateVolumesFromImageTest-6362499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.081s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:49:45 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-91cc47eb-a554-43fe-a76a-5d6dda6d439b tempest-CreateVolumesFromImageTest-6362499 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:49:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-25254340',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=966ae37a-dbfe-411b-a471-c8e135e72a22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab2b284631e842b1990f1772394c671d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:49:43Z,use_quota=True,user_id='ea72235c213d40acadfae81c47ab27b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:49:45 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-91cc47eb-a554-43fe-a76a-5d6dda6d439b tempest-CreateVolumesFromImageTest-6362499 None] Creating volume 966ae37a-dbfe-411b-a471-c8e135e72a22 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:49:45 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-91cc47eb-a554-43fe-a76a-5d6dda6d439b tempest-CreateVolumesFromImageTest-6362499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:49:45 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-91cc47eb-a554-43fe-a76a-5d6dda6d439b tempest-CreateVolumesFromImageTest-6362499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:49:45 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-91cc47eb-a554-43fe-a76a-5d6dda6d439b tempest-CreateVolumesFromImageTest-6362499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:49:45 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-91cc47eb-a554-43fe-a76a-5d6dda6d439b tempest-CreateVolumesFromImageTest-6362499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:49:45 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-91cc47eb-a554-43fe-a76a-5d6dda6d439b tempest-CreateVolumesFromImageTest-6362499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:49:45 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-91cc47eb-a554-43fe-a76a-5d6dda6d439b tempest-CreateVolumesFromImageTest-6362499 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:49:45 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-91cc47eb-a554-43fe-a76a-5d6dda6d439b tempest-CreateVolumesFromImageTest-6362499 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:49:45 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-91cc47eb-a554-43fe-a76a-5d6dda6d439b tempest-CreateVolumesFromImageTest-6362499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-966ae37a-dbfe-411b-a471-c8e135e72a22 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:45 devstack sudo[88919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-966ae37a-dbfe-411b-a471-c8e135e72a22 1073741824
Apr 09 12:49:45 devstack sudo[88919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:45 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8f61dadc-badf-41be-8547-fa64985a72c3 tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3ee02a9-df3c-4e83-8675-c4b918f6c900) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f920902-2cde-4c55-bb7d-c08431acb7a2', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:45 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8f61dadc-badf-41be-8547-fa64985a72c3 tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b44c9a0e-de29-4515-b525-ba14c0177323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:45 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-8f61dadc-badf-41be-8547-fa64985a72c3 tempest-CreateVolumesFromImageTest-6362499 None] Volume volume-9f920902-2cde-4c55-bb7d-c08431acb7a2 (9f920902-2cde-4c55-bb7d-c08431acb7a2): created successfully
Apr 09 12:49:45 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8f61dadc-badf-41be-8547-fa64985a72c3 tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b44c9a0e-de29-4515-b525-ba14c0177323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:45 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8f61dadc-badf-41be-8547-fa64985a72c3 tempest-CreateVolumesFromImageTest-6362499 None] Flow 'volume_create_manager' (758d32f4-9e81-4a7b-b6f9-25fc3c77067c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:49:45 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-8f61dadc-badf-41be-8547-fa64985a72c3 tempest-CreateVolumesFromImageTest-6362499 None] Created volume successfully.
Apr 09 12:49:46 devstack sudo[88919]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-91cc47eb-a554-43fe-a76a-5d6dda6d439b tempest-CreateVolumesFromImageTest-6362499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-966ae37a-dbfe-411b-a471-c8e135e72a22 1073741824" returned: 0 in 0.629s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-91cc47eb-a554-43fe-a76a-5d6dda6d439b tempest-CreateVolumesFromImageTest-6362499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-966ae37a-dbfe-411b-a471-c8e135e72a22 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:46 devstack sudo[88924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-966ae37a-dbfe-411b-a471-c8e135e72a22
Apr 09 12:49:46 devstack sudo[88924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:46 devstack sudo[88924]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-91cc47eb-a554-43fe-a76a-5d6dda6d439b tempest-CreateVolumesFromImageTest-6362499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-966ae37a-dbfe-411b-a471-c8e135e72a22" returned: 0 in 0.502s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:46 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-91cc47eb-a554-43fe-a76a-5d6dda6d439b tempest-CreateVolumesFromImageTest-6362499 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:49:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-91cc47eb-a554-43fe-a76a-5d6dda6d439b tempest-CreateVolumesFromImageTest-6362499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:49:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-9a1b1608-7880-4e0b-acd4-b62aacf68ea8 tempest-CreateVolumesFromImageTest-6362499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.944s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:49:46 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-9a1b1608-7880-4e0b-acd4-b62aacf68ea8 tempest-CreateVolumesFromImageTest-6362499 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:49:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-159496721',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcb9a11e-9a7a-4c74-85c9-85c093f0d538,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab2b284631e842b1990f1772394c671d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:49:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:49:44Z,use_quota=True,user_id='ea72235c213d40acadfae81c47ab27b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:49:46 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-9a1b1608-7880-4e0b-acd4-b62aacf68ea8 tempest-CreateVolumesFromImageTest-6362499 None] Creating volume fcb9a11e-9a7a-4c74-85c9-85c093f0d538 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:49:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-9a1b1608-7880-4e0b-acd4-b62aacf68ea8 tempest-CreateVolumesFromImageTest-6362499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:49:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-9a1b1608-7880-4e0b-acd4-b62aacf68ea8 tempest-CreateVolumesFromImageTest-6362499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:49:46 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-9a1b1608-7880-4e0b-acd4-b62aacf68ea8 tempest-CreateVolumesFromImageTest-6362499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:49:46 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-9a1b1608-7880-4e0b-acd4-b62aacf68ea8 tempest-CreateVolumesFromImageTest-6362499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:49:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-9a1b1608-7880-4e0b-acd4-b62aacf68ea8 tempest-CreateVolumesFromImageTest-6362499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:49:46 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-9a1b1608-7880-4e0b-acd4-b62aacf68ea8 tempest-CreateVolumesFromImageTest-6362499 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:49:46 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-9a1b1608-7880-4e0b-acd4-b62aacf68ea8 tempest-CreateVolumesFromImageTest-6362499 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:49:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9a1b1608-7880-4e0b-acd4-b62aacf68ea8 tempest-CreateVolumesFromImageTest-6362499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-fcb9a11e-9a7a-4c74-85c9-85c093f0d538 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:46 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-91cc47eb-a554-43fe-a76a-5d6dda6d439b tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73ce64cd-a97c-4063-986f-817826e0c4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-966ae37a-dbfe-411b-a471-c8e135e72a22', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:46 devstack sudo[88927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-fcb9a11e-9a7a-4c74-85c9-85c093f0d538 1073741824
Apr 09 12:49:46 devstack sudo[88927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:46 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-91cc47eb-a554-43fe-a76a-5d6dda6d439b tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41097c20-313c-449f-99fa-f3ecd3bf30a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:46 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-91cc47eb-a554-43fe-a76a-5d6dda6d439b tempest-CreateVolumesFromImageTest-6362499 None] Volume volume-966ae37a-dbfe-411b-a471-c8e135e72a22 (966ae37a-dbfe-411b-a471-c8e135e72a22): created successfully
Apr 09 12:49:46 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-91cc47eb-a554-43fe-a76a-5d6dda6d439b tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41097c20-313c-449f-99fa-f3ecd3bf30a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:46 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-91cc47eb-a554-43fe-a76a-5d6dda6d439b tempest-CreateVolumesFromImageTest-6362499 None] Flow 'volume_create_manager' (dc061fe7-fddb-4b35-8fa2-90243d65135e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:49:46 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-91cc47eb-a554-43fe-a76a-5d6dda6d439b tempest-CreateVolumesFromImageTest-6362499 None] Created volume successfully.
Apr 09 12:49:47 devstack sudo[88927]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:47 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9a1b1608-7880-4e0b-acd4-b62aacf68ea8 tempest-CreateVolumesFromImageTest-6362499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-fcb9a11e-9a7a-4c74-85c9-85c093f0d538 1073741824" returned: 0 in 0.694s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:47 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9a1b1608-7880-4e0b-acd4-b62aacf68ea8 tempest-CreateVolumesFromImageTest-6362499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-fcb9a11e-9a7a-4c74-85c9-85c093f0d538 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:47 devstack sudo[88933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-fcb9a11e-9a7a-4c74-85c9-85c093f0d538
Apr 09 12:49:47 devstack sudo[88933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:48 devstack sudo[88933]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:48 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9a1b1608-7880-4e0b-acd4-b62aacf68ea8 tempest-CreateVolumesFromImageTest-6362499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-fcb9a11e-9a7a-4c74-85c9-85c093f0d538" returned: 0 in 0.544s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:48 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-9a1b1608-7880-4e0b-acd4-b62aacf68ea8 tempest-CreateVolumesFromImageTest-6362499 None] <== create_volume: return (1267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:49:48 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-9a1b1608-7880-4e0b-acd4-b62aacf68ea8 tempest-CreateVolumesFromImageTest-6362499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.271s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:49:48 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-9a7c963d-f015-4ae7-8f79-c164614e694d tempest-CreateVolumesFromImageTest-6362499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.033s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:49:48 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-9a7c963d-f015-4ae7-8f79-c164614e694d tempest-CreateVolumesFromImageTest-6362499 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:49:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-766631807',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56a8d5c3-0723-4607-83c1-5911ac0f080c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab2b284631e842b1990f1772394c671d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:49:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:49:44Z,use_quota=True,user_id='ea72235c213d40acadfae81c47ab27b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:49:48 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-9a7c963d-f015-4ae7-8f79-c164614e694d tempest-CreateVolumesFromImageTest-6362499 None] Creating volume 56a8d5c3-0723-4607-83c1-5911ac0f080c {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:49:48 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-9a7c963d-f015-4ae7-8f79-c164614e694d tempest-CreateVolumesFromImageTest-6362499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:49:48 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-9a7c963d-f015-4ae7-8f79-c164614e694d tempest-CreateVolumesFromImageTest-6362499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:49:48 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-9a7c963d-f015-4ae7-8f79-c164614e694d tempest-CreateVolumesFromImageTest-6362499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:49:48 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-9a7c963d-f015-4ae7-8f79-c164614e694d tempest-CreateVolumesFromImageTest-6362499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:49:48 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-9a7c963d-f015-4ae7-8f79-c164614e694d tempest-CreateVolumesFromImageTest-6362499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:49:48 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-9a7c963d-f015-4ae7-8f79-c164614e694d tempest-CreateVolumesFromImageTest-6362499 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:49:48 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-9a7c963d-f015-4ae7-8f79-c164614e694d tempest-CreateVolumesFromImageTest-6362499 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:49:48 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9a7c963d-f015-4ae7-8f79-c164614e694d tempest-CreateVolumesFromImageTest-6362499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-56a8d5c3-0723-4607-83c1-5911ac0f080c 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:48 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-9a1b1608-7880-4e0b-acd4-b62aacf68ea8 tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1ef5fd7-84dd-4e5b-9053-8a1d83c5bdad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcb9a11e-9a7a-4c74-85c9-85c093f0d538', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:48 devstack sudo[88936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-56a8d5c3-0723-4607-83c1-5911ac0f080c 1073741824
Apr 09 12:49:48 devstack sudo[88936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:48 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-9a1b1608-7880-4e0b-acd4-b62aacf68ea8 tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c347173-8ae7-42a9-a870-c37a0249d2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:48 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-9a1b1608-7880-4e0b-acd4-b62aacf68ea8 tempest-CreateVolumesFromImageTest-6362499 None] Volume volume-fcb9a11e-9a7a-4c74-85c9-85c093f0d538 (fcb9a11e-9a7a-4c74-85c9-85c093f0d538): created successfully
Apr 09 12:49:48 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-9a1b1608-7880-4e0b-acd4-b62aacf68ea8 tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c347173-8ae7-42a9-a870-c37a0249d2f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:48 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-9a1b1608-7880-4e0b-acd4-b62aacf68ea8 tempest-CreateVolumesFromImageTest-6362499 None] Flow 'volume_create_manager' (d8ce139a-8b56-424f-8a37-da5f08164920) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:49:48 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-9a1b1608-7880-4e0b-acd4-b62aacf68ea8 tempest-CreateVolumesFromImageTest-6362499 None] Created volume successfully.
Apr 09 12:49:48 devstack sudo[88936]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:48 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9a7c963d-f015-4ae7-8f79-c164614e694d tempest-CreateVolumesFromImageTest-6362499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-56a8d5c3-0723-4607-83c1-5911ac0f080c 1073741824" returned: 0 in 0.745s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:48 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9a7c963d-f015-4ae7-8f79-c164614e694d tempest-CreateVolumesFromImageTest-6362499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-56a8d5c3-0723-4607-83c1-5911ac0f080c {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:48 devstack sudo[88941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-56a8d5c3-0723-4607-83c1-5911ac0f080c
Apr 09 12:49:48 devstack sudo[88941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:49 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:49:49 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] Flow 'volume_create_manager' (16826f1e-cca1-406d-9377-80943863820f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:49:49 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f0ce5ec-73f3-4281-933f-42dbaf8de649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:49 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f0ce5ec-73f3-4281-933f-42dbaf8de649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:49:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1791849907',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=455c6e95-fed1-469a-b1a4-2434bfb02223,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='878352933f3a4c70b03529316265065f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:49:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:49:49Z,use_quota=True,user_id='ea4f010ea60e44c0b5bbb6a50066aff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:49 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24cc2441-5035-4541-ad1d-bb25576dc948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:49 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24cc2441-5035-4541-ad1d-bb25576dc948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:49 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d059d0c-9019-44d8-abdf-b5544ba85513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:49 devstack cinder-volume[82760]: DEBUG cinder.image.glance [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] Creating Keystone auth plugin from conf {{(pid=82760) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 09 12:49:49 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d059d0c-9019-44d8-abdf-b5544ba85513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '455c6e95-fed1-469a-b1a4-2434bfb02223', 'volume_name': 'volume-455c6e95-fed1-469a-b1a4-2434bfb02223', 'volume_size': 1, 'image_id': '11bf303b-adca-49d8-8d80-d4a3c72e719a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11bf303b-adca-49d8-8d80-d4a3c72e719a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c43b4928ecdf4421ad23e5f918ea33fe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '11bf303b-adca-49d8-8d80-d4a3c72e719a', 'created_at': datetime.datetime(2026, 4, 9, 10, 38, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 10, 38, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11bf303b-adca-49d8-8d80-d4a3c72e719a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f378da6fd60>}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:49 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f78bbcd-9356-46bc-9efa-64474fb880fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:49 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f78bbcd-9356-46bc-9efa-64474fb880fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:49 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10f8a8f3-52b0-4bec-8f15-60160b2079f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:49 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] Volume 455c6e95-fed1-469a-b1a4-2434bfb02223: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-455c6e95-fed1-469a-b1a4-2434bfb02223', 'volume_size': 1, 'image_id': '11bf303b-adca-49d8-8d80-d4a3c72e719a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11bf303b-adca-49d8-8d80-d4a3c72e719a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c43b4928ecdf4421ad23e5f918ea33fe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '11bf303b-adca-49d8-8d80-d4a3c72e719a', 'created_at': datetime.datetime(2026, 4, 9, 10, 38, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 10, 38, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11bf303b-adca-49d8-8d80-d4a3c72e719a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f378da6fd60>}
Apr 09 12:49:49 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] Trying to clone 455c6e95-fed1-469a-b1a4-2434bfb02223 from image 11bf303b-adca-49d8-8d80-d4a3c72e719a at location (None, [{'url': 'file:///opt/stack/data/glance/images/11bf303b-adca-49d8-8d80-d4a3c72e719a', 'metadata': {}}]). {{(pid=82760) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 09 12:49:49 devstack sudo[88941]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:49 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9a7c963d-f015-4ae7-8f79-c164614e694d tempest-CreateVolumesFromImageTest-6362499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-56a8d5c3-0723-4607-83c1-5911ac0f080c" returned: 0 in 0.475s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:49 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-9a7c963d-f015-4ae7-8f79-c164614e694d tempest-CreateVolumesFromImageTest-6362499 None] <== create_volume: return (1249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:49:49 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-9a7c963d-f015-4ae7-8f79-c164614e694d tempest-CreateVolumesFromImageTest-6362499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.254s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:49:49 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c1b46a65-ad69-4211-bdff-6976d705b3ab tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.084s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:49:49 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-c1b46a65-ad69-4211-bdff-6976d705b3ab tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:49:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-283423072',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c59e6968-dd36-43c6-ae9b-6a71302d0442,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c6b80f4139f4edfb96692dbc45d987d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:49:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:49:44Z,use_quota=True,user_id='3beb3b0f083f4d749c98b0ac361d914b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:49:49 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-c1b46a65-ad69-4211-bdff-6976d705b3ab tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Creating volume c59e6968-dd36-43c6-ae9b-6a71302d0442 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:49:49 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c1b46a65-ad69-4211-bdff-6976d705b3ab tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:49:49 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c1b46a65-ad69-4211-bdff-6976d705b3ab tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:49:49 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-c1b46a65-ad69-4211-bdff-6976d705b3ab tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:49:49 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-c1b46a65-ad69-4211-bdff-6976d705b3ab tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:49:49 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c1b46a65-ad69-4211-bdff-6976d705b3ab tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:49:49 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-c1b46a65-ad69-4211-bdff-6976d705b3ab tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:49:49 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-c1b46a65-ad69-4211-bdff-6976d705b3ab tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:49:49 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c1b46a65-ad69-4211-bdff-6976d705b3ab tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c59e6968-dd36-43c6-ae9b-6a71302d0442 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:49 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-9a7c963d-f015-4ae7-8f79-c164614e694d tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5d548e8-13fa-442f-a807-45081470d3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56a8d5c3-0723-4607-83c1-5911ac0f080c', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:49 devstack sudo[88944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c59e6968-dd36-43c6-ae9b-6a71302d0442 1073741824
Apr 09 12:49:49 devstack sudo[88944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:49 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-9a7c963d-f015-4ae7-8f79-c164614e694d tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dec8be5-6b3b-43b2-9aa7-d14ebc8eaeed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:49 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-9a7c963d-f015-4ae7-8f79-c164614e694d tempest-CreateVolumesFromImageTest-6362499 None] Volume volume-56a8d5c3-0723-4607-83c1-5911ac0f080c (56a8d5c3-0723-4607-83c1-5911ac0f080c): created successfully
Apr 09 12:49:49 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-9a7c963d-f015-4ae7-8f79-c164614e694d tempest-CreateVolumesFromImageTest-6362499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dec8be5-6b3b-43b2-9aa7-d14ebc8eaeed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:49 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-9a7c963d-f015-4ae7-8f79-c164614e694d tempest-CreateVolumesFromImageTest-6362499 None] Flow 'volume_create_manager' (d60db8d4-d820-4fe0-9af5-c6f9055f4acf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:49:49 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-9a7c963d-f015-4ae7-8f79-c164614e694d tempest-CreateVolumesFromImageTest-6362499 None] Created volume successfully.
Apr 09 12:49:49 devstack cinder-volume[82760]: DEBUG cinder.image.image_utils [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_11bf303b-adca-49d8-8d80-d4a3c72e719a_er6q653hdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82760) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 09 12:49:49 devstack cinder-volume[82760]: INFO cinder.image.image_utils [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] Image download 20.69 MB at 20.69 MB/s
Apr 09 12:49:49 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[c146bae3-7625-4865-80e9-966777213a06]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:49:49 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11bf303b-adca-49d8-8d80-d4a3c72e719a_er6q653hdevstack@QuobyteHD {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:49 devstack sudo[88947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11bf303b-adca-49d8-8d80-d4a3c72e719a_er6q653hdevstack@QuobyteHD
Apr 09 12:49:49 devstack sudo[88947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:49 devstack sudo[88944]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:49 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c1b46a65-ad69-4211-bdff-6976d705b3ab tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c59e6968-dd36-43c6-ae9b-6a71302d0442 1073741824" returned: 0 in 0.563s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:49 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c1b46a65-ad69-4211-bdff-6976d705b3ab tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c59e6968-dd36-43c6-ae9b-6a71302d0442 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:49 devstack sudo[88952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c59e6968-dd36-43c6-ae9b-6a71302d0442
Apr 09 12:49:49 devstack sudo[88952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:50 devstack sudo[88947]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11bf303b-adca-49d8-8d80-d4a3c72e719a_er6q653hdevstack@QuobyteHD" returned: 0 in 0.588s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:50 devstack cinder-volume[82760]: DEBUG cinder.image.image_utils [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] Temporary image 11bf303b-adca-49d8-8d80-d4a3c72e719a is fetched for user ea4f010ea60e44c0b5bbb6a50066aff3. {{(pid=82760) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 09 12:49:50 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[90521998-5c6a-4e72-83ac-43f3b85d9ecb]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:49:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11bf303b-adca-49d8-8d80-d4a3c72e719a_er6q653hdevstack@QuobyteHD {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:50 devstack sudo[88957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11bf303b-adca-49d8-8d80-d4a3c72e719a_er6q653hdevstack@QuobyteHD
Apr 09 12:49:50 devstack sudo[88957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:50 devstack sudo[88952]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c1b46a65-ad69-4211-bdff-6976d705b3ab tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c59e6968-dd36-43c6-ae9b-6a71302d0442" returned: 0 in 0.477s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:50 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-c1b46a65-ad69-4211-bdff-6976d705b3ab tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:49:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c1b46a65-ad69-4211-bdff-6976d705b3ab tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:49:50 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c1b46a65-ad69-4211-bdff-6976d705b3ab tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (562d75ae-2794-4450-8ddc-85e3303cd956) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c59e6968-dd36-43c6-ae9b-6a71302d0442', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:50 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c1b46a65-ad69-4211-bdff-6976d705b3ab tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79f61f3f-2786-4bf6-821d-0819661937c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:50 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-c1b46a65-ad69-4211-bdff-6976d705b3ab tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Volume volume-c59e6968-dd36-43c6-ae9b-6a71302d0442 (c59e6968-dd36-43c6-ae9b-6a71302d0442): created successfully
Apr 09 12:49:50 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c1b46a65-ad69-4211-bdff-6976d705b3ab tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79f61f3f-2786-4bf6-821d-0819661937c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:50 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c1b46a65-ad69-4211-bdff-6976d705b3ab tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Flow 'volume_create_manager' (bb31bda1-123f-41fb-9420-187a50c1cbd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:49:50 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-c1b46a65-ad69-4211-bdff-6976d705b3ab tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Created volume successfully.
Apr 09 12:49:50 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-68a6e495-9490-4d5e-85f4-4e57ec05d41a tempest-CreateVolumesFromImageTest-6362499 None] Acquiring lock "cinder-56a8d5c3-0723-4607-83c1-5911ac0f080c-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:49:50 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-68a6e495-9490-4d5e-85f4-4e57ec05d41a tempest-CreateVolumesFromImageTest-6362499 None] Lock "cinder-56a8d5c3-0723-4607-83c1-5911ac0f080c-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:49:50 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-68a6e495-9490-4d5e-85f4-4e57ec05d41a tempest-CreateVolumesFromImageTest-6362499 None] Acquiring lock "cinder-quobyte-56a8d5c3-0723-4607-83c1-5911ac0f080c" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:49:50 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-68a6e495-9490-4d5e-85f4-4e57ec05d41a tempest-CreateVolumesFromImageTest-6362499 None] Lock "cinder-quobyte-56a8d5c3-0723-4607-83c1-5911ac0f080c" acquired by "delete_volume" :: waited 0.010s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:49:50 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[1761aa3d-0cb0-4308-9ad6-b76c77c6415c]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:49:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-68a6e495-9490-4d5e-85f4-4e57ec05d41a tempest-CreateVolumesFromImageTest-6362499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-56a8d5c3-0723-4607-83c1-5911ac0f080c {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:50 devstack sudo[88960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-56a8d5c3-0723-4607-83c1-5911ac0f080c
Apr 09 12:49:50 devstack sudo[88960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:50 devstack sudo[88957]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11bf303b-adca-49d8-8d80-d4a3c72e719a_er6q653hdevstack@QuobyteHD" returned: 0 in 0.540s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:49:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:49:50 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:49:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1791849907',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=455c6e95-fed1-469a-b1a4-2434bfb02223,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='878352933f3a4c70b03529316265065f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:49:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:49:49Z,use_quota=True,user_id='ea4f010ea60e44c0b5bbb6a50066aff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:49:50 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] Creating volume 455c6e95-fed1-469a-b1a4-2434bfb02223 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:49:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:49:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:49:50 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:49:50 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:49:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:49:50 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:49:50 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:49:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-455c6e95-fed1-469a-b1a4-2434bfb02223 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:50 devstack sudo[88965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-455c6e95-fed1-469a-b1a4-2434bfb02223 1073741824
Apr 09 12:49:50 devstack sudo[88965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:51 devstack sudo[88960]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-68a6e495-9490-4d5e-85f4-4e57ec05d41a tempest-CreateVolumesFromImageTest-6362499 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-56a8d5c3-0723-4607-83c1-5911ac0f080c" returned: 0 in 0.503s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-68a6e495-9490-4d5e-85f4-4e57ec05d41a tempest-CreateVolumesFromImageTest-6362499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-56a8d5c3-0723-4607-83c1-5911ac0f080c {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:51 devstack sudo[88973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-56a8d5c3-0723-4607-83c1-5911ac0f080c
Apr 09 12:49:51 devstack sudo[88973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:51 devstack sudo[88965]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-455c6e95-fed1-469a-b1a4-2434bfb02223 1073741824" returned: 0 in 0.535s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-455c6e95-fed1-469a-b1a4-2434bfb02223 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:51 devstack sudo[88975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-455c6e95-fed1-469a-b1a4-2434bfb02223
Apr 09 12:49:51 devstack sudo[88975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:51 devstack sudo[88973]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-68a6e495-9490-4d5e-85f4-4e57ec05d41a tempest-CreateVolumesFromImageTest-6362499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-56a8d5c3-0723-4607-83c1-5911ac0f080c" returned: 0 in 0.459s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:51 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-68a6e495-9490-4d5e-85f4-4e57ec05d41a tempest-CreateVolumesFromImageTest-6362499 None] Lock "cinder-quobyte-56a8d5c3-0723-4607-83c1-5911ac0f080c" released by "delete_volume" :: held 1.008s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:49:51 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-68a6e495-9490-4d5e-85f4-4e57ec05d41a tempest-CreateVolumesFromImageTest-6362499 None] Created reservations ['4eed6ad9-87b0-4af6-99b5-60f0f8d7d6c6', '6fc1f4be-6a4a-4b92-9e42-6de23942672f', 'f6a7a5bc-f3a2-4da6-af1a-da879f7d9acc', 'ce192914-156c-4e03-bbe0-70bc9f07fe91'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:49:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-68a6e495-9490-4d5e-85f4-4e57ec05d41a tempest-CreateVolumesFromImageTest-6362499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:49:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-68a6e495-9490-4d5e-85f4-4e57ec05d41a tempest-CreateVolumesFromImageTest-6362499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:49:51 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-68a6e495-9490-4d5e-85f4-4e57ec05d41a tempest-CreateVolumesFromImageTest-6362499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:49:51 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-68a6e495-9490-4d5e-85f4-4e57ec05d41a tempest-CreateVolumesFromImageTest-6362499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:49:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-68a6e495-9490-4d5e-85f4-4e57ec05d41a tempest-CreateVolumesFromImageTest-6362499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:49:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-68a6e495-9490-4d5e-85f4-4e57ec05d41a tempest-CreateVolumesFromImageTest-6362499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:51 devstack sudo[88979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:49:51 devstack sudo[88979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:51 devstack sudo[88975]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-455c6e95-fed1-469a-b1a4-2434bfb02223" returned: 0 in 0.487s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:51 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:49:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:49:51 devstack cinder-volume[82760]: DEBUG cinder.volume.volume_utils [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] Attempting download of 11bf303b-adca-49d8-8d80-d4a3c72e719a ((None, [{'url': 'file:///opt/stack/data/glance/images/11bf303b-adca-49d8-8d80-d4a3c72e719a', 'metadata': {}}])) to volume 455c6e95-fed1-469a-b1a4-2434bfb02223. {{(pid=82760) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 09 12:49:51 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a8e9f0-80f1-48c9-8856-260bd42036da]: (4, 'raw') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:49:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11bf303b-adca-49d8-8d80-d4a3c72e719a_nve5ytvc {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:51 devstack sudo[88981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11bf303b-adca-49d8-8d80-d4a3c72e719a_nve5ytvc
Apr 09 12:49:51 devstack sudo[88981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:51 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-69c89b6d-2807-4101-a215-963075de5c7a tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:49:51 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-69c89b6d-2807-4101-a215-963075de5c7a tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Flow 'volume_create_manager' (9b593beb-2a1a-4e8e-9240-87573fbef1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:49:51 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-69c89b6d-2807-4101-a215-963075de5c7a tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b798c704-cf61-4053-9156-1065c4c4c123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-69c89b6d-2807-4101-a215-963075de5c7a tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b798c704-cf61-4053-9156-1065c4c4c123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:49:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-929742275',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a9a662c-177c-4ad5-bd2c-9daf2699e982,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c6b80f4139f4edfb96692dbc45d987d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:49:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:49:52Z,use_quota=True,user_id='3beb3b0f083f4d749c98b0ac361d914b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-69c89b6d-2807-4101-a215-963075de5c7a tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bbc2006-6d4a-4ee6-869f-5cdb5171891e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-69c89b6d-2807-4101-a215-963075de5c7a tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bbc2006-6d4a-4ee6-869f-5cdb5171891e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-69c89b6d-2807-4101-a215-963075de5c7a tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57e3afb1-99c9-4741-b860-3b14402afadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-69c89b6d-2807-4101-a215-963075de5c7a tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57e3afb1-99c9-4741-b860-3b14402afadb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a9a662c-177c-4ad5-bd2c-9daf2699e982', 'volume_name': 'volume-3a9a662c-177c-4ad5-bd2c-9daf2699e982', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-69c89b6d-2807-4101-a215-963075de5c7a tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a3a117a-6945-423c-b9e5-427c5aaba071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-69c89b6d-2807-4101-a215-963075de5c7a tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a3a117a-6945-423c-b9e5-427c5aaba071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-69c89b6d-2807-4101-a215-963075de5c7a tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5283e2b8-8dce-4fcd-bd2d-eba9f33bdc19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:52 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-69c89b6d-2807-4101-a215-963075de5c7a tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Volume 3a9a662c-177c-4ad5-bd2c-9daf2699e982: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a9a662c-177c-4ad5-bd2c-9daf2699e982', 'volume_size': 1}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-69c89b6d-2807-4101-a215-963075de5c7a tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-69c89b6d-2807-4101-a215-963075de5c7a tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-69c89b6d-2807-4101-a215-963075de5c7a tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:49:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-929742275',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a9a662c-177c-4ad5-bd2c-9daf2699e982,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c6b80f4139f4edfb96692dbc45d987d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:49:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:49:52Z,use_quota=True,user_id='3beb3b0f083f4d749c98b0ac361d914b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-69c89b6d-2807-4101-a215-963075de5c7a tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Creating volume 3a9a662c-177c-4ad5-bd2c-9daf2699e982 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-69c89b6d-2807-4101-a215-963075de5c7a tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-69c89b6d-2807-4101-a215-963075de5c7a tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-69c89b6d-2807-4101-a215-963075de5c7a tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-69c89b6d-2807-4101-a215-963075de5c7a tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-69c89b6d-2807-4101-a215-963075de5c7a tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-69c89b6d-2807-4101-a215-963075de5c7a tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:49:52 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-69c89b6d-2807-4101-a215-963075de5c7a tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-69c89b6d-2807-4101-a215-963075de5c7a tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3a9a662c-177c-4ad5-bd2c-9daf2699e982 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:52 devstack sudo[88983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3a9a662c-177c-4ad5-bd2c-9daf2699e982 1073741824
Apr 09 12:49:52 devstack sudo[88983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e6924ac-1ac6-44c5-89f8-9010170d9d21 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:49:52 devstack sudo[88979]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-2e6924ac-1ac6-44c5-89f8-9010170d9d21 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Flow 'volume_create_manager' (e3f6e74b-2211-45f6-a732-99337fb1f106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-2e6924ac-1ac6-44c5-89f8-9010170d9d21 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d2149b6-2127-48fa-b2e8-ac6feaba2ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-68a6e495-9490-4d5e-85f4-4e57ec05d41a tempest-CreateVolumesFromImageTest-6362499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.691s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-68a6e495-9490-4d5e-85f4-4e57ec05d41a tempest-CreateVolumesFromImageTest-6362499 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-2e6924ac-1ac6-44c5-89f8-9010170d9d21 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d2149b6-2127-48fa-b2e8-ac6feaba2ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:49:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1587092214',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c951bed7-0801-42af-8992-5b29b4f40bdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c6b80f4139f4edfb96692dbc45d987d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:49:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:49:52Z,use_quota=True,user_id='3beb3b0f083f4d749c98b0ac361d914b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-2e6924ac-1ac6-44c5-89f8-9010170d9d21 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9da4316-2ed7-4f5d-80fb-4fa737ba75e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-2e6924ac-1ac6-44c5-89f8-9010170d9d21 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9da4316-2ed7-4f5d-80fb-4fa737ba75e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-2e6924ac-1ac6-44c5-89f8-9010170d9d21 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4700b4ce-fac2-420b-bd12-a365d07a057e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-2e6924ac-1ac6-44c5-89f8-9010170d9d21 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4700b4ce-fac2-420b-bd12-a365d07a057e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c951bed7-0801-42af-8992-5b29b4f40bdf', 'volume_name': 'volume-c951bed7-0801-42af-8992-5b29b4f40bdf', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-2e6924ac-1ac6-44c5-89f8-9010170d9d21 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28759930-8059-4893-9f02-c74c26f056a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-2e6924ac-1ac6-44c5-89f8-9010170d9d21 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28759930-8059-4893-9f02-c74c26f056a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-2e6924ac-1ac6-44c5-89f8-9010170d9d21 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc5794c4-d348-4179-98cf-04916758a19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:52 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-2e6924ac-1ac6-44c5-89f8-9010170d9d21 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Volume c951bed7-0801-42af-8992-5b29b4f40bdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c951bed7-0801-42af-8992-5b29b4f40bdf', 'volume_size': 1}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-2e6924ac-1ac6-44c5-89f8-9010170d9d21 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:49:52 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-68a6e495-9490-4d5e-85f4-4e57ec05d41a tempest-CreateVolumesFromImageTest-6362499 None] Deleted volume successfully.
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-68a6e495-9490-4d5e-85f4-4e57ec05d41a tempest-CreateVolumesFromImageTest-6362499 None] Lock "cinder-56a8d5c3-0723-4607-83c1-5911ac0f080c-delete_volume" released by "delete_volume" :: held 1.956s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-b51b3e64-878c-4290-b8fd-fc3159028670 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b51b3e64-878c-4290-b8fd-fc3159028670 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Flow 'volume_create_manager' (86f0984a-3c3d-4f94-bd91-58ca29918240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b51b3e64-878c-4290-b8fd-fc3159028670 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f6cecc7-668e-4d91-b844-d381d2a7dd04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b51b3e64-878c-4290-b8fd-fc3159028670 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f6cecc7-668e-4d91-b844-d381d2a7dd04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:49:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-127430158',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2153402f-2381-4632-8897-484dc5764b95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c6b80f4139f4edfb96692dbc45d987d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:49:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:49:52Z,use_quota=True,user_id='3beb3b0f083f4d749c98b0ac361d914b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:52 devstack sudo[88981]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b51b3e64-878c-4290-b8fd-fc3159028670 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fa7e3ad-0d38-45c5-8717-9aa549639506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b51b3e64-878c-4290-b8fd-fc3159028670 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fa7e3ad-0d38-45c5-8717-9aa549639506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b51b3e64-878c-4290-b8fd-fc3159028670 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5521590-68ef-4c72-b390-bf3cc9d59075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b51b3e64-878c-4290-b8fd-fc3159028670 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5521590-68ef-4c72-b390-bf3cc9d59075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2153402f-2381-4632-8897-484dc5764b95', 'volume_name': 'volume-2153402f-2381-4632-8897-484dc5764b95', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b51b3e64-878c-4290-b8fd-fc3159028670 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb8f1f16-40a9-4d52-8754-2e7a5bf67ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b51b3e64-878c-4290-b8fd-fc3159028670 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb8f1f16-40a9-4d52-8754-2e7a5bf67ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b51b3e64-878c-4290-b8fd-fc3159028670 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a04bed49-0b4c-41a9-bf3f-a87fbb38a109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:52 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-b51b3e64-878c-4290-b8fd-fc3159028670 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Volume 2153402f-2381-4632-8897-484dc5764b95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2153402f-2381-4632-8897-484dc5764b95', 'volume_size': 1}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b51b3e64-878c-4290-b8fd-fc3159028670 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11bf303b-adca-49d8-8d80-d4a3c72e719a_nve5ytvc" returned: 0 in 0.759s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11bf303b-adca-49d8-8d80-d4a3c72e719a_nve5ytvc {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:52 devstack sudo[88992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11bf303b-adca-49d8-8d80-d4a3c72e719a_nve5ytvc
Apr 09 12:49:52 devstack sudo[88992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-f719aa22-9f1d-4b79-8a00-e960c6f1d2fb tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f719aa22-9f1d-4b79-8a00-e960c6f1d2fb tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Flow 'volume_create_manager' (7ada17c9-91c9-4691-877f-9ac92083aaf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f719aa22-9f1d-4b79-8a00-e960c6f1d2fb tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (596fe9b1-216b-4757-8748-5688196d91e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f719aa22-9f1d-4b79-8a00-e960c6f1d2fb tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (596fe9b1-216b-4757-8748-5688196d91e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:49:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1408615792',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cca148c4-ea5b-4afa-8d09-a3439d442045,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c6b80f4139f4edfb96692dbc45d987d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:49:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:49:53Z,use_quota=True,user_id='3beb3b0f083f4d749c98b0ac361d914b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:52 devstack sudo[88983]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f719aa22-9f1d-4b79-8a00-e960c6f1d2fb tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afa81575-54c6-4eca-be0f-999322ab5ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f719aa22-9f1d-4b79-8a00-e960c6f1d2fb tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afa81575-54c6-4eca-be0f-999322ab5ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f719aa22-9f1d-4b79-8a00-e960c6f1d2fb tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4af379e4-0671-4bd3-8ddc-8eff527a3d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f719aa22-9f1d-4b79-8a00-e960c6f1d2fb tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4af379e4-0671-4bd3-8ddc-8eff527a3d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cca148c4-ea5b-4afa-8d09-a3439d442045', 'volume_name': 'volume-cca148c4-ea5b-4afa-8d09-a3439d442045', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f719aa22-9f1d-4b79-8a00-e960c6f1d2fb tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c244ae5-6004-4802-b01e-de8157915df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f719aa22-9f1d-4b79-8a00-e960c6f1d2fb tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c244ae5-6004-4802-b01e-de8157915df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f719aa22-9f1d-4b79-8a00-e960c6f1d2fb tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (906ef36a-c812-4d59-9130-e3f0b62e2ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:52 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-f719aa22-9f1d-4b79-8a00-e960c6f1d2fb tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Volume cca148c4-ea5b-4afa-8d09-a3439d442045: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cca148c4-ea5b-4afa-8d09-a3439d442045', 'volume_size': 1}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f719aa22-9f1d-4b79-8a00-e960c6f1d2fb tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-f7aa2b66-08b8-449e-9cfc-b3b476073bf7 tempest-CreateVolumesFromImageTest-6362499 None] Acquiring lock "cinder-fcb9a11e-9a7a-4c74-85c9-85c093f0d538-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-69c89b6d-2807-4101-a215-963075de5c7a tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3a9a662c-177c-4ad5-bd2c-9daf2699e982 1073741824" returned: 0 in 0.796s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-f7aa2b66-08b8-449e-9cfc-b3b476073bf7 tempest-CreateVolumesFromImageTest-6362499 None] Lock "cinder-fcb9a11e-9a7a-4c74-85c9-85c093f0d538-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-69c89b6d-2807-4101-a215-963075de5c7a tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3a9a662c-177c-4ad5-bd2c-9daf2699e982 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-f7aa2b66-08b8-449e-9cfc-b3b476073bf7 tempest-CreateVolumesFromImageTest-6362499 None] Acquiring lock "cinder-quobyte-fcb9a11e-9a7a-4c74-85c9-85c093f0d538" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:49:52 devstack sudo[88994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3a9a662c-177c-4ad5-bd2c-9daf2699e982
Apr 09 12:49:52 devstack sudo[88994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-f7aa2b66-08b8-449e-9cfc-b3b476073bf7 tempest-CreateVolumesFromImageTest-6362499 None] Lock "cinder-quobyte-fcb9a11e-9a7a-4c74-85c9-85c093f0d538" acquired by "delete_volume" :: waited 0.008s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[b696d0b3-28c2-426a-9665-c95e7c492936]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:49:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f7aa2b66-08b8-449e-9cfc-b3b476073bf7 tempest-CreateVolumesFromImageTest-6362499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-fcb9a11e-9a7a-4c74-85c9-85c093f0d538 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:53 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-c072d21e-1bf2-402d-b3cb-d07edcd6e562 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:49:53 devstack sudo[88996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-fcb9a11e-9a7a-4c74-85c9-85c093f0d538
Apr 09 12:49:53 devstack sudo[88996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:53 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c072d21e-1bf2-402d-b3cb-d07edcd6e562 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Flow 'volume_create_manager' (79e127af-2424-4809-a26f-0d3ecd56b210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:49:53 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c072d21e-1bf2-402d-b3cb-d07edcd6e562 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64518864-4932-46b4-bb4c-10920a15409a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:53 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c072d21e-1bf2-402d-b3cb-d07edcd6e562 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64518864-4932-46b4-bb4c-10920a15409a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:49:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-296277579',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f605275a-ba8d-4318-9812-3a8a68c1cc6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c6b80f4139f4edfb96692dbc45d987d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:49:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:49:53Z,use_quota=True,user_id='3beb3b0f083f4d749c98b0ac361d914b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:53 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c072d21e-1bf2-402d-b3cb-d07edcd6e562 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3feb2b2-a06c-49ae-b83e-f07598b85cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:53 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c072d21e-1bf2-402d-b3cb-d07edcd6e562 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3feb2b2-a06c-49ae-b83e-f07598b85cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:53 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c072d21e-1bf2-402d-b3cb-d07edcd6e562 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1428fae9-6c22-4971-ba4f-235733c308f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:53 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c072d21e-1bf2-402d-b3cb-d07edcd6e562 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1428fae9-6c22-4971-ba4f-235733c308f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f605275a-ba8d-4318-9812-3a8a68c1cc6f', 'volume_name': 'volume-f605275a-ba8d-4318-9812-3a8a68c1cc6f', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:53 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c072d21e-1bf2-402d-b3cb-d07edcd6e562 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bf69279-40bc-4975-9530-5272f11f0d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:53 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c072d21e-1bf2-402d-b3cb-d07edcd6e562 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bf69279-40bc-4975-9530-5272f11f0d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:53 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c072d21e-1bf2-402d-b3cb-d07edcd6e562 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05ba36bc-97c0-454b-9812-8ec557d61ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:53 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-c072d21e-1bf2-402d-b3cb-d07edcd6e562 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Volume f605275a-ba8d-4318-9812-3a8a68c1cc6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f605275a-ba8d-4318-9812-3a8a68c1cc6f', 'volume_size': 1}
Apr 09 12:49:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c072d21e-1bf2-402d-b3cb-d07edcd6e562 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:49:53 devstack sudo[88992]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11bf303b-adca-49d8-8d80-d4a3c72e719a_nve5ytvc" returned: 1 in 0.658s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11bf303b-adca-49d8-8d80-d4a3c72e719a_nve5ytvc' failed. Not Retrying. {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 09 12:49:53 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[5445e12b-c4a1-4a2f-bb90-2175eafccf7c]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:49:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11bf303b-adca-49d8-8d80-d4a3c72e719a_er6q653hdevstack@QuobyteHD {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:53 devstack sudo[89000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11bf303b-adca-49d8-8d80-d4a3c72e719a_er6q653hdevstack@QuobyteHD
Apr 09 12:49:53 devstack sudo[89000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:53 devstack sudo[88994]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-69c89b6d-2807-4101-a215-963075de5c7a tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3a9a662c-177c-4ad5-bd2c-9daf2699e982" returned: 0 in 0.519s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:53 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-69c89b6d-2807-4101-a215-963075de5c7a tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] <== create_volume: return (1357ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:49:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-69c89b6d-2807-4101-a215-963075de5c7a tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.362s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:49:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-2e6924ac-1ac6-44c5-89f8-9010170d9d21 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.931s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:49:53 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-2e6924ac-1ac6-44c5-89f8-9010170d9d21 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:49:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1587092214',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c951bed7-0801-42af-8992-5b29b4f40bdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c6b80f4139f4edfb96692dbc45d987d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:49:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:49:52Z,use_quota=True,user_id='3beb3b0f083f4d749c98b0ac361d914b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:49:53 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-2e6924ac-1ac6-44c5-89f8-9010170d9d21 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Creating volume c951bed7-0801-42af-8992-5b29b4f40bdf {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:49:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-2e6924ac-1ac6-44c5-89f8-9010170d9d21 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:49:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-2e6924ac-1ac6-44c5-89f8-9010170d9d21 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:49:53 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-2e6924ac-1ac6-44c5-89f8-9010170d9d21 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:49:53 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-2e6924ac-1ac6-44c5-89f8-9010170d9d21 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:49:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-2e6924ac-1ac6-44c5-89f8-9010170d9d21 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:49:53 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-2e6924ac-1ac6-44c5-89f8-9010170d9d21 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:49:53 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-2e6924ac-1ac6-44c5-89f8-9010170d9d21 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:49:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2e6924ac-1ac6-44c5-89f8-9010170d9d21 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c951bed7-0801-42af-8992-5b29b4f40bdf 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:53 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-69c89b6d-2807-4101-a215-963075de5c7a tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5283e2b8-8dce-4fcd-bd2d-eba9f33bdc19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a9a662c-177c-4ad5-bd2c-9daf2699e982', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:53 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-69c89b6d-2807-4101-a215-963075de5c7a tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f9b5b0e-3a28-4f9c-8b0b-d39df8ed8b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:53 devstack sudo[89006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c951bed7-0801-42af-8992-5b29b4f40bdf 1073741824
Apr 09 12:49:53 devstack sudo[89006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:53 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-69c89b6d-2807-4101-a215-963075de5c7a tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Volume volume-3a9a662c-177c-4ad5-bd2c-9daf2699e982 (3a9a662c-177c-4ad5-bd2c-9daf2699e982): created successfully
Apr 09 12:49:53 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-69c89b6d-2807-4101-a215-963075de5c7a tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f9b5b0e-3a28-4f9c-8b0b-d39df8ed8b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:53 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-69c89b6d-2807-4101-a215-963075de5c7a tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Flow 'volume_create_manager' (9b593beb-2a1a-4e8e-9240-87573fbef1e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:49:53 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-69c89b6d-2807-4101-a215-963075de5c7a tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Created volume successfully.
Apr 09 12:49:53 devstack sudo[88996]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f7aa2b66-08b8-449e-9cfc-b3b476073bf7 tempest-CreateVolumesFromImageTest-6362499 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-fcb9a11e-9a7a-4c74-85c9-85c093f0d538" returned: 0 in 0.574s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f7aa2b66-08b8-449e-9cfc-b3b476073bf7 tempest-CreateVolumesFromImageTest-6362499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-fcb9a11e-9a7a-4c74-85c9-85c093f0d538 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:53 devstack sudo[89008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-fcb9a11e-9a7a-4c74-85c9-85c093f0d538
Apr 09 12:49:53 devstack sudo[89008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:53 devstack sudo[89000]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11bf303b-adca-49d8-8d80-d4a3c72e719a_er6q653hdevstack@QuobyteHD" returned: 0 in 0.550s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:53 devstack cinder-volume[82760]: DEBUG cinder.image.image_utils [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] 11bf303b-adca-49d8-8d80-d4a3c72e719a was qcow2, converting to raw {{(pid=82760) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 09 12:49:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_11bf303b-adca-49d8-8d80-d4a3c72e719a_er6q653hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-455c6e95-fed1-469a-b1a4-2434bfb02223 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:53 devstack sudo[89015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_11bf303b-adca-49d8-8d80-d4a3c72e719a_er6q653hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-455c6e95-fed1-469a-b1a4-2434bfb02223
Apr 09 12:49:53 devstack sudo[89015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:53 devstack sudo[89006]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2e6924ac-1ac6-44c5-89f8-9010170d9d21 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c951bed7-0801-42af-8992-5b29b4f40bdf 1073741824" returned: 0 in 0.571s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2e6924ac-1ac6-44c5-89f8-9010170d9d21 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c951bed7-0801-42af-8992-5b29b4f40bdf {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:54 devstack sudo[89008]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f7aa2b66-08b8-449e-9cfc-b3b476073bf7 tempest-CreateVolumesFromImageTest-6362499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-fcb9a11e-9a7a-4c74-85c9-85c093f0d538" returned: 0 in 0.553s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:54 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-f7aa2b66-08b8-449e-9cfc-b3b476073bf7 tempest-CreateVolumesFromImageTest-6362499 None] Lock "cinder-quobyte-fcb9a11e-9a7a-4c74-85c9-85c093f0d538" released by "delete_volume" :: held 1.163s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:49:54 devstack sudo[89019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c951bed7-0801-42af-8992-5b29b4f40bdf
Apr 09 12:49:54 devstack sudo[89019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:54 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-f7aa2b66-08b8-449e-9cfc-b3b476073bf7 tempest-CreateVolumesFromImageTest-6362499 None] Created reservations ['c1dfd7d6-b255-4556-b2f1-73ff971d72d9', '16536027-c992-4634-9c65-1c3b29cf32b8', '07a59c5c-9740-4c71-aa4d-06fa1177cef4', 'e7488bf6-9766-4471-9fc4-c8000ade7352'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:49:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f7aa2b66-08b8-449e-9cfc-b3b476073bf7 tempest-CreateVolumesFromImageTest-6362499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:49:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f7aa2b66-08b8-449e-9cfc-b3b476073bf7 tempest-CreateVolumesFromImageTest-6362499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:49:54 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f7aa2b66-08b8-449e-9cfc-b3b476073bf7 tempest-CreateVolumesFromImageTest-6362499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:49:54 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f7aa2b66-08b8-449e-9cfc-b3b476073bf7 tempest-CreateVolumesFromImageTest-6362499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:49:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f7aa2b66-08b8-449e-9cfc-b3b476073bf7 tempest-CreateVolumesFromImageTest-6362499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:49:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f7aa2b66-08b8-449e-9cfc-b3b476073bf7 tempest-CreateVolumesFromImageTest-6362499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:54 devstack sudo[89022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:49:54 devstack sudo[89022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:54 devstack sudo[89019]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2e6924ac-1ac6-44c5-89f8-9010170d9d21 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c951bed7-0801-42af-8992-5b29b4f40bdf" returned: 0 in 0.616s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:54 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-2e6924ac-1ac6-44c5-89f8-9010170d9d21 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] <== create_volume: return (1252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:49:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-2e6924ac-1ac6-44c5-89f8-9010170d9d21 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.261s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:49:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b51b3e64-878c-4290-b8fd-fc3159028670 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.092s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:49:54 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-b51b3e64-878c-4290-b8fd-fc3159028670 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:49:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-127430158',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2153402f-2381-4632-8897-484dc5764b95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c6b80f4139f4edfb96692dbc45d987d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:49:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:49:52Z,use_quota=True,user_id='3beb3b0f083f4d749c98b0ac361d914b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:49:54 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-b51b3e64-878c-4290-b8fd-fc3159028670 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Creating volume 2153402f-2381-4632-8897-484dc5764b95 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:49:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b51b3e64-878c-4290-b8fd-fc3159028670 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:49:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b51b3e64-878c-4290-b8fd-fc3159028670 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:49:54 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-b51b3e64-878c-4290-b8fd-fc3159028670 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:49:54 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-b51b3e64-878c-4290-b8fd-fc3159028670 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:49:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b51b3e64-878c-4290-b8fd-fc3159028670 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:49:54 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-b51b3e64-878c-4290-b8fd-fc3159028670 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:49:54 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-b51b3e64-878c-4290-b8fd-fc3159028670 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:49:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b51b3e64-878c-4290-b8fd-fc3159028670 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2153402f-2381-4632-8897-484dc5764b95 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:54 devstack sudo[89042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2153402f-2381-4632-8897-484dc5764b95 1073741824
Apr 09 12:49:54 devstack sudo[89042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:54 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-2e6924ac-1ac6-44c5-89f8-9010170d9d21 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc5794c4-d348-4179-98cf-04916758a19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c951bed7-0801-42af-8992-5b29b4f40bdf', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:54 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-2e6924ac-1ac6-44c5-89f8-9010170d9d21 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (385742d9-fe9e-4336-a913-ecfcad1bcb3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:54 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-2e6924ac-1ac6-44c5-89f8-9010170d9d21 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Volume volume-c951bed7-0801-42af-8992-5b29b4f40bdf (c951bed7-0801-42af-8992-5b29b4f40bdf): created successfully
Apr 09 12:49:54 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-2e6924ac-1ac6-44c5-89f8-9010170d9d21 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (385742d9-fe9e-4336-a913-ecfcad1bcb3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:54 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-2e6924ac-1ac6-44c5-89f8-9010170d9d21 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Flow 'volume_create_manager' (e3f6e74b-2211-45f6-a732-99337fb1f106) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:49:54 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-2e6924ac-1ac6-44c5-89f8-9010170d9d21 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Created volume successfully.
Apr 09 12:49:54 devstack sudo[89022]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f7aa2b66-08b8-449e-9cfc-b3b476073bf7 tempest-CreateVolumesFromImageTest-6362499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.626s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:54 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-f7aa2b66-08b8-449e-9cfc-b3b476073bf7 tempest-CreateVolumesFromImageTest-6362499 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:49:54 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-f7aa2b66-08b8-449e-9cfc-b3b476073bf7 tempest-CreateVolumesFromImageTest-6362499 None] Deleted volume successfully.
Apr 09 12:49:54 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-f7aa2b66-08b8-449e-9cfc-b3b476073bf7 tempest-CreateVolumesFromImageTest-6362499 None] Lock "cinder-fcb9a11e-9a7a-4c74-85c9-85c093f0d538-delete_volume" released by "delete_volume" :: held 1.999s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:49:54 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-1b2cb616-8674-447c-ad86-5f48ed693b32 tempest-CreateVolumesFromImageTest-6362499 None] Acquiring lock "cinder-966ae37a-dbfe-411b-a471-c8e135e72a22-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:49:55 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-1b2cb616-8674-447c-ad86-5f48ed693b32 tempest-CreateVolumesFromImageTest-6362499 None] Lock "cinder-966ae37a-dbfe-411b-a471-c8e135e72a22-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:49:55 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-1b2cb616-8674-447c-ad86-5f48ed693b32 tempest-CreateVolumesFromImageTest-6362499 None] Acquiring lock "cinder-quobyte-966ae37a-dbfe-411b-a471-c8e135e72a22" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:49:55 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-1b2cb616-8674-447c-ad86-5f48ed693b32 tempest-CreateVolumesFromImageTest-6362499 None] Lock "cinder-quobyte-966ae37a-dbfe-411b-a471-c8e135e72a22" acquired by "delete_volume" :: waited 0.010s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:49:55 devstack sudo[89015]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_11bf303b-adca-49d8-8d80-d4a3c72e719a_er6q653hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-455c6e95-fed1-469a-b1a4-2434bfb02223" returned: 0 in 1.228s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:55 devstack cinder-volume[82760]: DEBUG cinder.image.image_utils [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_11bf303b-adca-49d8-8d80-d4a3c72e719a_er6q653hdevstack@QuobyteHD, size 112.00 MB, duration 1.23 sec, destination /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-455c6e95-fed1-469a-b1a4-2434bfb02223 {{(pid=82760) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 12:49:55 devstack cinder-volume[82760]: INFO cinder.image.image_utils [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] Converted 112.00 MB image at 91.15 MB/s
Apr 09 12:49:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-455c6e95-fed1-469a-b1a4-2434bfb02223 1G {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:55 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4af4f7-57b6-4f22-a562-8d3cd0068e9b]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:49:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-1b2cb616-8674-447c-ad86-5f48ed693b32 tempest-CreateVolumesFromImageTest-6362499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-966ae37a-dbfe-411b-a471-c8e135e72a22 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:55 devstack sudo[89044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-455c6e95-fed1-469a-b1a4-2434bfb02223 1G
Apr 09 12:49:55 devstack sudo[89044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:55 devstack sudo[89046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-966ae37a-dbfe-411b-a471-c8e135e72a22
Apr 09 12:49:55 devstack sudo[89046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:55 devstack sudo[89042]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b51b3e64-878c-4290-b8fd-fc3159028670 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2153402f-2381-4632-8897-484dc5764b95 1073741824" returned: 0 in 0.700s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b51b3e64-878c-4290-b8fd-fc3159028670 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2153402f-2381-4632-8897-484dc5764b95 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:55 devstack sudo[89051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2153402f-2381-4632-8897-484dc5764b95
Apr 09 12:49:55 devstack sudo[89051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:55 devstack sudo[89044]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-455c6e95-fed1-469a-b1a4-2434bfb02223 1G" returned: 0 in 0.574s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:55 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f55ab08-5498-43b8-84e4-e3139fcdbbcd]: (4, 'raw') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:49:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-455c6e95-fed1-469a-b1a4-2434bfb02223 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:55 devstack sudo[89056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-455c6e95-fed1-469a-b1a4-2434bfb02223
Apr 09 12:49:55 devstack sudo[89056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:55 devstack sudo[89046]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-1b2cb616-8674-447c-ad86-5f48ed693b32 tempest-CreateVolumesFromImageTest-6362499 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-966ae37a-dbfe-411b-a471-c8e135e72a22" returned: 0 in 0.770s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-1b2cb616-8674-447c-ad86-5f48ed693b32 tempest-CreateVolumesFromImageTest-6362499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-966ae37a-dbfe-411b-a471-c8e135e72a22 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:55 devstack sudo[89062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-966ae37a-dbfe-411b-a471-c8e135e72a22
Apr 09 12:49:55 devstack sudo[89062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:55 devstack sudo[89051]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b51b3e64-878c-4290-b8fd-fc3159028670 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2153402f-2381-4632-8897-484dc5764b95" returned: 0 in 0.532s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:55 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-b51b3e64-878c-4290-b8fd-fc3159028670 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] <== create_volume: return (1266ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:49:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b51b3e64-878c-4290-b8fd-fc3159028670 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:49:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f719aa22-9f1d-4b79-8a00-e960c6f1d2fb tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.116s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:49:55 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f719aa22-9f1d-4b79-8a00-e960c6f1d2fb tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:49:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1408615792',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cca148c4-ea5b-4afa-8d09-a3439d442045,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c6b80f4139f4edfb96692dbc45d987d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:49:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:49:53Z,use_quota=True,user_id='3beb3b0f083f4d749c98b0ac361d914b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:49:55 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-f719aa22-9f1d-4b79-8a00-e960c6f1d2fb tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Creating volume cca148c4-ea5b-4afa-8d09-a3439d442045 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:49:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f719aa22-9f1d-4b79-8a00-e960c6f1d2fb tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:49:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f719aa22-9f1d-4b79-8a00-e960c6f1d2fb tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:49:55 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f719aa22-9f1d-4b79-8a00-e960c6f1d2fb tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:49:55 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f719aa22-9f1d-4b79-8a00-e960c6f1d2fb tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:49:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f719aa22-9f1d-4b79-8a00-e960c6f1d2fb tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:49:55 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f719aa22-9f1d-4b79-8a00-e960c6f1d2fb tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:49:55 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-f719aa22-9f1d-4b79-8a00-e960c6f1d2fb tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:49:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f719aa22-9f1d-4b79-8a00-e960c6f1d2fb tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-cca148c4-ea5b-4afa-8d09-a3439d442045 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:56 devstack sudo[89064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-cca148c4-ea5b-4afa-8d09-a3439d442045 1073741824
Apr 09 12:49:56 devstack sudo[89064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:56 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b51b3e64-878c-4290-b8fd-fc3159028670 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a04bed49-0b4c-41a9-bf3f-a87fbb38a109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2153402f-2381-4632-8897-484dc5764b95', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:56 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b51b3e64-878c-4290-b8fd-fc3159028670 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4936702a-d613-4d7a-8824-9fbe401d9982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:56 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-b51b3e64-878c-4290-b8fd-fc3159028670 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Volume volume-2153402f-2381-4632-8897-484dc5764b95 (2153402f-2381-4632-8897-484dc5764b95): created successfully
Apr 09 12:49:56 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b51b3e64-878c-4290-b8fd-fc3159028670 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4936702a-d613-4d7a-8824-9fbe401d9982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:56 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b51b3e64-878c-4290-b8fd-fc3159028670 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Flow 'volume_create_manager' (86f0984a-3c3d-4f94-bd91-58ca29918240) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:49:56 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-b51b3e64-878c-4290-b8fd-fc3159028670 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Created volume successfully.
Apr 09 12:49:56 devstack sudo[89056]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-455c6e95-fed1-469a-b1a4-2434bfb02223" returned: 0 in 0.632s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-455c6e95-fed1-469a-b1a4-2434bfb02223 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:56 devstack sudo[89068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-455c6e95-fed1-469a-b1a4-2434bfb02223
Apr 09 12:49:56 devstack sudo[89068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:56 devstack sudo[89062]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-1b2cb616-8674-447c-ad86-5f48ed693b32 tempest-CreateVolumesFromImageTest-6362499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-966ae37a-dbfe-411b-a471-c8e135e72a22" returned: 0 in 0.617s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:56 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-1b2cb616-8674-447c-ad86-5f48ed693b32 tempest-CreateVolumesFromImageTest-6362499 None] Lock "cinder-quobyte-966ae37a-dbfe-411b-a471-c8e135e72a22" released by "delete_volume" :: held 1.428s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:49:56 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-1b2cb616-8674-447c-ad86-5f48ed693b32 tempest-CreateVolumesFromImageTest-6362499 None] Created reservations ['fe04ed80-4ac4-48e5-b9e1-eee7f75aeff7', 'e3a807ef-9b62-4618-b2d0-c0486f3d91c0', '04124da6-5aab-41f1-be7f-54fd3636492c', '3d91d524-e3fd-4703-a668-4b4507eef6e1'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:49:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-1b2cb616-8674-447c-ad86-5f48ed693b32 tempest-CreateVolumesFromImageTest-6362499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:49:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-1b2cb616-8674-447c-ad86-5f48ed693b32 tempest-CreateVolumesFromImageTest-6362499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:49:56 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-1b2cb616-8674-447c-ad86-5f48ed693b32 tempest-CreateVolumesFromImageTest-6362499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:49:56 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-1b2cb616-8674-447c-ad86-5f48ed693b32 tempest-CreateVolumesFromImageTest-6362499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:49:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-1b2cb616-8674-447c-ad86-5f48ed693b32 tempest-CreateVolumesFromImageTest-6362499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:49:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-1b2cb616-8674-447c-ad86-5f48ed693b32 tempest-CreateVolumesFromImageTest-6362499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:56 devstack sudo[89074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:49:56 devstack sudo[89074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:56 devstack sudo[89064]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f719aa22-9f1d-4b79-8a00-e960c6f1d2fb tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-cca148c4-ea5b-4afa-8d09-a3439d442045 1073741824" returned: 0 in 0.612s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f719aa22-9f1d-4b79-8a00-e960c6f1d2fb tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-cca148c4-ea5b-4afa-8d09-a3439d442045 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:56 devstack sudo[89076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-cca148c4-ea5b-4afa-8d09-a3439d442045
Apr 09 12:49:56 devstack sudo[89076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:56 devstack sudo[89068]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-455c6e95-fed1-469a-b1a4-2434bfb02223" returned: 1 in 0.587s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-455c6e95-fed1-469a-b1a4-2434bfb02223' failed. Not Retrying. {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 09 12:49:56 devstack cinder-volume[82760]: DEBUG cinder.volume.volume_utils [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] Downloaded image 11bf303b-adca-49d8-8d80-d4a3c72e719a ((None, [{'url': 'file:///opt/stack/data/glance/images/11bf303b-adca-49d8-8d80-d4a3c72e719a', 'metadata': {}}])) to volume 455c6e95-fed1-469a-b1a4-2434bfb02223 successfully. {{(pid=82760) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 09 12:49:56 devstack cinder-volume[82760]: DEBUG cinder.image.image_utils [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] Temporary image 11bf303b-adca-49d8-8d80-d4a3c72e719a for user ea4f010ea60e44c0b5bbb6a50066aff3 is deleted. {{(pid=82760) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 09 12:49:56 devstack cinder-volume[82760]: DEBUG cinder.volume.volume_utils [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] Marking volume 455c6e95-fed1-469a-b1a4-2434bfb02223 as bootable. {{(pid=82760) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 09 12:49:56 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] Copying metadata from image 11bf303b-adca-49d8-8d80-d4a3c72e719a to 455c6e95-fed1-469a-b1a4-2434bfb02223. {{(pid=82760) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 09 12:49:56 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] Creating volume glance metadata for volume 455c6e95-fed1-469a-b1a4-2434bfb02223 backed by image 11bf303b-adca-49d8-8d80-d4a3c72e719a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '11bf303b-adca-49d8-8d80-d4a3c72e719a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82760) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 09 12:49:56 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10f8a8f3-52b0-4bec-8f15-60160b2079f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-455c6e95-fed1-469a-b1a4-2434bfb02223', 'volume_size': 1, 'image_id': '11bf303b-adca-49d8-8d80-d4a3c72e719a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11bf303b-adca-49d8-8d80-d4a3c72e719a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c43b4928ecdf4421ad23e5f918ea33fe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '11bf303b-adca-49d8-8d80-d4a3c72e719a', 'created_at': datetime.datetime(2026, 4, 9, 10, 38, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 10, 38, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11bf303b-adca-49d8-8d80-d4a3c72e719a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f378da6fd60>}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:56 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (778c66dd-200a-4adf-a8e5-6ab7eeb1f499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:56 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] Volume volume-455c6e95-fed1-469a-b1a4-2434bfb02223 (455c6e95-fed1-469a-b1a4-2434bfb02223): created successfully
Apr 09 12:49:56 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (778c66dd-200a-4adf-a8e5-6ab7eeb1f499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:56 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] Flow 'volume_create_manager' (16826f1e-cca1-406d-9377-80943863820f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:49:56 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-463b97e0-1860-4e66-a9c2-50fefb00f8ff tempest-VolumesExtendTest-295816054 None] Created volume successfully.
Apr 09 12:49:57 devstack sudo[89074]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-1b2cb616-8674-447c-ad86-5f48ed693b32 tempest-CreateVolumesFromImageTest-6362499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.469s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:57 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-1b2cb616-8674-447c-ad86-5f48ed693b32 tempest-CreateVolumesFromImageTest-6362499 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:49:57 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-1b2cb616-8674-447c-ad86-5f48ed693b32 tempest-CreateVolumesFromImageTest-6362499 None] Deleted volume successfully.
Apr 09 12:49:57 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-1b2cb616-8674-447c-ad86-5f48ed693b32 tempest-CreateVolumesFromImageTest-6362499 None] Lock "cinder-966ae37a-dbfe-411b-a471-c8e135e72a22-delete_volume" released by "delete_volume" :: held 2.056s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:49:57 devstack sudo[89076]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f719aa22-9f1d-4b79-8a00-e960c6f1d2fb tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-cca148c4-ea5b-4afa-8d09-a3439d442045" returned: 0 in 0.496s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:57 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f719aa22-9f1d-4b79-8a00-e960c6f1d2fb tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:49:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f719aa22-9f1d-4b79-8a00-e960c6f1d2fb tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:49:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c072d21e-1bf2-402d-b3cb-d07edcd6e562 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.022s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:49:57 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-c072d21e-1bf2-402d-b3cb-d07edcd6e562 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:49:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-296277579',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f605275a-ba8d-4318-9812-3a8a68c1cc6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c6b80f4139f4edfb96692dbc45d987d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:49:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:49:53Z,use_quota=True,user_id='3beb3b0f083f4d749c98b0ac361d914b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:49:57 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-c072d21e-1bf2-402d-b3cb-d07edcd6e562 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Creating volume f605275a-ba8d-4318-9812-3a8a68c1cc6f {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:49:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c072d21e-1bf2-402d-b3cb-d07edcd6e562 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:49:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c072d21e-1bf2-402d-b3cb-d07edcd6e562 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:49:57 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-c072d21e-1bf2-402d-b3cb-d07edcd6e562 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:49:57 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-c072d21e-1bf2-402d-b3cb-d07edcd6e562 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:49:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c072d21e-1bf2-402d-b3cb-d07edcd6e562 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:49:57 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-c072d21e-1bf2-402d-b3cb-d07edcd6e562 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:49:57 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-c072d21e-1bf2-402d-b3cb-d07edcd6e562 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:49:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c072d21e-1bf2-402d-b3cb-d07edcd6e562 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f605275a-ba8d-4318-9812-3a8a68c1cc6f 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:57 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f719aa22-9f1d-4b79-8a00-e960c6f1d2fb tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (906ef36a-c812-4d59-9130-e3f0b62e2ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cca148c4-ea5b-4afa-8d09-a3439d442045', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:57 devstack sudo[89083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f605275a-ba8d-4318-9812-3a8a68c1cc6f 1073741824
Apr 09 12:49:57 devstack sudo[89083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:57 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f719aa22-9f1d-4b79-8a00-e960c6f1d2fb tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57b16ada-d3d6-430a-92e0-e01e205a13d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:57 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-f719aa22-9f1d-4b79-8a00-e960c6f1d2fb tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Volume volume-cca148c4-ea5b-4afa-8d09-a3439d442045 (cca148c4-ea5b-4afa-8d09-a3439d442045): created successfully
Apr 09 12:49:57 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f719aa22-9f1d-4b79-8a00-e960c6f1d2fb tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57b16ada-d3d6-430a-92e0-e01e205a13d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:57 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-f719aa22-9f1d-4b79-8a00-e960c6f1d2fb tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Flow 'volume_create_manager' (7ada17c9-91c9-4691-877f-9ac92083aaf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:49:57 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-f719aa22-9f1d-4b79-8a00-e960c6f1d2fb tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Created volume successfully.
Apr 09 12:49:57 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-30225734-acb1-41e6-9ef8-e92c07eb0f20 tempest-CreateVolumesFromImageTest-6362499 None] Acquiring lock "cinder-9f920902-2cde-4c55-bb7d-c08431acb7a2-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:49:57 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-30225734-acb1-41e6-9ef8-e92c07eb0f20 tempest-CreateVolumesFromImageTest-6362499 None] Lock "cinder-9f920902-2cde-4c55-bb7d-c08431acb7a2-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:49:57 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-30225734-acb1-41e6-9ef8-e92c07eb0f20 tempest-CreateVolumesFromImageTest-6362499 None] Acquiring lock "cinder-quobyte-9f920902-2cde-4c55-bb7d-c08431acb7a2" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:49:57 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-30225734-acb1-41e6-9ef8-e92c07eb0f20 tempest-CreateVolumesFromImageTest-6362499 None] Lock "cinder-quobyte-9f920902-2cde-4c55-bb7d-c08431acb7a2" acquired by "delete_volume" :: waited 0.011s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:49:57 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[32949077-135a-4988-a8f3-33f2c6a7073b]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:49:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-30225734-acb1-41e6-9ef8-e92c07eb0f20 tempest-CreateVolumesFromImageTest-6362499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9f920902-2cde-4c55-bb7d-c08431acb7a2 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:57 devstack sudo[89085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9f920902-2cde-4c55-bb7d-c08431acb7a2
Apr 09 12:49:57 devstack sudo[89085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-23b9f39a-27ce-43a1-9927-7fa591a1cc7c tempest-VolumesExtendTest-295816054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:49:57 devstack sudo[89083]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c072d21e-1bf2-402d-b3cb-d07edcd6e562 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f605275a-ba8d-4318-9812-3a8a68c1cc6f 1073741824" returned: 0 in 0.676s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c072d21e-1bf2-402d-b3cb-d07edcd6e562 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f605275a-ba8d-4318-9812-3a8a68c1cc6f {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:57 devstack sudo[89093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f605275a-ba8d-4318-9812-3a8a68c1cc6f
Apr 09 12:49:57 devstack sudo[89093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:57 devstack sudo[89085]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-30225734-acb1-41e6-9ef8-e92c07eb0f20 tempest-CreateVolumesFromImageTest-6362499 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9f920902-2cde-4c55-bb7d-c08431acb7a2" returned: 0 in 0.671s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-30225734-acb1-41e6-9ef8-e92c07eb0f20 tempest-CreateVolumesFromImageTest-6362499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9f920902-2cde-4c55-bb7d-c08431acb7a2 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:57 devstack sudo[89095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9f920902-2cde-4c55-bb7d-c08431acb7a2
Apr 09 12:49:57 devstack sudo[89095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:58 devstack sudo[89093]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c072d21e-1bf2-402d-b3cb-d07edcd6e562 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f605275a-ba8d-4318-9812-3a8a68c1cc6f" returned: 0 in 0.461s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:58 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-c072d21e-1bf2-402d-b3cb-d07edcd6e562 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:49:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c072d21e-1bf2-402d-b3cb-d07edcd6e562 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:49:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-23b9f39a-27ce-43a1-9927-7fa591a1cc7c tempest-VolumesExtendTest-295816054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.650s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:49:58 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c072d21e-1bf2-402d-b3cb-d07edcd6e562 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05ba36bc-97c0-454b-9812-8ec557d61ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f605275a-ba8d-4318-9812-3a8a68c1cc6f', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:58 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c072d21e-1bf2-402d-b3cb-d07edcd6e562 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8c31e1e-e293-4565-b5e5-3dda3d524311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:49:58 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-c072d21e-1bf2-402d-b3cb-d07edcd6e562 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Volume volume-f605275a-ba8d-4318-9812-3a8a68c1cc6f (f605275a-ba8d-4318-9812-3a8a68c1cc6f): created successfully
Apr 09 12:49:58 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c072d21e-1bf2-402d-b3cb-d07edcd6e562 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8c31e1e-e293-4565-b5e5-3dda3d524311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:49:58 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c072d21e-1bf2-402d-b3cb-d07edcd6e562 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Flow 'volume_create_manager' (79e127af-2424-4809-a26f-0d3ecd56b210) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:49:58 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[7efe7404-3e86-45bb-9c20-52e7f9aa0e12]: (4, 'raw') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:49:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-23b9f39a-27ce-43a1-9927-7fa591a1cc7c tempest-VolumesExtendTest-295816054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-455c6e95-fed1-469a-b1a4-2434bfb02223 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:58 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-c072d21e-1bf2-402d-b3cb-d07edcd6e562 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Created volume successfully.
Apr 09 12:49:58 devstack sudo[89098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-455c6e95-fed1-469a-b1a4-2434bfb02223
Apr 09 12:49:58 devstack sudo[89098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:58 devstack sudo[89095]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-30225734-acb1-41e6-9ef8-e92c07eb0f20 tempest-CreateVolumesFromImageTest-6362499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9f920902-2cde-4c55-bb7d-c08431acb7a2" returned: 0 in 0.501s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:58 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-30225734-acb1-41e6-9ef8-e92c07eb0f20 tempest-CreateVolumesFromImageTest-6362499 None] Lock "cinder-quobyte-9f920902-2cde-4c55-bb7d-c08431acb7a2" released by "delete_volume" :: held 1.208s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:49:58 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-30225734-acb1-41e6-9ef8-e92c07eb0f20 tempest-CreateVolumesFromImageTest-6362499 None] Created reservations ['f1de25ab-5c48-4afb-89a8-f9fcda379a72', 'cda8c38f-50fb-4c28-b57b-2a34b62b7a18', '4920ed8c-81ae-442d-b521-de9c4145fe07', 'f6e3856c-2448-44d8-b52d-538cfe03becf'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:49:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-30225734-acb1-41e6-9ef8-e92c07eb0f20 tempest-CreateVolumesFromImageTest-6362499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:49:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-30225734-acb1-41e6-9ef8-e92c07eb0f20 tempest-CreateVolumesFromImageTest-6362499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:49:58 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-30225734-acb1-41e6-9ef8-e92c07eb0f20 tempest-CreateVolumesFromImageTest-6362499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:49:58 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-30225734-acb1-41e6-9ef8-e92c07eb0f20 tempest-CreateVolumesFromImageTest-6362499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:49:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-30225734-acb1-41e6-9ef8-e92c07eb0f20 tempest-CreateVolumesFromImageTest-6362499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:49:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-30225734-acb1-41e6-9ef8-e92c07eb0f20 tempest-CreateVolumesFromImageTest-6362499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:58 devstack sudo[89101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:49:58 devstack sudo[89101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:58 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-202c7638-0e0f-4760-8677-e80d62785b5e tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Acquiring lock "cinder-f605275a-ba8d-4318-9812-3a8a68c1cc6f-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:49:58 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-202c7638-0e0f-4760-8677-e80d62785b5e tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "cinder-f605275a-ba8d-4318-9812-3a8a68c1cc6f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:49:58 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-202c7638-0e0f-4760-8677-e80d62785b5e tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Acquiring lock "cinder-quobyte-f605275a-ba8d-4318-9812-3a8a68c1cc6f" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:49:58 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-202c7638-0e0f-4760-8677-e80d62785b5e tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "cinder-quobyte-f605275a-ba8d-4318-9812-3a8a68c1cc6f" acquired by "delete_volume" :: waited 0.013s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:49:58 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be49245-b87a-4648-a0fb-219a54f389d2]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:49:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-202c7638-0e0f-4760-8677-e80d62785b5e tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f605275a-ba8d-4318-9812-3a8a68c1cc6f {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:58 devstack sudo[89103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f605275a-ba8d-4318-9812-3a8a68c1cc6f
Apr 09 12:49:58 devstack sudo[89103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:58 devstack sudo[89098]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-23b9f39a-27ce-43a1-9927-7fa591a1cc7c tempest-VolumesExtendTest-295816054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-455c6e95-fed1-469a-b1a4-2434bfb02223" returned: 0 in 0.640s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-23b9f39a-27ce-43a1-9927-7fa591a1cc7c tempest-VolumesExtendTest-295816054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-455c6e95-fed1-469a-b1a4-2434bfb02223 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:59 devstack sudo[89107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-455c6e95-fed1-469a-b1a4-2434bfb02223
Apr 09 12:49:59 devstack sudo[89107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:59 devstack sudo[89101]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:59 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-30225734-acb1-41e6-9ef8-e92c07eb0f20 tempest-CreateVolumesFromImageTest-6362499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.607s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:59 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-30225734-acb1-41e6-9ef8-e92c07eb0f20 tempest-CreateVolumesFromImageTest-6362499 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:49:59 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-30225734-acb1-41e6-9ef8-e92c07eb0f20 tempest-CreateVolumesFromImageTest-6362499 None] Deleted volume successfully.
Apr 09 12:49:59 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-30225734-acb1-41e6-9ef8-e92c07eb0f20 tempest-CreateVolumesFromImageTest-6362499 None] Lock "cinder-9f920902-2cde-4c55-bb7d-c08431acb7a2-delete_volume" released by "delete_volume" :: held 1.988s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:49:59 devstack sudo[89103]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:59 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-202c7638-0e0f-4760-8677-e80d62785b5e tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f605275a-ba8d-4318-9812-3a8a68c1cc6f" returned: 0 in 0.555s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:59 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-202c7638-0e0f-4760-8677-e80d62785b5e tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f605275a-ba8d-4318-9812-3a8a68c1cc6f {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:59 devstack sudo[89113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f605275a-ba8d-4318-9812-3a8a68c1cc6f
Apr 09 12:49:59 devstack sudo[89113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:59 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-3a42c679-9056-4310-839e-ffc0c03d91e5 tempest-CreateVolumesFromImageTest-6362499 None] Acquiring lock "cinder-1609aa42-e224-4e62-aa12-b39c762b4007-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:49:59 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-3a42c679-9056-4310-839e-ffc0c03d91e5 tempest-CreateVolumesFromImageTest-6362499 None] Lock "cinder-1609aa42-e224-4e62-aa12-b39c762b4007-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:49:59 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-3a42c679-9056-4310-839e-ffc0c03d91e5 tempest-CreateVolumesFromImageTest-6362499 None] Acquiring lock "cinder-quobyte-1609aa42-e224-4e62-aa12-b39c762b4007" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:49:59 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-3a42c679-9056-4310-839e-ffc0c03d91e5 tempest-CreateVolumesFromImageTest-6362499 None] Lock "cinder-quobyte-1609aa42-e224-4e62-aa12-b39c762b4007" acquired by "delete_volume" :: waited 0.014s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:49:59 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee27a1a4-e3ea-4b33-94d1-3355ee30628a]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:49:59 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-3a42c679-9056-4310-839e-ffc0c03d91e5 tempest-CreateVolumesFromImageTest-6362499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1609aa42-e224-4e62-aa12-b39c762b4007 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:59 devstack sudo[89107]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:59 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-23b9f39a-27ce-43a1-9927-7fa591a1cc7c tempest-VolumesExtendTest-295816054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-455c6e95-fed1-469a-b1a4-2434bfb02223" returned: 1 in 0.613s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:59 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-23b9f39a-27ce-43a1-9927-7fa591a1cc7c tempest-VolumesExtendTest-295816054 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-455c6e95-fed1-469a-b1a4-2434bfb02223' failed. Not Retrying. {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 09 12:49:59 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-23b9f39a-27ce-43a1-9927-7fa591a1cc7c tempest-VolumesExtendTest-295816054 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-455c6e95-fed1-469a-b1a4-2434bfb02223 2G {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:49:59 devstack sudo[89118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1609aa42-e224-4e62-aa12-b39c762b4007
Apr 09 12:49:59 devstack sudo[89118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:49:59 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-23b9f39a-27ce-43a1-9927-7fa591a1cc7c tempest-VolumesExtendTest-295816054 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-455c6e95-fed1-469a-b1a4-2434bfb02223 2G" returned: 0 in 0.047s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:59 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-23b9f39a-27ce-43a1-9927-7fa591a1cc7c tempest-VolumesExtendTest-295816054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.356s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:49:59 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-23b9f39a-27ce-43a1-9927-7fa591a1cc7c tempest-VolumesExtendTest-295816054 None] Extend volume completed successfully.
Apr 09 12:49:59 devstack sudo[89113]: pam_unix(sudo:session): session closed for user root
Apr 09 12:49:59 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-202c7638-0e0f-4760-8677-e80d62785b5e tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-f605275a-ba8d-4318-9812-3a8a68c1cc6f" returned: 0 in 0.618s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:49:59 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-202c7638-0e0f-4760-8677-e80d62785b5e tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "cinder-quobyte-f605275a-ba8d-4318-9812-3a8a68c1cc6f" released by "delete_volume" :: held 1.215s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:50:00 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-202c7638-0e0f-4760-8677-e80d62785b5e tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Created reservations ['51fae876-fc60-4774-87dc-7b1983d533a3', '8b3bebc8-849a-461b-84e4-f35957de4e46', 'f70caddb-77f5-4408-a467-a4548578fe90', 'e9b84431-ec33-4755-957c-7a7bdd8ecf9c'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:50:00 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-557f526e-174f-4c23-841a-baac24d7b072 tempest-VolumesExtendTest-295816054 None] Acquiring lock "cinder-455c6e95-fed1-469a-b1a4-2434bfb02223-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:50:00 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-557f526e-174f-4c23-841a-baac24d7b072 tempest-VolumesExtendTest-295816054 None] Lock "cinder-455c6e95-fed1-469a-b1a4-2434bfb02223-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:50:00 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-557f526e-174f-4c23-841a-baac24d7b072 tempest-VolumesExtendTest-295816054 None] Acquiring lock "cinder-quobyte-455c6e95-fed1-469a-b1a4-2434bfb02223" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:50:00 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-557f526e-174f-4c23-841a-baac24d7b072 tempest-VolumesExtendTest-295816054 None] Lock "cinder-quobyte-455c6e95-fed1-469a-b1a4-2434bfb02223" acquired by "delete_volume" :: waited 0.015s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:50:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-202c7638-0e0f-4760-8677-e80d62785b5e tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:50:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-202c7638-0e0f-4760-8677-e80d62785b5e tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:50:00 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-202c7638-0e0f-4760-8677-e80d62785b5e tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:50:00 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-202c7638-0e0f-4760-8677-e80d62785b5e tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:50:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-202c7638-0e0f-4760-8677-e80d62785b5e tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:50:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-202c7638-0e0f-4760-8677-e80d62785b5e tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:00 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd089ba3-efdc-4d77-b2de-9257f4a9927b]: (4, 'raw') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:50:00 devstack sudo[89127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:50:00 devstack sudo[89127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-557f526e-174f-4c23-841a-baac24d7b072 tempest-VolumesExtendTest-295816054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-455c6e95-fed1-469a-b1a4-2434bfb02223 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:00 devstack sudo[89118]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-3a42c679-9056-4310-839e-ffc0c03d91e5 tempest-CreateVolumesFromImageTest-6362499 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1609aa42-e224-4e62-aa12-b39c762b4007" returned: 0 in 0.674s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-3a42c679-9056-4310-839e-ffc0c03d91e5 tempest-CreateVolumesFromImageTest-6362499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1609aa42-e224-4e62-aa12-b39c762b4007 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:00 devstack sudo[89129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-455c6e95-fed1-469a-b1a4-2434bfb02223
Apr 09 12:50:00 devstack sudo[89129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:00 devstack sudo[89130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1609aa42-e224-4e62-aa12-b39c762b4007
Apr 09 12:50:00 devstack sudo[89130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:00 devstack sudo[89127]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-202c7638-0e0f-4760-8677-e80d62785b5e tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.531s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:00 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-202c7638-0e0f-4760-8677-e80d62785b5e tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:50:00 devstack sudo[89129]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:00 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-202c7638-0e0f-4760-8677-e80d62785b5e tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Deleted volume successfully.
Apr 09 12:50:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-557f526e-174f-4c23-841a-baac24d7b072 tempest-VolumesExtendTest-295816054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-455c6e95-fed1-469a-b1a4-2434bfb02223" returned: 0 in 0.524s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-557f526e-174f-4c23-841a-baac24d7b072 tempest-VolumesExtendTest-295816054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-455c6e95-fed1-469a-b1a4-2434bfb02223 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:00 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-202c7638-0e0f-4760-8677-e80d62785b5e tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "cinder-f605275a-ba8d-4318-9812-3a8a68c1cc6f-delete_volume" released by "delete_volume" :: held 2.003s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:50:00 devstack sudo[89130]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-3a42c679-9056-4310-839e-ffc0c03d91e5 tempest-CreateVolumesFromImageTest-6362499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1609aa42-e224-4e62-aa12-b39c762b4007" returned: 0 in 0.513s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:00 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-3a42c679-9056-4310-839e-ffc0c03d91e5 tempest-CreateVolumesFromImageTest-6362499 None] Lock "cinder-quobyte-1609aa42-e224-4e62-aa12-b39c762b4007" released by "delete_volume" :: held 1.222s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:50:00 devstack sudo[89137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-455c6e95-fed1-469a-b1a4-2434bfb02223
Apr 09 12:50:00 devstack sudo[89137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:00 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-3a42c679-9056-4310-839e-ffc0c03d91e5 tempest-CreateVolumesFromImageTest-6362499 None] Created reservations ['afdeb546-d8ea-4734-837f-d51c756bc7cf', '994a334d-8d91-4ee4-b4da-078e925d19b9', '4dfa18bf-a1c3-4b87-a214-e10efdb4f9fe', '8b54a76c-d60a-4269-b7dc-4a70ab86d2ef'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:50:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-3a42c679-9056-4310-839e-ffc0c03d91e5 tempest-CreateVolumesFromImageTest-6362499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:50:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-3a42c679-9056-4310-839e-ffc0c03d91e5 tempest-CreateVolumesFromImageTest-6362499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:50:00 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-3a42c679-9056-4310-839e-ffc0c03d91e5 tempest-CreateVolumesFromImageTest-6362499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:50:00 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-3a42c679-9056-4310-839e-ffc0c03d91e5 tempest-CreateVolumesFromImageTest-6362499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:50:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-3a42c679-9056-4310-839e-ffc0c03d91e5 tempest-CreateVolumesFromImageTest-6362499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:50:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-3a42c679-9056-4310-839e-ffc0c03d91e5 tempest-CreateVolumesFromImageTest-6362499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:00 devstack sudo[89139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:50:00 devstack sudo[89139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:00 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-92c5a8a6-9506-4872-974e-2b1ea7052cb0 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Acquiring lock "cinder-cca148c4-ea5b-4afa-8d09-a3439d442045-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:50:00 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-92c5a8a6-9506-4872-974e-2b1ea7052cb0 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "cinder-cca148c4-ea5b-4afa-8d09-a3439d442045-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:50:00 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-92c5a8a6-9506-4872-974e-2b1ea7052cb0 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Acquiring lock "cinder-quobyte-cca148c4-ea5b-4afa-8d09-a3439d442045" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:50:01 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-92c5a8a6-9506-4872-974e-2b1ea7052cb0 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "cinder-quobyte-cca148c4-ea5b-4afa-8d09-a3439d442045" acquired by "delete_volume" :: waited 0.011s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:50:01 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6cc098-f947-41ce-b8d8-82f275811df3]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:50:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-92c5a8a6-9506-4872-974e-2b1ea7052cb0 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-cca148c4-ea5b-4afa-8d09-a3439d442045 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:01 devstack sudo[89141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-cca148c4-ea5b-4afa-8d09-a3439d442045
Apr 09 12:50:01 devstack sudo[89141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:01 devstack sudo[89137]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-557f526e-174f-4c23-841a-baac24d7b072 tempest-VolumesExtendTest-295816054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-455c6e95-fed1-469a-b1a4-2434bfb02223" returned: 1 in 0.652s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-557f526e-174f-4c23-841a-baac24d7b072 tempest-VolumesExtendTest-295816054 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-455c6e95-fed1-469a-b1a4-2434bfb02223' failed. Not Retrying. {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 09 12:50:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-557f526e-174f-4c23-841a-baac24d7b072 tempest-VolumesExtendTest-295816054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-455c6e95-fed1-469a-b1a4-2434bfb02223 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:01 devstack sudo[89146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-455c6e95-fed1-469a-b1a4-2434bfb02223
Apr 09 12:50:01 devstack sudo[89146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:01 devstack sudo[89139]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-3a42c679-9056-4310-839e-ffc0c03d91e5 tempest-CreateVolumesFromImageTest-6362499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.599s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:01 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-3a42c679-9056-4310-839e-ffc0c03d91e5 tempest-CreateVolumesFromImageTest-6362499 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:50:01 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-3a42c679-9056-4310-839e-ffc0c03d91e5 tempest-CreateVolumesFromImageTest-6362499 None] Deleted volume successfully.
Apr 09 12:50:01 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-3a42c679-9056-4310-839e-ffc0c03d91e5 tempest-CreateVolumesFromImageTest-6362499 None] Lock "cinder-1609aa42-e224-4e62-aa12-b39c762b4007-delete_volume" released by "delete_volume" :: held 2.034s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:50:01 devstack sudo[89141]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-92c5a8a6-9506-4872-974e-2b1ea7052cb0 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-cca148c4-ea5b-4afa-8d09-a3439d442045" returned: 0 in 0.651s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-92c5a8a6-9506-4872-974e-2b1ea7052cb0 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-cca148c4-ea5b-4afa-8d09-a3439d442045 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:01 devstack sudo[89152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-cca148c4-ea5b-4afa-8d09-a3439d442045
Apr 09 12:50:01 devstack sudo[89152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:01 devstack sudo[89146]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-557f526e-174f-4c23-841a-baac24d7b072 tempest-VolumesExtendTest-295816054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-455c6e95-fed1-469a-b1a4-2434bfb02223" returned: 0 in 0.636s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:01 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-557f526e-174f-4c23-841a-baac24d7b072 tempest-VolumesExtendTest-295816054 None] Lock "cinder-quobyte-455c6e95-fed1-469a-b1a4-2434bfb02223" released by "delete_volume" :: held 1.885s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:50:02 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-557f526e-174f-4c23-841a-baac24d7b072 tempest-VolumesExtendTest-295816054 None] Created reservations ['84c44f4e-7027-492c-a508-ab6b099d406e', '732cee8d-dbc3-4819-a1bc-2b3989f0c6c7', 'fca221ea-2968-4374-a4f6-49e47d6eef06', '252b9ea1-62a9-41af-abf4-5b80059a9d26'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:50:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-557f526e-174f-4c23-841a-baac24d7b072 tempest-VolumesExtendTest-295816054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:50:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-557f526e-174f-4c23-841a-baac24d7b072 tempest-VolumesExtendTest-295816054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:50:02 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-557f526e-174f-4c23-841a-baac24d7b072 tempest-VolumesExtendTest-295816054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:50:02 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-557f526e-174f-4c23-841a-baac24d7b072 tempest-VolumesExtendTest-295816054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:50:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-557f526e-174f-4c23-841a-baac24d7b072 tempest-VolumesExtendTest-295816054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:50:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-557f526e-174f-4c23-841a-baac24d7b072 tempest-VolumesExtendTest-295816054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:02 devstack sudo[89155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:50:02 devstack sudo[89155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:02 devstack sudo[89152]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-92c5a8a6-9506-4872-974e-2b1ea7052cb0 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-cca148c4-ea5b-4afa-8d09-a3439d442045" returned: 0 in 0.620s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:02 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-92c5a8a6-9506-4872-974e-2b1ea7052cb0 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "cinder-quobyte-cca148c4-ea5b-4afa-8d09-a3439d442045" released by "delete_volume" :: held 1.307s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:50:02 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-92c5a8a6-9506-4872-974e-2b1ea7052cb0 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Created reservations ['75e98083-5249-4832-9209-e578c0856f4e', '31959ff1-6c34-4ad8-9459-b8248c505019', '855a7d13-7028-474d-a6db-acbbbabf159d', '7c8933cf-da62-4f1e-8715-caf90817a66c'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:50:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-92c5a8a6-9506-4872-974e-2b1ea7052cb0 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:50:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-92c5a8a6-9506-4872-974e-2b1ea7052cb0 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:50:02 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-92c5a8a6-9506-4872-974e-2b1ea7052cb0 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:50:02 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-92c5a8a6-9506-4872-974e-2b1ea7052cb0 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:50:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-92c5a8a6-9506-4872-974e-2b1ea7052cb0 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:50:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-92c5a8a6-9506-4872-974e-2b1ea7052cb0 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:02 devstack sudo[89158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:50:02 devstack sudo[89158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:02 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-668fb34a-c3a0-4479-ac52-7b24c0f087cb tempest-VolumesExtendTest-295816054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:50:02 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-668fb34a-c3a0-4479-ac52-7b24c0f087cb tempest-VolumesExtendTest-295816054 None] Flow 'volume_create_manager' (6e7dc035-5a91-40d5-86a1-7bdc9db6c632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:50:02 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-668fb34a-c3a0-4479-ac52-7b24c0f087cb tempest-VolumesExtendTest-295816054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06dea808-32c6-49a7-8219-30fe5ef550fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:02 devstack sudo[89155]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:02 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-668fb34a-c3a0-4479-ac52-7b24c0f087cb tempest-VolumesExtendTest-295816054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06dea808-32c6-49a7-8219-30fe5ef550fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:50:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1850269307',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dde215d-33b0-4116-a3e2-f2e587e19a25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='878352933f3a4c70b03529316265065f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:50:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:50:03Z,use_quota=True,user_id='ea4f010ea60e44c0b5bbb6a50066aff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:02 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-668fb34a-c3a0-4479-ac52-7b24c0f087cb tempest-VolumesExtendTest-295816054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f4d33cb-a64d-4c11-8297-27e074516d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:02 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-668fb34a-c3a0-4479-ac52-7b24c0f087cb tempest-VolumesExtendTest-295816054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f4d33cb-a64d-4c11-8297-27e074516d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:02 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-668fb34a-c3a0-4479-ac52-7b24c0f087cb tempest-VolumesExtendTest-295816054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da92252d-b0a2-4f87-881d-ce290d233ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:02 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-668fb34a-c3a0-4479-ac52-7b24c0f087cb tempest-VolumesExtendTest-295816054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da92252d-b0a2-4f87-881d-ce290d233ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dde215d-33b0-4116-a3e2-f2e587e19a25', 'volume_name': 'volume-9dde215d-33b0-4116-a3e2-f2e587e19a25', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:02 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-668fb34a-c3a0-4479-ac52-7b24c0f087cb tempest-VolumesExtendTest-295816054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cd0210c-7c8f-483e-a378-6776cd16d08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:02 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-668fb34a-c3a0-4479-ac52-7b24c0f087cb tempest-VolumesExtendTest-295816054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cd0210c-7c8f-483e-a378-6776cd16d08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:02 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-668fb34a-c3a0-4479-ac52-7b24c0f087cb tempest-VolumesExtendTest-295816054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ca0c6f0-09c4-48ee-b62f-f50b6a6656d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:02 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-668fb34a-c3a0-4479-ac52-7b24c0f087cb tempest-VolumesExtendTest-295816054 None] Volume 9dde215d-33b0-4116-a3e2-f2e587e19a25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dde215d-33b0-4116-a3e2-f2e587e19a25', 'volume_size': 1}
Apr 09 12:50:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-668fb34a-c3a0-4479-ac52-7b24c0f087cb tempest-VolumesExtendTest-295816054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:50:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-668fb34a-c3a0-4479-ac52-7b24c0f087cb tempest-VolumesExtendTest-295816054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:50:02 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-668fb34a-c3a0-4479-ac52-7b24c0f087cb tempest-VolumesExtendTest-295816054 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:50:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1850269307',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dde215d-33b0-4116-a3e2-f2e587e19a25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='878352933f3a4c70b03529316265065f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:50:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:50:03Z,use_quota=True,user_id='ea4f010ea60e44c0b5bbb6a50066aff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:50:02 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-668fb34a-c3a0-4479-ac52-7b24c0f087cb tempest-VolumesExtendTest-295816054 None] Creating volume 9dde215d-33b0-4116-a3e2-f2e587e19a25 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:50:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-668fb34a-c3a0-4479-ac52-7b24c0f087cb tempest-VolumesExtendTest-295816054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:50:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-668fb34a-c3a0-4479-ac52-7b24c0f087cb tempest-VolumesExtendTest-295816054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:50:02 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-668fb34a-c3a0-4479-ac52-7b24c0f087cb tempest-VolumesExtendTest-295816054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:50:02 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-668fb34a-c3a0-4479-ac52-7b24c0f087cb tempest-VolumesExtendTest-295816054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:50:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-668fb34a-c3a0-4479-ac52-7b24c0f087cb tempest-VolumesExtendTest-295816054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:50:02 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-668fb34a-c3a0-4479-ac52-7b24c0f087cb tempest-VolumesExtendTest-295816054 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:50:02 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-668fb34a-c3a0-4479-ac52-7b24c0f087cb tempest-VolumesExtendTest-295816054 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:50:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-668fb34a-c3a0-4479-ac52-7b24c0f087cb tempest-VolumesExtendTest-295816054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9dde215d-33b0-4116-a3e2-f2e587e19a25 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-557f526e-174f-4c23-841a-baac24d7b072 tempest-VolumesExtendTest-295816054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.673s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:02 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-557f526e-174f-4c23-841a-baac24d7b072 tempest-VolumesExtendTest-295816054 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:50:02 devstack sudo[89162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9dde215d-33b0-4116-a3e2-f2e587e19a25 1073741824
Apr 09 12:50:02 devstack sudo[89162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:02 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-557f526e-174f-4c23-841a-baac24d7b072 tempest-VolumesExtendTest-295816054 None] Deleted volume successfully.
Apr 09 12:50:02 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-557f526e-174f-4c23-841a-baac24d7b072 tempest-VolumesExtendTest-295816054 None] Lock "cinder-455c6e95-fed1-469a-b1a4-2434bfb02223-delete_volume" released by "delete_volume" :: held 2.767s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:50:03 devstack sudo[89158]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-92c5a8a6-9506-4872-974e-2b1ea7052cb0 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.625s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:03 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-92c5a8a6-9506-4872-974e-2b1ea7052cb0 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:50:03 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-92c5a8a6-9506-4872-974e-2b1ea7052cb0 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Deleted volume successfully.
Apr 09 12:50:03 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-92c5a8a6-9506-4872-974e-2b1ea7052cb0 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "cinder-cca148c4-ea5b-4afa-8d09-a3439d442045-delete_volume" released by "delete_volume" :: held 2.140s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:50:03 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-2f5c2ff0-9a44-47f7-9f66-aa015566aca7 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Acquiring lock "cinder-2153402f-2381-4632-8897-484dc5764b95-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:50:03 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-2f5c2ff0-9a44-47f7-9f66-aa015566aca7 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "cinder-2153402f-2381-4632-8897-484dc5764b95-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:50:03 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-2f5c2ff0-9a44-47f7-9f66-aa015566aca7 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Acquiring lock "cinder-quobyte-2153402f-2381-4632-8897-484dc5764b95" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:50:03 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-2f5c2ff0-9a44-47f7-9f66-aa015566aca7 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "cinder-quobyte-2153402f-2381-4632-8897-484dc5764b95" acquired by "delete_volume" :: waited 0.014s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:50:03 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c0e63e-b206-45ec-95f4-e54f969e38e6]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:50:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2f5c2ff0-9a44-47f7-9f66-aa015566aca7 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2153402f-2381-4632-8897-484dc5764b95 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:03 devstack sudo[89168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2153402f-2381-4632-8897-484dc5764b95
Apr 09 12:50:03 devstack sudo[89168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:03 devstack sudo[89162]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-668fb34a-c3a0-4479-ac52-7b24c0f087cb tempest-VolumesExtendTest-295816054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9dde215d-33b0-4116-a3e2-f2e587e19a25 1073741824" returned: 0 in 0.707s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-668fb34a-c3a0-4479-ac52-7b24c0f087cb tempest-VolumesExtendTest-295816054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9dde215d-33b0-4116-a3e2-f2e587e19a25 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:03 devstack sudo[89170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9dde215d-33b0-4116-a3e2-f2e587e19a25
Apr 09 12:50:03 devstack sudo[89170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:04 devstack sudo[89168]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2f5c2ff0-9a44-47f7-9f66-aa015566aca7 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2153402f-2381-4632-8897-484dc5764b95" returned: 0 in 0.708s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2f5c2ff0-9a44-47f7-9f66-aa015566aca7 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2153402f-2381-4632-8897-484dc5764b95 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:04 devstack sudo[89176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2153402f-2381-4632-8897-484dc5764b95
Apr 09 12:50:04 devstack sudo[89176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:04 devstack sudo[89170]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-668fb34a-c3a0-4479-ac52-7b24c0f087cb tempest-VolumesExtendTest-295816054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9dde215d-33b0-4116-a3e2-f2e587e19a25" returned: 0 in 0.566s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:04 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-668fb34a-c3a0-4479-ac52-7b24c0f087cb tempest-VolumesExtendTest-295816054 None] <== create_volume: return (1310ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:50:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-668fb34a-c3a0-4479-ac52-7b24c0f087cb tempest-VolumesExtendTest-295816054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.312s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:50:04 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-668fb34a-c3a0-4479-ac52-7b24c0f087cb tempest-VolumesExtendTest-295816054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ca0c6f0-09c4-48ee-b62f-f50b6a6656d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dde215d-33b0-4116-a3e2-f2e587e19a25', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:04 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-668fb34a-c3a0-4479-ac52-7b24c0f087cb tempest-VolumesExtendTest-295816054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87294c94-2348-4ba4-9641-7ee4022310ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:04 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-668fb34a-c3a0-4479-ac52-7b24c0f087cb tempest-VolumesExtendTest-295816054 None] Volume volume-9dde215d-33b0-4116-a3e2-f2e587e19a25 (9dde215d-33b0-4116-a3e2-f2e587e19a25): created successfully
Apr 09 12:50:04 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-668fb34a-c3a0-4479-ac52-7b24c0f087cb tempest-VolumesExtendTest-295816054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87294c94-2348-4ba4-9641-7ee4022310ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:04 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-668fb34a-c3a0-4479-ac52-7b24c0f087cb tempest-VolumesExtendTest-295816054 None] Flow 'volume_create_manager' (6e7dc035-5a91-40d5-86a1-7bdc9db6c632) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:50:04 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-668fb34a-c3a0-4479-ac52-7b24c0f087cb tempest-VolumesExtendTest-295816054 None] Created volume successfully.
Apr 09 12:50:04 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-4495034d-664f-4d49-a23b-c54068d95ece tempest-CreateVolumesFromSnapshotTest-1617940444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:50:04 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4495034d-664f-4d49-a23b-c54068d95ece tempest-CreateVolumesFromSnapshotTest-1617940444 None] Flow 'volume_create_manager' (dba9caf0-c136-46c0-bb45-5bc0d62ab040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:50:04 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4495034d-664f-4d49-a23b-c54068d95ece tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00969f5e-7a7d-4ec1-bcb3-6d68af1e703a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:04 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4495034d-664f-4d49-a23b-c54068d95ece tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00969f5e-7a7d-4ec1-bcb3-6d68af1e703a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:50:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-744758498',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=740f30ef-71bd-4830-8174-eb1da462cd0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777d286a40af4f989749dcd5dbc5e9ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:50:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:50:04Z,use_quota=True,user_id='16b542988ec944b19cdc7ebbb3facff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:04 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4495034d-664f-4d49-a23b-c54068d95ece tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ebd0a6f-635a-4fd8-ba74-1378a2d0e7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:04 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4495034d-664f-4d49-a23b-c54068d95ece tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ebd0a6f-635a-4fd8-ba74-1378a2d0e7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:04 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4495034d-664f-4d49-a23b-c54068d95ece tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2139f04d-e40c-4799-bd90-4be85d02e6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:04 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4495034d-664f-4d49-a23b-c54068d95ece tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2139f04d-e40c-4799-bd90-4be85d02e6ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '740f30ef-71bd-4830-8174-eb1da462cd0b', 'volume_name': 'volume-740f30ef-71bd-4830-8174-eb1da462cd0b', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:04 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4495034d-664f-4d49-a23b-c54068d95ece tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca41b91f-cf7f-4c11-86dd-b79f753e71e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:04 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4495034d-664f-4d49-a23b-c54068d95ece tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca41b91f-cf7f-4c11-86dd-b79f753e71e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:04 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4495034d-664f-4d49-a23b-c54068d95ece tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d276cd9-dc2f-429d-bc73-d29fafeb466f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:04 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-4495034d-664f-4d49-a23b-c54068d95ece tempest-CreateVolumesFromSnapshotTest-1617940444 None] Volume 740f30ef-71bd-4830-8174-eb1da462cd0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-740f30ef-71bd-4830-8174-eb1da462cd0b', 'volume_size': 1}
Apr 09 12:50:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-4495034d-664f-4d49-a23b-c54068d95ece tempest-CreateVolumesFromSnapshotTest-1617940444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:50:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-4495034d-664f-4d49-a23b-c54068d95ece tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:50:04 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-4495034d-664f-4d49-a23b-c54068d95ece tempest-CreateVolumesFromSnapshotTest-1617940444 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:50:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-744758498',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=740f30ef-71bd-4830-8174-eb1da462cd0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777d286a40af4f989749dcd5dbc5e9ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:50:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:50:04Z,use_quota=True,user_id='16b542988ec944b19cdc7ebbb3facff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:50:04 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-4495034d-664f-4d49-a23b-c54068d95ece tempest-CreateVolumesFromSnapshotTest-1617940444 None] Creating volume 740f30ef-71bd-4830-8174-eb1da462cd0b {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:50:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-4495034d-664f-4d49-a23b-c54068d95ece tempest-CreateVolumesFromSnapshotTest-1617940444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:50:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-4495034d-664f-4d49-a23b-c54068d95ece tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:50:04 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-4495034d-664f-4d49-a23b-c54068d95ece tempest-CreateVolumesFromSnapshotTest-1617940444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:50:04 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-4495034d-664f-4d49-a23b-c54068d95ece tempest-CreateVolumesFromSnapshotTest-1617940444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:50:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-4495034d-664f-4d49-a23b-c54068d95ece tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:50:04 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-4495034d-664f-4d49-a23b-c54068d95ece tempest-CreateVolumesFromSnapshotTest-1617940444 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:50:04 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-4495034d-664f-4d49-a23b-c54068d95ece tempest-CreateVolumesFromSnapshotTest-1617940444 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:50:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-4495034d-664f-4d49-a23b-c54068d95ece tempest-CreateVolumesFromSnapshotTest-1617940444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-740f30ef-71bd-4830-8174-eb1da462cd0b 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:04 devstack sudo[89178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-740f30ef-71bd-4830-8174-eb1da462cd0b 1073741824
Apr 09 12:50:04 devstack sudo[89178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:04 devstack sudo[89176]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2f5c2ff0-9a44-47f7-9f66-aa015566aca7 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-2153402f-2381-4632-8897-484dc5764b95" returned: 0 in 0.538s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:04 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-2f5c2ff0-9a44-47f7-9f66-aa015566aca7 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "cinder-quobyte-2153402f-2381-4632-8897-484dc5764b95" released by "delete_volume" :: held 1.287s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:50:04 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-2f5c2ff0-9a44-47f7-9f66-aa015566aca7 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Created reservations ['fdcaa3a7-6c33-485d-8031-1ce141e45e98', 'b4e86c1a-21fc-46be-9512-c23a33d5f8b9', '9d5f48f0-5c75-4484-8c57-3b97cef7a435', '86db72d2-3f57-4e9d-a298-c4868257f5ec'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:50:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-2f5c2ff0-9a44-47f7-9f66-aa015566aca7 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:50:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-2f5c2ff0-9a44-47f7-9f66-aa015566aca7 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:50:04 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-2f5c2ff0-9a44-47f7-9f66-aa015566aca7 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:50:04 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-2f5c2ff0-9a44-47f7-9f66-aa015566aca7 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:50:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-2f5c2ff0-9a44-47f7-9f66-aa015566aca7 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:50:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2f5c2ff0-9a44-47f7-9f66-aa015566aca7 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:04 devstack sudo[89181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:50:04 devstack sudo[89181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-1fafc60d-6f4d-4448-a49b-d1eaacca7d21 tempest-VolumesExtendTest-295816054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:50:05 devstack sudo[89178]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-4495034d-664f-4d49-a23b-c54068d95ece tempest-CreateVolumesFromSnapshotTest-1617940444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-740f30ef-71bd-4830-8174-eb1da462cd0b 1073741824" returned: 0 in 0.647s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-4495034d-664f-4d49-a23b-c54068d95ece tempest-CreateVolumesFromSnapshotTest-1617940444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-740f30ef-71bd-4830-8174-eb1da462cd0b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:05 devstack sudo[89186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-740f30ef-71bd-4830-8174-eb1da462cd0b
Apr 09 12:50:05 devstack sudo[89186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:05 devstack sudo[89181]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2f5c2ff0-9a44-47f7-9f66-aa015566aca7 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.623s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:05 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-2f5c2ff0-9a44-47f7-9f66-aa015566aca7 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:50:05 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-2f5c2ff0-9a44-47f7-9f66-aa015566aca7 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Deleted volume successfully.
Apr 09 12:50:05 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-2f5c2ff0-9a44-47f7-9f66-aa015566aca7 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "cinder-2153402f-2381-4632-8897-484dc5764b95-delete_volume" released by "delete_volume" :: held 2.110s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:50:05 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-b8cc9204-fea5-4e5d-8886-dea10433d135 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Acquiring lock "cinder-c951bed7-0801-42af-8992-5b29b4f40bdf-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:50:05 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-b8cc9204-fea5-4e5d-8886-dea10433d135 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "cinder-c951bed7-0801-42af-8992-5b29b4f40bdf-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:50:05 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-b8cc9204-fea5-4e5d-8886-dea10433d135 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Acquiring lock "cinder-quobyte-c951bed7-0801-42af-8992-5b29b4f40bdf" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:50:05 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-b8cc9204-fea5-4e5d-8886-dea10433d135 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "cinder-quobyte-c951bed7-0801-42af-8992-5b29b4f40bdf" acquired by "delete_volume" :: waited 0.008s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:50:05 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9b39ac-fe92-4977-a77d-e830dbd151ee]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:50:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b8cc9204-fea5-4e5d-8886-dea10433d135 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c951bed7-0801-42af-8992-5b29b4f40bdf {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:05 devstack sudo[89190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c951bed7-0801-42af-8992-5b29b4f40bdf
Apr 09 12:50:05 devstack sudo[89190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:05 devstack sudo[89186]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-4495034d-664f-4d49-a23b-c54068d95ece tempest-CreateVolumesFromSnapshotTest-1617940444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-740f30ef-71bd-4830-8174-eb1da462cd0b" returned: 0 in 0.572s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:05 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-4495034d-664f-4d49-a23b-c54068d95ece tempest-CreateVolumesFromSnapshotTest-1617940444 None] <== create_volume: return (1244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:50:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-4495034d-664f-4d49-a23b-c54068d95ece tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.247s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:50:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-1fafc60d-6f4d-4448-a49b-d1eaacca7d21 tempest-VolumesExtendTest-295816054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.621s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:50:05 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4495034d-664f-4d49-a23b-c54068d95ece tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d276cd9-dc2f-429d-bc73-d29fafeb466f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-740f30ef-71bd-4830-8174-eb1da462cd0b', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:05 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4495034d-664f-4d49-a23b-c54068d95ece tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (534281e9-d7ec-4782-a944-f6dd4b9b010f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:05 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-1fafc60d-6f4d-4448-a49b-d1eaacca7d21 tempest-VolumesExtendTest-295816054 None] Creating offline snapshot f0e3f407-bd17-4440-b9c1-cf19c60730c9 of volume 9dde215d-33b0-4116-a3e2-f2e587e19a25 {{(pid=82760) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 12:50:05 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-4495034d-664f-4d49-a23b-c54068d95ece tempest-CreateVolumesFromSnapshotTest-1617940444 None] Volume volume-740f30ef-71bd-4830-8174-eb1da462cd0b (740f30ef-71bd-4830-8174-eb1da462cd0b): created successfully
Apr 09 12:50:05 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4495034d-664f-4d49-a23b-c54068d95ece tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (534281e9-d7ec-4782-a944-f6dd4b9b010f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:05 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4495034d-664f-4d49-a23b-c54068d95ece tempest-CreateVolumesFromSnapshotTest-1617940444 None] Flow 'volume_create_manager' (dba9caf0-c136-46c0-bb45-5bc0d62ab040) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:50:05 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[734a6b7a-2a6f-4ee5-a4b3-3add751af0ef]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:50:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-1fafc60d-6f4d-4448-a49b-d1eaacca7d21 tempest-VolumesExtendTest-295816054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9dde215d-33b0-4116-a3e2-f2e587e19a25 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:05 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-4495034d-664f-4d49-a23b-c54068d95ece tempest-CreateVolumesFromSnapshotTest-1617940444 None] Created volume successfully.
Apr 09 12:50:05 devstack sudo[89192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9dde215d-33b0-4116-a3e2-f2e587e19a25
Apr 09 12:50:05 devstack sudo[89192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:06 devstack sudo[89190]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:06 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b8cc9204-fea5-4e5d-8886-dea10433d135 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c951bed7-0801-42af-8992-5b29b4f40bdf" returned: 0 in 0.597s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:06 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b8cc9204-fea5-4e5d-8886-dea10433d135 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c951bed7-0801-42af-8992-5b29b4f40bdf {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:06 devstack sudo[89198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c951bed7-0801-42af-8992-5b29b4f40bdf
Apr 09 12:50:06 devstack sudo[89198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:06 devstack sudo[89192]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:06 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-1fafc60d-6f4d-4448-a49b-d1eaacca7d21 tempest-VolumesExtendTest-295816054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9dde215d-33b0-4116-a3e2-f2e587e19a25" returned: 0 in 0.500s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:06 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-1fafc60d-6f4d-4448-a49b-d1eaacca7d21 tempest-VolumesExtendTest-295816054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9dde215d-33b0-4116-a3e2-f2e587e19a25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9dde215d-33b0-4116-a3e2-f2e587e19a25.f0e3f407-bd17-4440-b9c1-cf19c60730c9 1G {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:06 devstack sudo[89202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9dde215d-33b0-4116-a3e2-f2e587e19a25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9dde215d-33b0-4116-a3e2-f2e587e19a25.f0e3f407-bd17-4440-b9c1-cf19c60730c9 1G
Apr 09 12:50:06 devstack sudo[89202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:06 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-72689f26-687c-412e-ac9a-bcb003db5e86 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:50:06 devstack sudo[89198]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:06 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b8cc9204-fea5-4e5d-8886-dea10433d135 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c951bed7-0801-42af-8992-5b29b4f40bdf" returned: 0 in 0.547s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:06 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-b8cc9204-fea5-4e5d-8886-dea10433d135 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "cinder-quobyte-c951bed7-0801-42af-8992-5b29b4f40bdf" released by "delete_volume" :: held 1.176s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:50:06 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-b8cc9204-fea5-4e5d-8886-dea10433d135 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Created reservations ['72a6a784-008d-4b88-a2b4-687956759c39', '0c6d9a31-8413-4b5d-b8e3-f5b7fb184961', '5ce5f433-862f-413c-becb-7cdecc128c39', '52250ddc-510b-4f54-8061-c8776eb6a9cd'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:50:06 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b8cc9204-fea5-4e5d-8886-dea10433d135 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:50:06 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b8cc9204-fea5-4e5d-8886-dea10433d135 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:50:06 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-b8cc9204-fea5-4e5d-8886-dea10433d135 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:50:06 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-b8cc9204-fea5-4e5d-8886-dea10433d135 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:50:06 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b8cc9204-fea5-4e5d-8886-dea10433d135 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:50:06 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b8cc9204-fea5-4e5d-8886-dea10433d135 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:06 devstack sudo[89202]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:06 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-1fafc60d-6f4d-4448-a49b-d1eaacca7d21 tempest-VolumesExtendTest-295816054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9dde215d-33b0-4116-a3e2-f2e587e19a25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9dde215d-33b0-4116-a3e2-f2e587e19a25.f0e3f407-bd17-4440-b9c1-cf19c60730c9 1G" returned: 0 in 0.570s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:06 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-1fafc60d-6f4d-4448-a49b-d1eaacca7d21 tempest-VolumesExtendTest-295816054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dde215d-33b0-4116-a3e2-f2e587e19a25 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9dde215d-33b0-4116-a3e2-f2e587e19a25.f0e3f407-bd17-4440-b9c1-cf19c60730c9 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:06 devstack sudo[89208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:50:06 devstack sudo[89208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:06 devstack sudo[89210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dde215d-33b0-4116-a3e2-f2e587e19a25 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9dde215d-33b0-4116-a3e2-f2e587e19a25.f0e3f407-bd17-4440-b9c1-cf19c60730c9
Apr 09 12:50:06 devstack sudo[89210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:07 devstack sudo[89208]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:07 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b8cc9204-fea5-4e5d-8886-dea10433d135 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.477s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:07 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-b8cc9204-fea5-4e5d-8886-dea10433d135 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:50:07 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-b8cc9204-fea5-4e5d-8886-dea10433d135 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Deleted volume successfully.
Apr 09 12:50:07 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-b8cc9204-fea5-4e5d-8886-dea10433d135 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "cinder-c951bed7-0801-42af-8992-5b29b4f40bdf-delete_volume" released by "delete_volume" :: held 1.817s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:50:07 devstack sudo[89210]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:07 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-1fafc60d-6f4d-4448-a49b-d1eaacca7d21 tempest-VolumesExtendTest-295816054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dde215d-33b0-4116-a3e2-f2e587e19a25 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9dde215d-33b0-4116-a3e2-f2e587e19a25.f0e3f407-bd17-4440-b9c1-cf19c60730c9" returned: 0 in 0.536s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:07 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-1fafc60d-6f4d-4448-a49b-d1eaacca7d21 tempest-VolumesExtendTest-295816054 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9dde215d-33b0-4116-a3e2-f2e587e19a25.f0e3f407-bd17-4440-b9c1-cf19c60730c9 is being set with open permissions: ugo+rw
Apr 09 12:50:07 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-1fafc60d-6f4d-4448-a49b-d1eaacca7d21 tempest-VolumesExtendTest-295816054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9dde215d-33b0-4116-a3e2-f2e587e19a25.f0e3f407-bd17-4440-b9c1-cf19c60730c9 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:07 devstack sudo[89216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9dde215d-33b0-4116-a3e2-f2e587e19a25.f0e3f407-bd17-4440-b9c1-cf19c60730c9
Apr 09 12:50:07 devstack sudo[89216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:07 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-02a7cfef-62db-4644-880e-a51b4f045418 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Acquiring lock "cinder-3a9a662c-177c-4ad5-bd2c-9daf2699e982-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:50:07 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-02a7cfef-62db-4644-880e-a51b4f045418 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "cinder-3a9a662c-177c-4ad5-bd2c-9daf2699e982-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:50:07 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-02a7cfef-62db-4644-880e-a51b4f045418 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Acquiring lock "cinder-quobyte-3a9a662c-177c-4ad5-bd2c-9daf2699e982" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:50:07 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-02a7cfef-62db-4644-880e-a51b4f045418 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "cinder-quobyte-3a9a662c-177c-4ad5-bd2c-9daf2699e982" acquired by "delete_volume" :: waited 0.016s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:50:07 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ceebbf-7eb9-4f59-a5ff-7738b9b13d9f]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:50:07 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-02a7cfef-62db-4644-880e-a51b4f045418 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3a9a662c-177c-4ad5-bd2c-9daf2699e982 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:07 devstack sudo[89216]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:07 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-1fafc60d-6f4d-4448-a49b-d1eaacca7d21 tempest-VolumesExtendTest-295816054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9dde215d-33b0-4116-a3e2-f2e587e19a25.f0e3f407-bd17-4440-b9c1-cf19c60730c9" returned: 0 in 0.491s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:07 devstack sudo[89219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3a9a662c-177c-4ad5-bd2c-9daf2699e982
Apr 09 12:50:07 devstack sudo[89219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:07 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-1fafc60d-6f4d-4448-a49b-d1eaacca7d21 tempest-VolumesExtendTest-295816054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9dde215d-33b0-4116-a3e2-f2e587e19a25.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:07 devstack sudo[89221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9dde215d-33b0-4116-a3e2-f2e587e19a25.info
Apr 09 12:50:07 devstack sudo[89221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:08 devstack sudo[89219]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-02a7cfef-62db-4644-880e-a51b4f045418 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3a9a662c-177c-4ad5-bd2c-9daf2699e982" returned: 0 in 0.642s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-02a7cfef-62db-4644-880e-a51b4f045418 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3a9a662c-177c-4ad5-bd2c-9daf2699e982 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:08 devstack sudo[89221]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-1fafc60d-6f4d-4448-a49b-d1eaacca7d21 tempest-VolumesExtendTest-295816054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9dde215d-33b0-4116-a3e2-f2e587e19a25.info" returned: 0 in 0.560s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:08 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-1fafc60d-6f4d-4448-a49b-d1eaacca7d21 tempest-VolumesExtendTest-295816054 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9dde215d-33b0-4116-a3e2-f2e587e19a25.info is being set with open permissions: ugo+rw
Apr 09 12:50:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-1fafc60d-6f4d-4448-a49b-d1eaacca7d21 tempest-VolumesExtendTest-295816054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9dde215d-33b0-4116-a3e2-f2e587e19a25.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:08 devstack sudo[89227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3a9a662c-177c-4ad5-bd2c-9daf2699e982
Apr 09 12:50:08 devstack sudo[89227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:08 devstack sudo[89229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9dde215d-33b0-4116-a3e2-f2e587e19a25.info
Apr 09 12:50:08 devstack sudo[89229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:08 devstack sudo[89227]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-02a7cfef-62db-4644-880e-a51b4f045418 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3a9a662c-177c-4ad5-bd2c-9daf2699e982" returned: 0 in 0.444s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:08 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-02a7cfef-62db-4644-880e-a51b4f045418 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "cinder-quobyte-3a9a662c-177c-4ad5-bd2c-9daf2699e982" released by "delete_volume" :: held 1.115s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:50:08 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-02a7cfef-62db-4644-880e-a51b4f045418 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Created reservations ['359a159d-3229-4186-a1af-485c54918666', '93c5ca48-5f86-486a-ba23-eda5f0af6fd8', 'ee11d592-bab3-43a3-aff1-b0fb0d81e76a', '5dda3525-623d-4dbf-a03e-a0f164899224'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:50:08 devstack sudo[89229]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-1fafc60d-6f4d-4448-a49b-d1eaacca7d21 tempest-VolumesExtendTest-295816054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9dde215d-33b0-4116-a3e2-f2e587e19a25.info" returned: 0 in 0.547s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-1fafc60d-6f4d-4448-a49b-d1eaacca7d21 tempest-VolumesExtendTest-295816054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.331s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:50:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-72689f26-687c-412e-ac9a-bcb003db5e86 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.340s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:50:09 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-72689f26-687c-412e-ac9a-bcb003db5e86 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Creating offline snapshot b065253e-019b-4290-9b63-3e9df2f9ac3d of volume 740f30ef-71bd-4830-8174-eb1da462cd0b {{(pid=82760) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 12:50:09 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e27acd-36b2-4753-b3b9-4a5e1cc2cdcd]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:50:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-72689f26-687c-412e-ac9a-bcb003db5e86 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-740f30ef-71bd-4830-8174-eb1da462cd0b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:09 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-1fafc60d-6f4d-4448-a49b-d1eaacca7d21 tempest-VolumesExtendTest-295816054 None] Create snapshot completed successfully
Apr 09 12:50:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-02a7cfef-62db-4644-880e-a51b4f045418 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:50:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-02a7cfef-62db-4644-880e-a51b4f045418 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:50:09 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-02a7cfef-62db-4644-880e-a51b4f045418 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:50:09 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-02a7cfef-62db-4644-880e-a51b4f045418 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:50:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-02a7cfef-62db-4644-880e-a51b4f045418 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:50:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-02a7cfef-62db-4644-880e-a51b4f045418 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:09 devstack sudo[89234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:50:09 devstack sudo[89234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:09 devstack sudo[89233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-740f30ef-71bd-4830-8174-eb1da462cd0b
Apr 09 12:50:09 devstack sudo[89233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-fe95e62d-228e-4d71-adaa-beb560ced480 tempest-VolumesExtendTest-295816054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:50:09 devstack cinder-volume[82760]: DEBUG oslo_service.periodic_task [None req-f8337202-8290-4658-916e-19cfa929172e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82760) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 09 12:50:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f8337202-8290-4658-916e-19cfa929172e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:50:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f8337202-8290-4658-916e-19cfa929172e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:50:09 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f8337202-8290-4658-916e-19cfa929172e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:50:09 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f8337202-8290-4658-916e-19cfa929172e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:50:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f8337202-8290-4658-916e-19cfa929172e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:50:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f8337202-8290-4658-916e-19cfa929172e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:09 devstack sudo[89237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:50:09 devstack sudo[89237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:09 devstack sudo[89234]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-02a7cfef-62db-4644-880e-a51b4f045418 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.606s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:09 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-02a7cfef-62db-4644-880e-a51b4f045418 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:50:09 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-02a7cfef-62db-4644-880e-a51b4f045418 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Deleted volume successfully.
Apr 09 12:50:09 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-02a7cfef-62db-4644-880e-a51b4f045418 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "cinder-3a9a662c-177c-4ad5-bd2c-9daf2699e982-delete_volume" released by "delete_volume" :: held 2.061s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:50:09 devstack sudo[89233]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-72689f26-687c-412e-ac9a-bcb003db5e86 tempest-CreateVolumesFromSnapshotTest-1617940444 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-740f30ef-71bd-4830-8174-eb1da462cd0b" returned: 0 in 0.795s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-72689f26-687c-412e-ac9a-bcb003db5e86 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-740f30ef-71bd-4830-8174-eb1da462cd0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-740f30ef-71bd-4830-8174-eb1da462cd0b.b065253e-019b-4290-9b63-3e9df2f9ac3d 1G {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:09 devstack sudo[89244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-740f30ef-71bd-4830-8174-eb1da462cd0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-740f30ef-71bd-4830-8174-eb1da462cd0b.b065253e-019b-4290-9b63-3e9df2f9ac3d 1G
Apr 09 12:50:09 devstack sudo[89244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:09 devstack sudo[89237]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f8337202-8290-4658-916e-19cfa929172e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.507s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:09 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-f8337202-8290-4658-916e-19cfa929172e None None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:50:09 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-14dffa90-767a-4d4b-99eb-d4791a63fc67 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Acquiring lock "cinder-c59e6968-dd36-43c6-ae9b-6a71302d0442-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:50:09 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-14dffa90-767a-4d4b-99eb-d4791a63fc67 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "cinder-c59e6968-dd36-43c6-ae9b-6a71302d0442-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:50:09 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-14dffa90-767a-4d4b-99eb-d4791a63fc67 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Acquiring lock "cinder-quobyte-c59e6968-dd36-43c6-ae9b-6a71302d0442" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:50:09 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-14dffa90-767a-4d4b-99eb-d4791a63fc67 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "cinder-quobyte-c59e6968-dd36-43c6-ae9b-6a71302d0442" acquired by "delete_volume" :: waited 0.011s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:50:10 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[5860aaba-6009-4e5d-919a-88ed29671354]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:50:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-14dffa90-767a-4d4b-99eb-d4791a63fc67 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c59e6968-dd36-43c6-ae9b-6a71302d0442 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:10 devstack sudo[89246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c59e6968-dd36-43c6-ae9b-6a71302d0442
Apr 09 12:50:10 devstack sudo[89246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:10 devstack sudo[89244]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-72689f26-687c-412e-ac9a-bcb003db5e86 tempest-CreateVolumesFromSnapshotTest-1617940444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-740f30ef-71bd-4830-8174-eb1da462cd0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-740f30ef-71bd-4830-8174-eb1da462cd0b.b065253e-019b-4290-9b63-3e9df2f9ac3d 1G" returned: 0 in 0.743s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-72689f26-687c-412e-ac9a-bcb003db5e86 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-740f30ef-71bd-4830-8174-eb1da462cd0b -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-740f30ef-71bd-4830-8174-eb1da462cd0b.b065253e-019b-4290-9b63-3e9df2f9ac3d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:10 devstack sudo[89254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-740f30ef-71bd-4830-8174-eb1da462cd0b -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-740f30ef-71bd-4830-8174-eb1da462cd0b.b065253e-019b-4290-9b63-3e9df2f9ac3d
Apr 09 12:50:10 devstack sudo[89254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:10 devstack sudo[89246]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-14dffa90-767a-4d4b-99eb-d4791a63fc67 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c59e6968-dd36-43c6-ae9b-6a71302d0442" returned: 0 in 0.715s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-14dffa90-767a-4d4b-99eb-d4791a63fc67 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c59e6968-dd36-43c6-ae9b-6a71302d0442 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:10 devstack sudo[89256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c59e6968-dd36-43c6-ae9b-6a71302d0442
Apr 09 12:50:10 devstack sudo[89256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:11 devstack sudo[89254]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:11 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-72689f26-687c-412e-ac9a-bcb003db5e86 tempest-CreateVolumesFromSnapshotTest-1617940444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-740f30ef-71bd-4830-8174-eb1da462cd0b -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-740f30ef-71bd-4830-8174-eb1da462cd0b.b065253e-019b-4290-9b63-3e9df2f9ac3d" returned: 0 in 0.693s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:11 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-72689f26-687c-412e-ac9a-bcb003db5e86 tempest-CreateVolumesFromSnapshotTest-1617940444 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-740f30ef-71bd-4830-8174-eb1da462cd0b.b065253e-019b-4290-9b63-3e9df2f9ac3d is being set with open permissions: ugo+rw
Apr 09 12:50:11 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-72689f26-687c-412e-ac9a-bcb003db5e86 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-740f30ef-71bd-4830-8174-eb1da462cd0b.b065253e-019b-4290-9b63-3e9df2f9ac3d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:11 devstack sudo[89262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-740f30ef-71bd-4830-8174-eb1da462cd0b.b065253e-019b-4290-9b63-3e9df2f9ac3d
Apr 09 12:50:11 devstack sudo[89262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:11 devstack sudo[89256]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:11 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-14dffa90-767a-4d4b-99eb-d4791a63fc67 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-c59e6968-dd36-43c6-ae9b-6a71302d0442" returned: 0 in 0.586s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:11 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-14dffa90-767a-4d4b-99eb-d4791a63fc67 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "cinder-quobyte-c59e6968-dd36-43c6-ae9b-6a71302d0442" released by "delete_volume" :: held 1.332s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:50:11 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-14dffa90-767a-4d4b-99eb-d4791a63fc67 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Created reservations ['3da9be99-8094-4e3e-a264-972b3241482d', 'f1a59fea-3c4d-4e0b-90b4-44463f0a050b', '871561e8-8dad-49c3-a062-0d4717424dd1', '52dd904b-a328-4ba0-88ab-42209f10e48b'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:50:11 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-14dffa90-767a-4d4b-99eb-d4791a63fc67 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:50:11 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-14dffa90-767a-4d4b-99eb-d4791a63fc67 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:50:11 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-14dffa90-767a-4d4b-99eb-d4791a63fc67 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:50:11 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-14dffa90-767a-4d4b-99eb-d4791a63fc67 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:50:11 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-14dffa90-767a-4d4b-99eb-d4791a63fc67 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:50:11 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-14dffa90-767a-4d4b-99eb-d4791a63fc67 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:11 devstack sudo[89265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:50:11 devstack sudo[89265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:11 devstack sudo[89262]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:11 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-72689f26-687c-412e-ac9a-bcb003db5e86 tempest-CreateVolumesFromSnapshotTest-1617940444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-740f30ef-71bd-4830-8174-eb1da462cd0b.b065253e-019b-4290-9b63-3e9df2f9ac3d" returned: 0 in 0.632s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:11 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-72689f26-687c-412e-ac9a-bcb003db5e86 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-740f30ef-71bd-4830-8174-eb1da462cd0b.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:11 devstack sudo[89269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-740f30ef-71bd-4830-8174-eb1da462cd0b.info
Apr 09 12:50:11 devstack sudo[89269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:12 devstack sudo[89265]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:12 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-14dffa90-767a-4d4b-99eb-d4791a63fc67 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.605s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:12 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-14dffa90-767a-4d4b-99eb-d4791a63fc67 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:50:12 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-14dffa90-767a-4d4b-99eb-d4791a63fc67 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Deleted volume successfully.
Apr 09 12:50:12 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-14dffa90-767a-4d4b-99eb-d4791a63fc67 tempest-CreateVolumesFromSourceVolumeTest-1034176904 None] Lock "cinder-c59e6968-dd36-43c6-ae9b-6a71302d0442-delete_volume" released by "delete_volume" :: held 2.159s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:50:12 devstack sudo[89269]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:12 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-72689f26-687c-412e-ac9a-bcb003db5e86 tempest-CreateVolumesFromSnapshotTest-1617940444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-740f30ef-71bd-4830-8174-eb1da462cd0b.info" returned: 0 in 0.624s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:12 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-72689f26-687c-412e-ac9a-bcb003db5e86 tempest-CreateVolumesFromSnapshotTest-1617940444 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-740f30ef-71bd-4830-8174-eb1da462cd0b.info is being set with open permissions: ugo+rw
Apr 09 12:50:12 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-72689f26-687c-412e-ac9a-bcb003db5e86 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-740f30ef-71bd-4830-8174-eb1da462cd0b.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:12 devstack sudo[89273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-740f30ef-71bd-4830-8174-eb1da462cd0b.info
Apr 09 12:50:12 devstack sudo[89273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:13 devstack sudo[89273]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:13 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-72689f26-687c-412e-ac9a-bcb003db5e86 tempest-CreateVolumesFromSnapshotTest-1617940444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-740f30ef-71bd-4830-8174-eb1da462cd0b.info" returned: 0 in 0.688s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:13 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-72689f26-687c-412e-ac9a-bcb003db5e86 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.287s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:50:13 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-fe95e62d-228e-4d71-adaa-beb560ced480 tempest-VolumesExtendTest-295816054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 3.939s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:50:13 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f812b1d-37d2-4e7c-a287-99d8215d46fa]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:50:13 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-fe95e62d-228e-4d71-adaa-beb560ced480 tempest-VolumesExtendTest-295816054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9dde215d-33b0-4116-a3e2-f2e587e19a25 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:13 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-72689f26-687c-412e-ac9a-bcb003db5e86 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Create snapshot completed successfully
Apr 09 12:50:13 devstack sudo[89276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9dde215d-33b0-4116-a3e2-f2e587e19a25
Apr 09 12:50:13 devstack sudo[89276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:13 devstack sudo[89276]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:13 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-fe95e62d-228e-4d71-adaa-beb560ced480 tempest-VolumesExtendTest-295816054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9dde215d-33b0-4116-a3e2-f2e587e19a25" returned: 0 in 0.703s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-fe95e62d-228e-4d71-adaa-beb560ced480 tempest-VolumesExtendTest-295816054 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9dde215d-33b0-4116-a3e2-f2e587e19a25.f0e3f407-bd17-4440-b9c1-cf19c60730c9 2G {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-fe95e62d-228e-4d71-adaa-beb560ced480 tempest-VolumesExtendTest-295816054 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9dde215d-33b0-4116-a3e2-f2e587e19a25.f0e3f407-bd17-4440-b9c1-cf19c60730c9 2G" returned: 0 in 0.109s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-fe95e62d-228e-4d71-adaa-beb560ced480 tempest-VolumesExtendTest-295816054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.844s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:50:14 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-fe95e62d-228e-4d71-adaa-beb560ced480 tempest-VolumesExtendTest-295816054 None] Extend volume completed successfully.
Apr 09 12:50:14 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcc02fe6-39db-428d-a068-14e1710d3654 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:50:14 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-dcc02fe6-39db-428d-a068-14e1710d3654 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Flow 'volume_create_manager' (860e198c-ccaf-480f-8873-5e44230df52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:50:14 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-dcc02fe6-39db-428d-a068-14e1710d3654 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a35cd5a2-3f53-4522-a139-c65174ab6a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:14 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-dcc02fe6-39db-428d-a068-14e1710d3654 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a35cd5a2-3f53-4522-a139-c65174ab6a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:50:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1889071463',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5db82b0d-0575-4926-9432-e2ce277eef2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777d286a40af4f989749dcd5dbc5e9ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:50:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:50:14Z,use_quota=True,user_id='16b542988ec944b19cdc7ebbb3facff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:14 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-dcc02fe6-39db-428d-a068-14e1710d3654 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc8c46f3-f7c3-4117-a33c-cf10da76bdf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:14 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-dcc02fe6-39db-428d-a068-14e1710d3654 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc8c46f3-f7c3-4117-a33c-cf10da76bdf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:14 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-dcc02fe6-39db-428d-a068-14e1710d3654 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e17d2b6-85e6-46af-99d5-950d1717376d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:14 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-dcc02fe6-39db-428d-a068-14e1710d3654 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e17d2b6-85e6-46af-99d5-950d1717376d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5db82b0d-0575-4926-9432-e2ce277eef2c', 'volume_name': 'volume-5db82b0d-0575-4926-9432-e2ce277eef2c', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:14 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-dcc02fe6-39db-428d-a068-14e1710d3654 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7106d132-876b-48fc-bf80-2f829a88d7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:14 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-dcc02fe6-39db-428d-a068-14e1710d3654 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7106d132-876b-48fc-bf80-2f829a88d7c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:14 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-dcc02fe6-39db-428d-a068-14e1710d3654 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf5bed6c-9760-4079-8ecb-af0877d512f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:14 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-dcc02fe6-39db-428d-a068-14e1710d3654 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Volume 5db82b0d-0575-4926-9432-e2ce277eef2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5db82b0d-0575-4926-9432-e2ce277eef2c', 'volume_size': 1}
Apr 09 12:50:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-dcc02fe6-39db-428d-a068-14e1710d3654 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:50:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-dcc02fe6-39db-428d-a068-14e1710d3654 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:50:14 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-dcc02fe6-39db-428d-a068-14e1710d3654 tempest-CreateVolumesFromSnapshotTest-1617940444 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:50:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1889071463',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5db82b0d-0575-4926-9432-e2ce277eef2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777d286a40af4f989749dcd5dbc5e9ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:50:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:50:14Z,use_quota=True,user_id='16b542988ec944b19cdc7ebbb3facff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:50:14 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-dcc02fe6-39db-428d-a068-14e1710d3654 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Creating volume 5db82b0d-0575-4926-9432-e2ce277eef2c {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:50:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-dcc02fe6-39db-428d-a068-14e1710d3654 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:50:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-dcc02fe6-39db-428d-a068-14e1710d3654 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:50:14 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-dcc02fe6-39db-428d-a068-14e1710d3654 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:50:14 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-dcc02fe6-39db-428d-a068-14e1710d3654 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:50:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-dcc02fe6-39db-428d-a068-14e1710d3654 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:50:14 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-dcc02fe6-39db-428d-a068-14e1710d3654 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:50:14 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-dcc02fe6-39db-428d-a068-14e1710d3654 tempest-CreateVolumesFromSnapshotTest-1617940444 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:50:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-dcc02fe6-39db-428d-a068-14e1710d3654 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5db82b0d-0575-4926-9432-e2ce277eef2c 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:14 devstack sudo[89284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5db82b0d-0575-4926-9432-e2ce277eef2c 1073741824
Apr 09 12:50:14 devstack sudo[89284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:14 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d915af3-88f4-438f-89f7-92e2df67f27f tempest-CreateVolumesFromSnapshotTest-1617940444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:50:14 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-6d915af3-88f4-438f-89f7-92e2df67f27f tempest-CreateVolumesFromSnapshotTest-1617940444 None] Flow 'volume_create_manager' (e1bf862b-4680-4598-b1ff-f38fc6ee32b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:50:14 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-6d915af3-88f4-438f-89f7-92e2df67f27f tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac7b8f51-98cc-4f45-a525-9a2e9a0b5bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:14 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-6d915af3-88f4-438f-89f7-92e2df67f27f tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac7b8f51-98cc-4f45-a525-9a2e9a0b5bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:50:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1469738320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=498ed18d-450b-443a-b538-2dc19c7b0366,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777d286a40af4f989749dcd5dbc5e9ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:50:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:50:15Z,use_quota=True,user_id='16b542988ec944b19cdc7ebbb3facff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:14 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-6d915af3-88f4-438f-89f7-92e2df67f27f tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a71522d0-9b6c-4e2a-9076-02cd09ed32dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:14 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-6d915af3-88f4-438f-89f7-92e2df67f27f tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a71522d0-9b6c-4e2a-9076-02cd09ed32dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:14 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-6d915af3-88f4-438f-89f7-92e2df67f27f tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4166c708-2007-41b0-955b-76f2d0d55353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:14 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-6d915af3-88f4-438f-89f7-92e2df67f27f tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4166c708-2007-41b0-955b-76f2d0d55353) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '498ed18d-450b-443a-b538-2dc19c7b0366', 'volume_name': 'volume-498ed18d-450b-443a-b538-2dc19c7b0366', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:14 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-6d915af3-88f4-438f-89f7-92e2df67f27f tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4018ab6-e095-4b42-8ca7-4b486e15d07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:14 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-6d915af3-88f4-438f-89f7-92e2df67f27f tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4018ab6-e095-4b42-8ca7-4b486e15d07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:14 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-6d915af3-88f4-438f-89f7-92e2df67f27f tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39406114-0e5c-4b9d-91c5-3725943a2a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:14 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-6d915af3-88f4-438f-89f7-92e2df67f27f tempest-CreateVolumesFromSnapshotTest-1617940444 None] Volume 498ed18d-450b-443a-b538-2dc19c7b0366: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-498ed18d-450b-443a-b538-2dc19c7b0366', 'volume_size': 1}
Apr 09 12:50:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-6d915af3-88f4-438f-89f7-92e2df67f27f tempest-CreateVolumesFromSnapshotTest-1617940444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:50:14 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-5ec1a00d-438e-4d43-8d82-c6e1a3e093c9 tempest-VolumesExtendTest-295816054 None] Acquiring lock "cinder-f0e3f407-bd17-4440-b9c1-cf19c60730c9-delete_snapshot" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:50:14 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-5ec1a00d-438e-4d43-8d82-c6e1a3e093c9 tempest-VolumesExtendTest-295816054 None] Lock "cinder-f0e3f407-bd17-4440-b9c1-cf19c60730c9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:50:14 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-5ec1a00d-438e-4d43-8d82-c6e1a3e093c9 tempest-VolumesExtendTest-295816054 None] Acquiring lock "cinder-quobyte-9dde215d-33b0-4116-a3e2-f2e587e19a25" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:50:15 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-5ec1a00d-438e-4d43-8d82-c6e1a3e093c9 tempest-VolumesExtendTest-295816054 None] Lock "cinder-quobyte-9dde215d-33b0-4116-a3e2-f2e587e19a25" acquired by "delete_snapshot" :: waited 0.041s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:50:15 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-5ec1a00d-438e-4d43-8d82-c6e1a3e093c9 tempest-VolumesExtendTest-295816054 None] Acquiring lock "cinder-quobyte-f0e3f407-bd17-4440-b9c1-cf19c60730c9" by "_delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:50:15 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-5ec1a00d-438e-4d43-8d82-c6e1a3e093c9 tempest-VolumesExtendTest-295816054 None] Lock "cinder-quobyte-f0e3f407-bd17-4440-b9c1-cf19c60730c9" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:50:15 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-5ec1a00d-438e-4d43-8d82-c6e1a3e093c9 tempest-VolumesExtendTest-295816054 None] Deleting offline snapshot f0e3f407-bd17-4440-b9c1-cf19c60730c9 of volume 9dde215d-33b0-4116-a3e2-f2e587e19a25 {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 12:50:15 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-5ec1a00d-438e-4d43-8d82-c6e1a3e093c9 tempest-VolumesExtendTest-295816054 None] snapshot_file for this snap is: volume-9dde215d-33b0-4116-a3e2-f2e587e19a25.f0e3f407-bd17-4440-b9c1-cf19c60730c9 {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 12:50:15 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[38cfb923-1b06-4a83-82fa-28278468ca80]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:50:15 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-5ec1a00d-438e-4d43-8d82-c6e1a3e093c9 tempest-VolumesExtendTest-295816054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9dde215d-33b0-4116-a3e2-f2e587e19a25.f0e3f407-bd17-4440-b9c1-cf19c60730c9 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:15 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-d883ca40-244d-4fb8-9d76-bb7fe56e56ad tempest-CreateVolumesFromSnapshotTest-1617940444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:50:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d883ca40-244d-4fb8-9d76-bb7fe56e56ad tempest-CreateVolumesFromSnapshotTest-1617940444 None] Flow 'volume_create_manager' (c2ce35ea-f340-4d97-8abc-6ac82e2f0d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:50:15 devstack sudo[89286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9dde215d-33b0-4116-a3e2-f2e587e19a25.f0e3f407-bd17-4440-b9c1-cf19c60730c9
Apr 09 12:50:15 devstack sudo[89286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d883ca40-244d-4fb8-9d76-bb7fe56e56ad tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2abb414-33d3-46d6-9024-1227eb5bd17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d883ca40-244d-4fb8-9d76-bb7fe56e56ad tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2abb414-33d3-46d6-9024-1227eb5bd17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1038558404',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1114d7fc-408b-4101-a03b-42e52c863814,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777d286a40af4f989749dcd5dbc5e9ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:50:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:50:15Z,use_quota=True,user_id='16b542988ec944b19cdc7ebbb3facff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d883ca40-244d-4fb8-9d76-bb7fe56e56ad tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (721c85f5-d2fd-4a13-bb75-c0e452268cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d883ca40-244d-4fb8-9d76-bb7fe56e56ad tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (721c85f5-d2fd-4a13-bb75-c0e452268cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d883ca40-244d-4fb8-9d76-bb7fe56e56ad tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (783ecc41-9cda-4d40-9336-e33ace6e7e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d883ca40-244d-4fb8-9d76-bb7fe56e56ad tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (783ecc41-9cda-4d40-9336-e33ace6e7e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1114d7fc-408b-4101-a03b-42e52c863814', 'volume_name': 'volume-1114d7fc-408b-4101-a03b-42e52c863814', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d883ca40-244d-4fb8-9d76-bb7fe56e56ad tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ba19ffa-d1cd-49fe-81a7-5f313d89fe81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d883ca40-244d-4fb8-9d76-bb7fe56e56ad tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ba19ffa-d1cd-49fe-81a7-5f313d89fe81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d883ca40-244d-4fb8-9d76-bb7fe56e56ad tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10b3560d-b3f8-4767-ac9c-1d98a73cc30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:15 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-d883ca40-244d-4fb8-9d76-bb7fe56e56ad tempest-CreateVolumesFromSnapshotTest-1617940444 None] Volume 1114d7fc-408b-4101-a03b-42e52c863814: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1114d7fc-408b-4101-a03b-42e52c863814', 'volume_size': 1}
Apr 09 12:50:15 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d883ca40-244d-4fb8-9d76-bb7fe56e56ad tempest-CreateVolumesFromSnapshotTest-1617940444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:50:15 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-1be84b06-9fd0-44a2-b47a-0f2719ba11b3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:50:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-1be84b06-9fd0-44a2-b47a-0f2719ba11b3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Flow 'volume_create_manager' (d560f113-793b-47e1-9014-6fb9ef2b9cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:50:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-1be84b06-9fd0-44a2-b47a-0f2719ba11b3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6244326d-baf9-4026-9dd3-c46bbe38e839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:15 devstack sudo[89284]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-1be84b06-9fd0-44a2-b47a-0f2719ba11b3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6244326d-baf9-4026-9dd3-c46bbe38e839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-965738588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9432c4ff-e522-4b94-a5ac-bb1d01476435,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777d286a40af4f989749dcd5dbc5e9ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:50:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:50:15Z,use_quota=True,user_id='16b542988ec944b19cdc7ebbb3facff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-1be84b06-9fd0-44a2-b47a-0f2719ba11b3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (149a8282-48ee-41b5-94a8-dd7212a21dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-1be84b06-9fd0-44a2-b47a-0f2719ba11b3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (149a8282-48ee-41b5-94a8-dd7212a21dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-1be84b06-9fd0-44a2-b47a-0f2719ba11b3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06b86257-be4a-4aa1-8749-e3975b75d2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-1be84b06-9fd0-44a2-b47a-0f2719ba11b3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06b86257-be4a-4aa1-8749-e3975b75d2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9432c4ff-e522-4b94-a5ac-bb1d01476435', 'volume_name': 'volume-9432c4ff-e522-4b94-a5ac-bb1d01476435', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-1be84b06-9fd0-44a2-b47a-0f2719ba11b3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99b87760-3f63-4407-b439-64f4c55127c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-1be84b06-9fd0-44a2-b47a-0f2719ba11b3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99b87760-3f63-4407-b439-64f4c55127c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-1be84b06-9fd0-44a2-b47a-0f2719ba11b3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (245e0231-b3dd-44f5-81a3-f256f57d3de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:15 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-1be84b06-9fd0-44a2-b47a-0f2719ba11b3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Volume 9432c4ff-e522-4b94-a5ac-bb1d01476435: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9432c4ff-e522-4b94-a5ac-bb1d01476435', 'volume_size': 1}
Apr 09 12:50:15 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-1be84b06-9fd0-44a2-b47a-0f2719ba11b3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:50:15 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-dcc02fe6-39db-428d-a068-14e1710d3654 tempest-CreateVolumesFromSnapshotTest-1617940444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5db82b0d-0575-4926-9432-e2ce277eef2c 1073741824" returned: 0 in 1.037s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:15 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-dcc02fe6-39db-428d-a068-14e1710d3654 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5db82b0d-0575-4926-9432-e2ce277eef2c {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:15 devstack sudo[89291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5db82b0d-0575-4926-9432-e2ce277eef2c
Apr 09 12:50:15 devstack sudo[89291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:15 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-8be00371-c1d0-4e1c-ae21-9eb8a9b269a4 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:50:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8be00371-c1d0-4e1c-ae21-9eb8a9b269a4 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Flow 'volume_create_manager' (7d77d4dc-3fbd-4e5c-ba0c-565cc498587b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:50:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8be00371-c1d0-4e1c-ae21-9eb8a9b269a4 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2098cf83-732f-4558-8920-2008acaf827e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8be00371-c1d0-4e1c-ae21-9eb8a9b269a4 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2098cf83-732f-4558-8920-2008acaf827e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1637341300',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9511f59f-3682-4825-b7f9-aeb5258e9003,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777d286a40af4f989749dcd5dbc5e9ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:50:16Z,use_quota=True,user_id='16b542988ec944b19cdc7ebbb3facff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8be00371-c1d0-4e1c-ae21-9eb8a9b269a4 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (924d6904-1452-4719-b918-b10c27c2813a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8be00371-c1d0-4e1c-ae21-9eb8a9b269a4 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (924d6904-1452-4719-b918-b10c27c2813a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8be00371-c1d0-4e1c-ae21-9eb8a9b269a4 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6ca0882-493a-4e68-b1f5-fd62498d5b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8be00371-c1d0-4e1c-ae21-9eb8a9b269a4 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6ca0882-493a-4e68-b1f5-fd62498d5b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9511f59f-3682-4825-b7f9-aeb5258e9003', 'volume_name': 'volume-9511f59f-3682-4825-b7f9-aeb5258e9003', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8be00371-c1d0-4e1c-ae21-9eb8a9b269a4 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7b40307-c5c6-4814-936e-83dbe004a104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8be00371-c1d0-4e1c-ae21-9eb8a9b269a4 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7b40307-c5c6-4814-936e-83dbe004a104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8be00371-c1d0-4e1c-ae21-9eb8a9b269a4 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e8e8049-e71d-4bb1-8b7f-8e07ad9525db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:15 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-8be00371-c1d0-4e1c-ae21-9eb8a9b269a4 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Volume 9511f59f-3682-4825-b7f9-aeb5258e9003: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9511f59f-3682-4825-b7f9-aeb5258e9003', 'volume_size': 1}
Apr 09 12:50:15 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-8be00371-c1d0-4e1c-ae21-9eb8a9b269a4 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:50:16 devstack sudo[89286]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:16 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-5ec1a00d-438e-4d43-8d82-c6e1a3e093c9 tempest-VolumesExtendTest-295816054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9dde215d-33b0-4116-a3e2-f2e587e19a25.f0e3f407-bd17-4440-b9c1-cf19c60730c9" returned: 0 in 1.013s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:16 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-5ec1a00d-438e-4d43-8d82-c6e1a3e093c9 tempest-VolumesExtendTest-295816054 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9dde215d-33b0-4116-a3e2-f2e587e19a25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:50:16 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[d551e581-909e-454e-85b5-0b0740c51f23]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:50:16 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-5ec1a00d-438e-4d43-8d82-c6e1a3e093c9 tempest-VolumesExtendTest-295816054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9dde215d-33b0-4116-a3e2-f2e587e19a25 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:16 devstack sudo[89296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9dde215d-33b0-4116-a3e2-f2e587e19a25
Apr 09 12:50:16 devstack sudo[89296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:16 devstack sudo[89291]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:16 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-dcc02fe6-39db-428d-a068-14e1710d3654 tempest-CreateVolumesFromSnapshotTest-1617940444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5db82b0d-0575-4926-9432-e2ce277eef2c" returned: 0 in 0.656s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:16 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-dcc02fe6-39db-428d-a068-14e1710d3654 tempest-CreateVolumesFromSnapshotTest-1617940444 None] <== create_volume: return (1735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:50:16 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-dcc02fe6-39db-428d-a068-14e1710d3654 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.741s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:50:16 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-6d915af3-88f4-438f-89f7-92e2df67f27f tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.448s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:50:16 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-6d915af3-88f4-438f-89f7-92e2df67f27f tempest-CreateVolumesFromSnapshotTest-1617940444 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:50:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1469738320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=498ed18d-450b-443a-b538-2dc19c7b0366,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777d286a40af4f989749dcd5dbc5e9ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:50:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:50:15Z,use_quota=True,user_id='16b542988ec944b19cdc7ebbb3facff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:50:16 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-6d915af3-88f4-438f-89f7-92e2df67f27f tempest-CreateVolumesFromSnapshotTest-1617940444 None] Creating volume 498ed18d-450b-443a-b538-2dc19c7b0366 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:50:16 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-6d915af3-88f4-438f-89f7-92e2df67f27f tempest-CreateVolumesFromSnapshotTest-1617940444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:50:16 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-6d915af3-88f4-438f-89f7-92e2df67f27f tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:50:16 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-6d915af3-88f4-438f-89f7-92e2df67f27f tempest-CreateVolumesFromSnapshotTest-1617940444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:50:16 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-6d915af3-88f4-438f-89f7-92e2df67f27f tempest-CreateVolumesFromSnapshotTest-1617940444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:50:16 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-6d915af3-88f4-438f-89f7-92e2df67f27f tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:50:16 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-6d915af3-88f4-438f-89f7-92e2df67f27f tempest-CreateVolumesFromSnapshotTest-1617940444 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:50:16 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-6d915af3-88f4-438f-89f7-92e2df67f27f tempest-CreateVolumesFromSnapshotTest-1617940444 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:50:16 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6d915af3-88f4-438f-89f7-92e2df67f27f tempest-CreateVolumesFromSnapshotTest-1617940444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-498ed18d-450b-443a-b538-2dc19c7b0366 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:16 devstack sudo[89299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-498ed18d-450b-443a-b538-2dc19c7b0366 1073741824
Apr 09 12:50:16 devstack sudo[89299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:16 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-dcc02fe6-39db-428d-a068-14e1710d3654 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf5bed6c-9760-4079-8ecb-af0877d512f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5db82b0d-0575-4926-9432-e2ce277eef2c', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:16 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-dcc02fe6-39db-428d-a068-14e1710d3654 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2196498-618d-4ab3-b576-3980eacb21e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:16 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-dcc02fe6-39db-428d-a068-14e1710d3654 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Volume volume-5db82b0d-0575-4926-9432-e2ce277eef2c (5db82b0d-0575-4926-9432-e2ce277eef2c): created successfully
Apr 09 12:50:16 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-dcc02fe6-39db-428d-a068-14e1710d3654 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2196498-618d-4ab3-b576-3980eacb21e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:16 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-dcc02fe6-39db-428d-a068-14e1710d3654 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Flow 'volume_create_manager' (860e198c-ccaf-480f-8873-5e44230df52f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:50:16 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-dcc02fe6-39db-428d-a068-14e1710d3654 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Created volume successfully.
Apr 09 12:50:16 devstack sudo[89296]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:16 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-5ec1a00d-438e-4d43-8d82-c6e1a3e093c9 tempest-VolumesExtendTest-295816054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9dde215d-33b0-4116-a3e2-f2e587e19a25" returned: 0 in 0.715s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:16 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-5ec1a00d-438e-4d43-8d82-c6e1a3e093c9 tempest-VolumesExtendTest-295816054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9dde215d-33b0-4116-a3e2-f2e587e19a25.f0e3f407-bd17-4440-b9c1-cf19c60730c9 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:16 devstack sudo[89307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9dde215d-33b0-4116-a3e2-f2e587e19a25.f0e3f407-bd17-4440-b9c1-cf19c60730c9
Apr 09 12:50:16 devstack sudo[89307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:17 devstack sudo[89299]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:17 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6d915af3-88f4-438f-89f7-92e2df67f27f tempest-CreateVolumesFromSnapshotTest-1617940444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-498ed18d-450b-443a-b538-2dc19c7b0366 1073741824" returned: 0 in 0.691s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:17 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6d915af3-88f4-438f-89f7-92e2df67f27f tempest-CreateVolumesFromSnapshotTest-1617940444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-498ed18d-450b-443a-b538-2dc19c7b0366 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:17 devstack sudo[89309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-498ed18d-450b-443a-b538-2dc19c7b0366
Apr 09 12:50:17 devstack sudo[89309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:17 devstack sudo[89307]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:17 devstack sudo[89309]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:17 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6d915af3-88f4-438f-89f7-92e2df67f27f tempest-CreateVolumesFromSnapshotTest-1617940444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-498ed18d-450b-443a-b538-2dc19c7b0366" returned: 0 in 0.492s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:17 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-6d915af3-88f4-438f-89f7-92e2df67f27f tempest-CreateVolumesFromSnapshotTest-1617940444 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:50:17 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-6d915af3-88f4-438f-89f7-92e2df67f27f tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:50:17 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-5ec1a00d-438e-4d43-8d82-c6e1a3e093c9 tempest-VolumesExtendTest-295816054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9dde215d-33b0-4116-a3e2-f2e587e19a25.f0e3f407-bd17-4440-b9c1-cf19c60730c9" returned: 0 in 0.721s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:17 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d883ca40-244d-4fb8-9d76-bb7fe56e56ad tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.156s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:50:17 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-d883ca40-244d-4fb8-9d76-bb7fe56e56ad tempest-CreateVolumesFromSnapshotTest-1617940444 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1038558404',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1114d7fc-408b-4101-a03b-42e52c863814,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777d286a40af4f989749dcd5dbc5e9ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:50:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:50:15Z,use_quota=True,user_id='16b542988ec944b19cdc7ebbb3facff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:50:17 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-d883ca40-244d-4fb8-9d76-bb7fe56e56ad tempest-CreateVolumesFromSnapshotTest-1617940444 None] Creating volume 1114d7fc-408b-4101-a03b-42e52c863814 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:50:17 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d883ca40-244d-4fb8-9d76-bb7fe56e56ad tempest-CreateVolumesFromSnapshotTest-1617940444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:50:17 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d883ca40-244d-4fb8-9d76-bb7fe56e56ad tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:50:17 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-d883ca40-244d-4fb8-9d76-bb7fe56e56ad tempest-CreateVolumesFromSnapshotTest-1617940444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:50:17 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-d883ca40-244d-4fb8-9d76-bb7fe56e56ad tempest-CreateVolumesFromSnapshotTest-1617940444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:50:17 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d883ca40-244d-4fb8-9d76-bb7fe56e56ad tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:50:17 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-d883ca40-244d-4fb8-9d76-bb7fe56e56ad tempest-CreateVolumesFromSnapshotTest-1617940444 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:50:17 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-d883ca40-244d-4fb8-9d76-bb7fe56e56ad tempest-CreateVolumesFromSnapshotTest-1617940444 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:50:17 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d883ca40-244d-4fb8-9d76-bb7fe56e56ad tempest-CreateVolumesFromSnapshotTest-1617940444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1114d7fc-408b-4101-a03b-42e52c863814 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:17 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-5ec1a00d-438e-4d43-8d82-c6e1a3e093c9 tempest-VolumesExtendTest-295816054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9dde215d-33b0-4116-a3e2-f2e587e19a25.f0e3f407-bd17-4440-b9c1-cf19c60730c9 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:17 devstack sudo[89315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1114d7fc-408b-4101-a03b-42e52c863814 1073741824
Apr 09 12:50:17 devstack sudo[89315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:17 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-6d915af3-88f4-438f-89f7-92e2df67f27f tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39406114-0e5c-4b9d-91c5-3725943a2a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-498ed18d-450b-443a-b538-2dc19c7b0366', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:17 devstack sudo[89316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9dde215d-33b0-4116-a3e2-f2e587e19a25.f0e3f407-bd17-4440-b9c1-cf19c60730c9
Apr 09 12:50:17 devstack sudo[89316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:17 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-6d915af3-88f4-438f-89f7-92e2df67f27f tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e4314d4-ee5c-4bc5-a07f-ce847d38472d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:17 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-6d915af3-88f4-438f-89f7-92e2df67f27f tempest-CreateVolumesFromSnapshotTest-1617940444 None] Volume volume-498ed18d-450b-443a-b538-2dc19c7b0366 (498ed18d-450b-443a-b538-2dc19c7b0366): created successfully
Apr 09 12:50:17 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-6d915af3-88f4-438f-89f7-92e2df67f27f tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e4314d4-ee5c-4bc5-a07f-ce847d38472d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:17 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-6d915af3-88f4-438f-89f7-92e2df67f27f tempest-CreateVolumesFromSnapshotTest-1617940444 None] Flow 'volume_create_manager' (e1bf862b-4680-4598-b1ff-f38fc6ee32b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:50:17 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-6d915af3-88f4-438f-89f7-92e2df67f27f tempest-CreateVolumesFromSnapshotTest-1617940444 None] Created volume successfully.
Apr 09 12:50:18 devstack sudo[89316]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-5ec1a00d-438e-4d43-8d82-c6e1a3e093c9 tempest-VolumesExtendTest-295816054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9dde215d-33b0-4116-a3e2-f2e587e19a25.f0e3f407-bd17-4440-b9c1-cf19c60730c9" returned: 0 in 0.618s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:18 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-5ec1a00d-438e-4d43-8d82-c6e1a3e093c9 tempest-VolumesExtendTest-295816054 None] Lock "cinder-quobyte-f0e3f407-bd17-4440-b9c1-cf19c60730c9" released by "_delete_snapshot" :: held 3.189s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:50:18 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-5ec1a00d-438e-4d43-8d82-c6e1a3e093c9 tempest-VolumesExtendTest-295816054 None] Lock "cinder-quobyte-9dde215d-33b0-4116-a3e2-f2e587e19a25" released by "delete_snapshot" :: held 3.221s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:50:18 devstack sudo[89315]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d883ca40-244d-4fb8-9d76-bb7fe56e56ad tempest-CreateVolumesFromSnapshotTest-1617940444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1114d7fc-408b-4101-a03b-42e52c863814 1073741824" returned: 0 in 0.725s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:18 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-5ec1a00d-438e-4d43-8d82-c6e1a3e093c9 tempest-VolumesExtendTest-295816054 None] Created reservations ['c96fd81b-b0c5-43e9-b55f-43832880a262', '1253de82-67ab-406d-adff-d81574dd67bb', 'e0e400b7-8167-4613-b190-840566c4b506', 'ee7972d4-8d27-40c9-9974-0ef69af1455c'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:50:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d883ca40-244d-4fb8-9d76-bb7fe56e56ad tempest-CreateVolumesFromSnapshotTest-1617940444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1114d7fc-408b-4101-a03b-42e52c863814 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:18 devstack sudo[89323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1114d7fc-408b-4101-a03b-42e52c863814
Apr 09 12:50:18 devstack sudo[89323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:18 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-5ec1a00d-438e-4d43-8d82-c6e1a3e093c9 tempest-VolumesExtendTest-295816054 None] Delete snapshot completed successfully.
Apr 09 12:50:18 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-5ec1a00d-438e-4d43-8d82-c6e1a3e093c9 tempest-VolumesExtendTest-295816054 None] Lock "cinder-f0e3f407-bd17-4440-b9c1-cf19c60730c9-delete_snapshot" released by "delete_snapshot" :: held 3.467s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:50:18 devstack sudo[89323]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d883ca40-244d-4fb8-9d76-bb7fe56e56ad tempest-CreateVolumesFromSnapshotTest-1617940444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1114d7fc-408b-4101-a03b-42e52c863814" returned: 0 in 0.548s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:18 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-d883ca40-244d-4fb8-9d76-bb7fe56e56ad tempest-CreateVolumesFromSnapshotTest-1617940444 None] <== create_volume: return (1344ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:50:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d883ca40-244d-4fb8-9d76-bb7fe56e56ad tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.348s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:50:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-1be84b06-9fd0-44a2-b47a-0f2719ba11b3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.309s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:50:18 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-1be84b06-9fd0-44a2-b47a-0f2719ba11b3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-965738588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9432c4ff-e522-4b94-a5ac-bb1d01476435,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777d286a40af4f989749dcd5dbc5e9ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:50:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:50:15Z,use_quota=True,user_id='16b542988ec944b19cdc7ebbb3facff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:50:18 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-1be84b06-9fd0-44a2-b47a-0f2719ba11b3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Creating volume 9432c4ff-e522-4b94-a5ac-bb1d01476435 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:50:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-1be84b06-9fd0-44a2-b47a-0f2719ba11b3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:50:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-1be84b06-9fd0-44a2-b47a-0f2719ba11b3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:50:18 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-1be84b06-9fd0-44a2-b47a-0f2719ba11b3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:50:18 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-1be84b06-9fd0-44a2-b47a-0f2719ba11b3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:50:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-1be84b06-9fd0-44a2-b47a-0f2719ba11b3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:50:18 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-1be84b06-9fd0-44a2-b47a-0f2719ba11b3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:50:18 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-1be84b06-9fd0-44a2-b47a-0f2719ba11b3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:50:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-1be84b06-9fd0-44a2-b47a-0f2719ba11b3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9432c4ff-e522-4b94-a5ac-bb1d01476435 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:18 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d883ca40-244d-4fb8-9d76-bb7fe56e56ad tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10b3560d-b3f8-4767-ac9c-1d98a73cc30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1114d7fc-408b-4101-a03b-42e52c863814', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:18 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d883ca40-244d-4fb8-9d76-bb7fe56e56ad tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cbc7c37-fa5c-4368-8260-5fa5f5f8fad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:18 devstack sudo[89326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9432c4ff-e522-4b94-a5ac-bb1d01476435 1073741824
Apr 09 12:50:18 devstack sudo[89326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:18 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-d883ca40-244d-4fb8-9d76-bb7fe56e56ad tempest-CreateVolumesFromSnapshotTest-1617940444 None] Volume volume-1114d7fc-408b-4101-a03b-42e52c863814 (1114d7fc-408b-4101-a03b-42e52c863814): created successfully
Apr 09 12:50:18 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d883ca40-244d-4fb8-9d76-bb7fe56e56ad tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cbc7c37-fa5c-4368-8260-5fa5f5f8fad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:18 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d883ca40-244d-4fb8-9d76-bb7fe56e56ad tempest-CreateVolumesFromSnapshotTest-1617940444 None] Flow 'volume_create_manager' (c2ce35ea-f340-4d97-8abc-6ac82e2f0d9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:50:18 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-d883ca40-244d-4fb8-9d76-bb7fe56e56ad tempest-CreateVolumesFromSnapshotTest-1617940444 None] Created volume successfully.
Apr 09 12:50:19 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-f4e84d25-2c16-4d68-b560-be95b61ba685 tempest-VolumesExtendTest-295816054 None] Acquiring lock "cinder-9dde215d-33b0-4116-a3e2-f2e587e19a25-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:50:19 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-f4e84d25-2c16-4d68-b560-be95b61ba685 tempest-VolumesExtendTest-295816054 None] Lock "cinder-9dde215d-33b0-4116-a3e2-f2e587e19a25-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:50:19 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-f4e84d25-2c16-4d68-b560-be95b61ba685 tempest-VolumesExtendTest-295816054 None] Acquiring lock "cinder-quobyte-9dde215d-33b0-4116-a3e2-f2e587e19a25" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:50:19 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-f4e84d25-2c16-4d68-b560-be95b61ba685 tempest-VolumesExtendTest-295816054 None] Lock "cinder-quobyte-9dde215d-33b0-4116-a3e2-f2e587e19a25" acquired by "delete_volume" :: waited 0.013s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:50:19 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae91a546-cc1e-46b6-90a0-fd747f485666]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:50:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f4e84d25-2c16-4d68-b560-be95b61ba685 tempest-VolumesExtendTest-295816054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9dde215d-33b0-4116-a3e2-f2e587e19a25 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:19 devstack sudo[89331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9dde215d-33b0-4116-a3e2-f2e587e19a25
Apr 09 12:50:19 devstack sudo[89331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:19 devstack sudo[89326]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-1be84b06-9fd0-44a2-b47a-0f2719ba11b3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9432c4ff-e522-4b94-a5ac-bb1d01476435 1073741824" returned: 0 in 0.933s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-1be84b06-9fd0-44a2-b47a-0f2719ba11b3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9432c4ff-e522-4b94-a5ac-bb1d01476435 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:19 devstack sudo[89333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9432c4ff-e522-4b94-a5ac-bb1d01476435
Apr 09 12:50:19 devstack sudo[89333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:20 devstack sudo[89331]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:20 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f4e84d25-2c16-4d68-b560-be95b61ba685 tempest-VolumesExtendTest-295816054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9dde215d-33b0-4116-a3e2-f2e587e19a25" returned: 0 in 0.783s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:20 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f4e84d25-2c16-4d68-b560-be95b61ba685 tempest-VolumesExtendTest-295816054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9dde215d-33b0-4116-a3e2-f2e587e19a25 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:20 devstack sudo[89339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9dde215d-33b0-4116-a3e2-f2e587e19a25
Apr 09 12:50:20 devstack sudo[89339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:20 devstack sudo[89333]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:20 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-1be84b06-9fd0-44a2-b47a-0f2719ba11b3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9432c4ff-e522-4b94-a5ac-bb1d01476435" returned: 0 in 0.591s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:20 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-1be84b06-9fd0-44a2-b47a-0f2719ba11b3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] <== create_volume: return (1573ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:50:20 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-1be84b06-9fd0-44a2-b47a-0f2719ba11b3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:50:20 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-8be00371-c1d0-4e1c-ae21-9eb8a9b269a4 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.638s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:50:20 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-8be00371-c1d0-4e1c-ae21-9eb8a9b269a4 tempest-CreateVolumesFromSnapshotTest-1617940444 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1637341300',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9511f59f-3682-4825-b7f9-aeb5258e9003,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777d286a40af4f989749dcd5dbc5e9ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:50:16Z,use_quota=True,user_id='16b542988ec944b19cdc7ebbb3facff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:50:20 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-8be00371-c1d0-4e1c-ae21-9eb8a9b269a4 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Creating volume 9511f59f-3682-4825-b7f9-aeb5258e9003 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:50:20 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-8be00371-c1d0-4e1c-ae21-9eb8a9b269a4 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:50:20 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-8be00371-c1d0-4e1c-ae21-9eb8a9b269a4 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:50:20 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-8be00371-c1d0-4e1c-ae21-9eb8a9b269a4 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:50:20 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-8be00371-c1d0-4e1c-ae21-9eb8a9b269a4 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:50:20 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-8be00371-c1d0-4e1c-ae21-9eb8a9b269a4 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:50:20 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-8be00371-c1d0-4e1c-ae21-9eb8a9b269a4 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:50:20 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-8be00371-c1d0-4e1c-ae21-9eb8a9b269a4 tempest-CreateVolumesFromSnapshotTest-1617940444 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:50:20 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-8be00371-c1d0-4e1c-ae21-9eb8a9b269a4 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9511f59f-3682-4825-b7f9-aeb5258e9003 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:20 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-1be84b06-9fd0-44a2-b47a-0f2719ba11b3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (245e0231-b3dd-44f5-81a3-f256f57d3de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9432c4ff-e522-4b94-a5ac-bb1d01476435', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:20 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-1be84b06-9fd0-44a2-b47a-0f2719ba11b3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94dbde0a-89a0-4c58-9ace-85633a6c9ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:20 devstack sudo[89341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9511f59f-3682-4825-b7f9-aeb5258e9003 1073741824
Apr 09 12:50:20 devstack sudo[89341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:20 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-1be84b06-9fd0-44a2-b47a-0f2719ba11b3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Volume volume-9432c4ff-e522-4b94-a5ac-bb1d01476435 (9432c4ff-e522-4b94-a5ac-bb1d01476435): created successfully
Apr 09 12:50:20 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-1be84b06-9fd0-44a2-b47a-0f2719ba11b3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94dbde0a-89a0-4c58-9ace-85633a6c9ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:20 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-1be84b06-9fd0-44a2-b47a-0f2719ba11b3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Flow 'volume_create_manager' (d560f113-793b-47e1-9014-6fb9ef2b9cd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:50:20 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-1be84b06-9fd0-44a2-b47a-0f2719ba11b3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Created volume successfully.
Apr 09 12:50:21 devstack sudo[89339]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:21 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f4e84d25-2c16-4d68-b560-be95b61ba685 tempest-VolumesExtendTest-295816054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9dde215d-33b0-4116-a3e2-f2e587e19a25" returned: 0 in 0.837s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:21 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-f4e84d25-2c16-4d68-b560-be95b61ba685 tempest-VolumesExtendTest-295816054 None] Lock "cinder-quobyte-9dde215d-33b0-4116-a3e2-f2e587e19a25" released by "delete_volume" :: held 1.686s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:50:21 devstack cinder-volume[82760]: DEBUG dbcounter [-] [82760] Writing DB stats cinder:UPDATE=216,cinder:SELECT=140,cinder:INSERT=57,cinder:DELETE=18 {{(pid=82760) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 12:50:21 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-f4e84d25-2c16-4d68-b560-be95b61ba685 tempest-VolumesExtendTest-295816054 None] Created reservations ['eb4f0f0d-f6db-4a39-a11d-44717fe16708', '538d630a-65bc-40ad-b406-11d62c20c052', '12e47d34-bfb4-475b-8383-287511ecf7c9', '659a302b-6cd2-4217-a233-fb14bb929489'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:50:21 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f4e84d25-2c16-4d68-b560-be95b61ba685 tempest-VolumesExtendTest-295816054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:50:21 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f4e84d25-2c16-4d68-b560-be95b61ba685 tempest-VolumesExtendTest-295816054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:50:21 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f4e84d25-2c16-4d68-b560-be95b61ba685 tempest-VolumesExtendTest-295816054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:50:21 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f4e84d25-2c16-4d68-b560-be95b61ba685 tempest-VolumesExtendTest-295816054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:50:21 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f4e84d25-2c16-4d68-b560-be95b61ba685 tempest-VolumesExtendTest-295816054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:50:21 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f4e84d25-2c16-4d68-b560-be95b61ba685 tempest-VolumesExtendTest-295816054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:21 devstack sudo[89347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:50:21 devstack sudo[89347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:21 devstack sudo[89341]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:21 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-8be00371-c1d0-4e1c-ae21-9eb8a9b269a4 tempest-CreateVolumesFromSnapshotTest-1617940444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9511f59f-3682-4825-b7f9-aeb5258e9003 1073741824" returned: 0 in 0.866s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:21 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-8be00371-c1d0-4e1c-ae21-9eb8a9b269a4 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9511f59f-3682-4825-b7f9-aeb5258e9003 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:21 devstack sudo[89349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9511f59f-3682-4825-b7f9-aeb5258e9003
Apr 09 12:50:21 devstack sudo[89349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:22 devstack sudo[89347]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:22 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f4e84d25-2c16-4d68-b560-be95b61ba685 tempest-VolumesExtendTest-295816054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.745s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:22 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-f4e84d25-2c16-4d68-b560-be95b61ba685 tempest-VolumesExtendTest-295816054 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:50:22 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-f4e84d25-2c16-4d68-b560-be95b61ba685 tempest-VolumesExtendTest-295816054 None] Deleted volume successfully.
Apr 09 12:50:22 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-f4e84d25-2c16-4d68-b560-be95b61ba685 tempest-VolumesExtendTest-295816054 None] Lock "cinder-9dde215d-33b0-4116-a3e2-f2e587e19a25-delete_volume" released by "delete_volume" :: held 2.761s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:50:22 devstack sudo[89349]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:22 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-8be00371-c1d0-4e1c-ae21-9eb8a9b269a4 tempest-CreateVolumesFromSnapshotTest-1617940444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9511f59f-3682-4825-b7f9-aeb5258e9003" returned: 0 in 0.807s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:22 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-8be00371-c1d0-4e1c-ae21-9eb8a9b269a4 tempest-CreateVolumesFromSnapshotTest-1617940444 None] <== create_volume: return (1743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:50:22 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-8be00371-c1d0-4e1c-ae21-9eb8a9b269a4 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.751s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:50:22 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8be00371-c1d0-4e1c-ae21-9eb8a9b269a4 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e8e8049-e71d-4bb1-8b7f-8e07ad9525db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9511f59f-3682-4825-b7f9-aeb5258e9003', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:22 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8be00371-c1d0-4e1c-ae21-9eb8a9b269a4 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85038816-ae71-49f2-9937-0da973200f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:22 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-8be00371-c1d0-4e1c-ae21-9eb8a9b269a4 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Volume volume-9511f59f-3682-4825-b7f9-aeb5258e9003 (9511f59f-3682-4825-b7f9-aeb5258e9003): created successfully
Apr 09 12:50:22 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8be00371-c1d0-4e1c-ae21-9eb8a9b269a4 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85038816-ae71-49f2-9937-0da973200f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:22 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8be00371-c1d0-4e1c-ae21-9eb8a9b269a4 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Flow 'volume_create_manager' (7d77d4dc-3fbd-4e5c-ba0c-565cc498587b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:50:22 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-8be00371-c1d0-4e1c-ae21-9eb8a9b269a4 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Created volume successfully.
Apr 09 12:50:22 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-e5b095e4-9d0d-4884-b955-391dcca435f3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Acquiring lock "cinder-9511f59f-3682-4825-b7f9-aeb5258e9003-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:50:22 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-e5b095e4-9d0d-4884-b955-391dcca435f3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "cinder-9511f59f-3682-4825-b7f9-aeb5258e9003-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:50:22 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-e5b095e4-9d0d-4884-b955-391dcca435f3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Acquiring lock "cinder-quobyte-9511f59f-3682-4825-b7f9-aeb5258e9003" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:50:22 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-e5b095e4-9d0d-4884-b955-391dcca435f3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "cinder-quobyte-9511f59f-3682-4825-b7f9-aeb5258e9003" acquired by "delete_volume" :: waited 0.015s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:50:22 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10885d2-dcef-40cd-a416-c42411dca1e9]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:50:22 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e5b095e4-9d0d-4884-b955-391dcca435f3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9511f59f-3682-4825-b7f9-aeb5258e9003 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:22 devstack sudo[89356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9511f59f-3682-4825-b7f9-aeb5258e9003
Apr 09 12:50:22 devstack sudo[89356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:23 devstack sudo[89356]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e5b095e4-9d0d-4884-b955-391dcca435f3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9511f59f-3682-4825-b7f9-aeb5258e9003" returned: 0 in 0.809s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e5b095e4-9d0d-4884-b955-391dcca435f3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9511f59f-3682-4825-b7f9-aeb5258e9003 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:23 devstack sudo[89367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9511f59f-3682-4825-b7f9-aeb5258e9003
Apr 09 12:50:23 devstack sudo[89367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:24 devstack sudo[89367]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e5b095e4-9d0d-4884-b955-391dcca435f3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9511f59f-3682-4825-b7f9-aeb5258e9003" returned: 0 in 0.674s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:24 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-e5b095e4-9d0d-4884-b955-391dcca435f3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "cinder-quobyte-9511f59f-3682-4825-b7f9-aeb5258e9003" released by "delete_volume" :: held 1.519s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:50:24 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-e5b095e4-9d0d-4884-b955-391dcca435f3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Created reservations ['ba6329dd-d83f-454d-b961-b4cb13983937', 'c208ed86-1620-4aad-9fe9-ac7c380d9f92', '60e30e84-f91e-4735-92ab-b8c46445838f', '7b861a23-f2da-423f-bd10-b7b0e4598ef1'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:50:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-e5b095e4-9d0d-4884-b955-391dcca435f3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:50:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-e5b095e4-9d0d-4884-b955-391dcca435f3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:50:24 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-e5b095e4-9d0d-4884-b955-391dcca435f3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:50:24 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-e5b095e4-9d0d-4884-b955-391dcca435f3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:50:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-e5b095e4-9d0d-4884-b955-391dcca435f3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:50:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e5b095e4-9d0d-4884-b955-391dcca435f3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:24 devstack sudo[89370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:50:24 devstack sudo[89370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:24 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-f9e76701-449f-4257-a7f9-3b56b4c13d81 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Acquiring lock "cinder-9432c4ff-e522-4b94-a5ac-bb1d01476435-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:50:24 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-f9e76701-449f-4257-a7f9-3b56b4c13d81 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "cinder-9432c4ff-e522-4b94-a5ac-bb1d01476435-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:50:24 devstack cinder-volume[82760]: DEBUG dbcounter [-] [82760] Writing DB stats cinder:SELECT=191,cinder:UPDATE=228,cinder:DELETE=21,cinder:INSERT=58 {{(pid=82760) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 12:50:25 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-173b57e5-990c-42c3-98ee-fc59fc3fc603 tempest-VolumesNegativeTest-1971064052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:50:25 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-173b57e5-990c-42c3-98ee-fc59fc3fc603 tempest-VolumesNegativeTest-1971064052 None] Flow 'volume_create_manager' (eb9e2182-6bb4-4edf-a52a-4755b89b6faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:50:25 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-173b57e5-990c-42c3-98ee-fc59fc3fc603 tempest-VolumesNegativeTest-1971064052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84db2105-9c63-4cc1-93ac-4c44b75501f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:25 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-173b57e5-990c-42c3-98ee-fc59fc3fc603 tempest-VolumesNegativeTest-1971064052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84db2105-9c63-4cc1-93ac-4c44b75501f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1580040256',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b3937ed-fe96-4e1e-9fe3-8cc9b08c750a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d17bc752a0b04661b5a41ef29e65b666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:50:25Z,use_quota=True,user_id='ed930930e35c411397c3a2068a582d79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:25 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-173b57e5-990c-42c3-98ee-fc59fc3fc603 tempest-VolumesNegativeTest-1971064052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27a53a88-9c8f-4de7-9bed-a22bbabd2a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:25 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-173b57e5-990c-42c3-98ee-fc59fc3fc603 tempest-VolumesNegativeTest-1971064052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27a53a88-9c8f-4de7-9bed-a22bbabd2a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:25 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-173b57e5-990c-42c3-98ee-fc59fc3fc603 tempest-VolumesNegativeTest-1971064052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a785c6b-cfe0-4dfc-bda0-7f95d2fe8460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:25 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-173b57e5-990c-42c3-98ee-fc59fc3fc603 tempest-VolumesNegativeTest-1971064052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a785c6b-cfe0-4dfc-bda0-7f95d2fe8460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b3937ed-fe96-4e1e-9fe3-8cc9b08c750a', 'volume_name': 'volume-6b3937ed-fe96-4e1e-9fe3-8cc9b08c750a', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:25 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-173b57e5-990c-42c3-98ee-fc59fc3fc603 tempest-VolumesNegativeTest-1971064052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57869c5e-0846-4c49-bfd9-e39c383a6937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:25 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-173b57e5-990c-42c3-98ee-fc59fc3fc603 tempest-VolumesNegativeTest-1971064052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57869c5e-0846-4c49-bfd9-e39c383a6937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:25 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-173b57e5-990c-42c3-98ee-fc59fc3fc603 tempest-VolumesNegativeTest-1971064052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f9d090a-cd78-45fc-8d56-9dc9a6192227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:25 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-173b57e5-990c-42c3-98ee-fc59fc3fc603 tempest-VolumesNegativeTest-1971064052 None] Volume 6b3937ed-fe96-4e1e-9fe3-8cc9b08c750a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b3937ed-fe96-4e1e-9fe3-8cc9b08c750a', 'volume_size': 1}
Apr 09 12:50:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-173b57e5-990c-42c3-98ee-fc59fc3fc603 tempest-VolumesNegativeTest-1971064052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:50:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-173b57e5-990c-42c3-98ee-fc59fc3fc603 tempest-VolumesNegativeTest-1971064052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:50:25 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-173b57e5-990c-42c3-98ee-fc59fc3fc603 tempest-VolumesNegativeTest-1971064052 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1580040256',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b3937ed-fe96-4e1e-9fe3-8cc9b08c750a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d17bc752a0b04661b5a41ef29e65b666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:50:25Z,use_quota=True,user_id='ed930930e35c411397c3a2068a582d79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:50:25 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-173b57e5-990c-42c3-98ee-fc59fc3fc603 tempest-VolumesNegativeTest-1971064052 None] Creating volume 6b3937ed-fe96-4e1e-9fe3-8cc9b08c750a {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:50:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-173b57e5-990c-42c3-98ee-fc59fc3fc603 tempest-VolumesNegativeTest-1971064052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:50:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-173b57e5-990c-42c3-98ee-fc59fc3fc603 tempest-VolumesNegativeTest-1971064052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:50:25 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-173b57e5-990c-42c3-98ee-fc59fc3fc603 tempest-VolumesNegativeTest-1971064052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:50:25 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-173b57e5-990c-42c3-98ee-fc59fc3fc603 tempest-VolumesNegativeTest-1971064052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:50:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-173b57e5-990c-42c3-98ee-fc59fc3fc603 tempest-VolumesNegativeTest-1971064052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:50:25 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-173b57e5-990c-42c3-98ee-fc59fc3fc603 tempest-VolumesNegativeTest-1971064052 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:50:25 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-173b57e5-990c-42c3-98ee-fc59fc3fc603 tempest-VolumesNegativeTest-1971064052 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:50:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-173b57e5-990c-42c3-98ee-fc59fc3fc603 tempest-VolumesNegativeTest-1971064052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6b3937ed-fe96-4e1e-9fe3-8cc9b08c750a 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:25 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-f9e76701-449f-4257-a7f9-3b56b4c13d81 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Acquiring lock "cinder-quobyte-9432c4ff-e522-4b94-a5ac-bb1d01476435" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:50:25 devstack sudo[89373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6b3937ed-fe96-4e1e-9fe3-8cc9b08c750a 1073741824
Apr 09 12:50:25 devstack sudo[89373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:25 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-f9e76701-449f-4257-a7f9-3b56b4c13d81 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "cinder-quobyte-9432c4ff-e522-4b94-a5ac-bb1d01476435" acquired by "delete_volume" :: waited 0.010s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:50:25 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf082691-edd6-4f90-a3d8-adeb8286bdc0]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:50:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f9e76701-449f-4257-a7f9-3b56b4c13d81 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9432c4ff-e522-4b94-a5ac-bb1d01476435 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:25 devstack sudo[89370]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e5b095e4-9d0d-4884-b955-391dcca435f3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.707s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:25 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-e5b095e4-9d0d-4884-b955-391dcca435f3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:50:25 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-e5b095e4-9d0d-4884-b955-391dcca435f3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Deleted volume successfully.
Apr 09 12:50:25 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-e5b095e4-9d0d-4884-b955-391dcca435f3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "cinder-9511f59f-3682-4825-b7f9-aeb5258e9003-delete_volume" released by "delete_volume" :: held 2.462s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:50:25 devstack sudo[89375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9432c4ff-e522-4b94-a5ac-bb1d01476435
Apr 09 12:50:25 devstack sudo[89375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:25 devstack sudo[89373]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-173b57e5-990c-42c3-98ee-fc59fc3fc603 tempest-VolumesNegativeTest-1971064052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6b3937ed-fe96-4e1e-9fe3-8cc9b08c750a 1073741824" returned: 0 in 0.703s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-173b57e5-990c-42c3-98ee-fc59fc3fc603 tempest-VolumesNegativeTest-1971064052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6b3937ed-fe96-4e1e-9fe3-8cc9b08c750a {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:25 devstack sudo[89375]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f9e76701-449f-4257-a7f9-3b56b4c13d81 tempest-CreateVolumesFromSnapshotTest-1617940444 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9432c4ff-e522-4b94-a5ac-bb1d01476435" returned: 0 in 0.701s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f9e76701-449f-4257-a7f9-3b56b4c13d81 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9432c4ff-e522-4b94-a5ac-bb1d01476435 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:25 devstack sudo[89383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6b3937ed-fe96-4e1e-9fe3-8cc9b08c750a
Apr 09 12:50:25 devstack sudo[89383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:25 devstack sudo[89384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9432c4ff-e522-4b94-a5ac-bb1d01476435
Apr 09 12:50:25 devstack sudo[89384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:26 devstack sudo[89383]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-173b57e5-990c-42c3-98ee-fc59fc3fc603 tempest-VolumesNegativeTest-1971064052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6b3937ed-fe96-4e1e-9fe3-8cc9b08c750a" returned: 0 in 0.659s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:26 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-173b57e5-990c-42c3-98ee-fc59fc3fc603 tempest-VolumesNegativeTest-1971064052 None] <== create_volume: return (1392ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:50:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-173b57e5-990c-42c3-98ee-fc59fc3fc603 tempest-VolumesNegativeTest-1971064052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.394s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:50:26 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-173b57e5-990c-42c3-98ee-fc59fc3fc603 tempest-VolumesNegativeTest-1971064052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f9d090a-cd78-45fc-8d56-9dc9a6192227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b3937ed-fe96-4e1e-9fe3-8cc9b08c750a', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:26 devstack sudo[89384]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:26 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-173b57e5-990c-42c3-98ee-fc59fc3fc603 tempest-VolumesNegativeTest-1971064052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66ca6219-177f-4c02-a27e-16fa5fe5b6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f9e76701-449f-4257-a7f9-3b56b4c13d81 tempest-CreateVolumesFromSnapshotTest-1617940444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9432c4ff-e522-4b94-a5ac-bb1d01476435" returned: 0 in 0.670s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:26 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-173b57e5-990c-42c3-98ee-fc59fc3fc603 tempest-VolumesNegativeTest-1971064052 None] Volume volume-6b3937ed-fe96-4e1e-9fe3-8cc9b08c750a (6b3937ed-fe96-4e1e-9fe3-8cc9b08c750a): created successfully
Apr 09 12:50:26 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-173b57e5-990c-42c3-98ee-fc59fc3fc603 tempest-VolumesNegativeTest-1971064052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66ca6219-177f-4c02-a27e-16fa5fe5b6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:26 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-173b57e5-990c-42c3-98ee-fc59fc3fc603 tempest-VolumesNegativeTest-1971064052 None] Flow 'volume_create_manager' (eb9e2182-6bb4-4edf-a52a-4755b89b6faf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:50:26 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-173b57e5-990c-42c3-98ee-fc59fc3fc603 tempest-VolumesNegativeTest-1971064052 None] Created volume successfully.
Apr 09 12:50:26 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-f9e76701-449f-4257-a7f9-3b56b4c13d81 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "cinder-quobyte-9432c4ff-e522-4b94-a5ac-bb1d01476435" released by "delete_volume" :: held 1.424s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:50:26 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-f9e76701-449f-4257-a7f9-3b56b4c13d81 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Created reservations ['dfdc4bea-e22b-4545-8fed-397e5494748e', '8bd9f0f9-6239-4b1e-afea-955f8aee7699', 'f107a0ac-eb31-4d43-b06a-5a870bb718b9', 'a40045e1-8d80-4e47-9461-fa688045d7b6'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:50:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f9e76701-449f-4257-a7f9-3b56b4c13d81 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:50:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f9e76701-449f-4257-a7f9-3b56b4c13d81 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:50:26 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f9e76701-449f-4257-a7f9-3b56b4c13d81 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:50:26 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f9e76701-449f-4257-a7f9-3b56b4c13d81 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:50:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f9e76701-449f-4257-a7f9-3b56b4c13d81 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:50:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f9e76701-449f-4257-a7f9-3b56b4c13d81 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:26 devstack sudo[89389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:50:26 devstack sudo[89389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:27 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-9519bcc9-04b6-4f85-8bef-35fb9b977d46 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Acquiring lock "cinder-1114d7fc-408b-4101-a03b-42e52c863814-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:50:27 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-9519bcc9-04b6-4f85-8bef-35fb9b977d46 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "cinder-1114d7fc-408b-4101-a03b-42e52c863814-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:50:27 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-9519bcc9-04b6-4f85-8bef-35fb9b977d46 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Acquiring lock "cinder-quobyte-1114d7fc-408b-4101-a03b-42e52c863814" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:50:27 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-9519bcc9-04b6-4f85-8bef-35fb9b977d46 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "cinder-quobyte-1114d7fc-408b-4101-a03b-42e52c863814" acquired by "delete_volume" :: waited 0.012s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:50:27 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab3c04b-25c0-4c43-9eac-11c62848372d]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:50:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9519bcc9-04b6-4f85-8bef-35fb9b977d46 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1114d7fc-408b-4101-a03b-42e52c863814 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:27 devstack sudo[89389]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f9e76701-449f-4257-a7f9-3b56b4c13d81 tempest-CreateVolumesFromSnapshotTest-1617940444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.697s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:27 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-f9e76701-449f-4257-a7f9-3b56b4c13d81 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:50:27 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-f9e76701-449f-4257-a7f9-3b56b4c13d81 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Deleted volume successfully.
Apr 09 12:50:27 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-f9e76701-449f-4257-a7f9-3b56b4c13d81 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "cinder-9432c4ff-e522-4b94-a5ac-bb1d01476435-delete_volume" released by "delete_volume" :: held 2.454s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:50:27 devstack sudo[89392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1114d7fc-408b-4101-a03b-42e52c863814
Apr 09 12:50:27 devstack sudo[89392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:28 devstack sudo[89392]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:28 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9519bcc9-04b6-4f85-8bef-35fb9b977d46 tempest-CreateVolumesFromSnapshotTest-1617940444 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1114d7fc-408b-4101-a03b-42e52c863814" returned: 0 in 0.715s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:28 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9519bcc9-04b6-4f85-8bef-35fb9b977d46 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1114d7fc-408b-4101-a03b-42e52c863814 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:28 devstack sudo[89400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1114d7fc-408b-4101-a03b-42e52c863814
Apr 09 12:50:28 devstack sudo[89400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:28 devstack sudo[89400]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:28 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9519bcc9-04b6-4f85-8bef-35fb9b977d46 tempest-CreateVolumesFromSnapshotTest-1617940444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1114d7fc-408b-4101-a03b-42e52c863814" returned: 0 in 0.632s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:28 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-9519bcc9-04b6-4f85-8bef-35fb9b977d46 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "cinder-quobyte-1114d7fc-408b-4101-a03b-42e52c863814" released by "delete_volume" :: held 1.387s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:50:28 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-9519bcc9-04b6-4f85-8bef-35fb9b977d46 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Created reservations ['e7e3b7e8-ccaa-4909-a04c-1cd7c835b906', '8740bbc7-ce2c-4206-b949-7d663464e081', '0d0919dd-f59d-43ab-a149-9fef9f9b4679', 'e26d379b-2f55-4413-ac4a-dea359a37b39'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:50:28 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-9519bcc9-04b6-4f85-8bef-35fb9b977d46 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:50:28 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-9519bcc9-04b6-4f85-8bef-35fb9b977d46 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:50:28 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-9519bcc9-04b6-4f85-8bef-35fb9b977d46 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:50:28 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-9519bcc9-04b6-4f85-8bef-35fb9b977d46 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:50:28 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-9519bcc9-04b6-4f85-8bef-35fb9b977d46 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:50:28 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9519bcc9-04b6-4f85-8bef-35fb9b977d46 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:28 devstack sudo[89404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:50:28 devstack sudo[89404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:29 devstack sudo[89404]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:29 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9519bcc9-04b6-4f85-8bef-35fb9b977d46 tempest-CreateVolumesFromSnapshotTest-1617940444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.598s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:29 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-9519bcc9-04b6-4f85-8bef-35fb9b977d46 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:50:29 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-9519bcc9-04b6-4f85-8bef-35fb9b977d46 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Deleted volume successfully.
Apr 09 12:50:29 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-9519bcc9-04b6-4f85-8bef-35fb9b977d46 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "cinder-1114d7fc-408b-4101-a03b-42e52c863814-delete_volume" released by "delete_volume" :: held 2.208s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:50:29 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-db16c6b0-9d26-475c-96de-48c68d6d52d4 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Acquiring lock "cinder-498ed18d-450b-443a-b538-2dc19c7b0366-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:50:29 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-db16c6b0-9d26-475c-96de-48c68d6d52d4 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "cinder-498ed18d-450b-443a-b538-2dc19c7b0366-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:50:29 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-db16c6b0-9d26-475c-96de-48c68d6d52d4 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Acquiring lock "cinder-quobyte-498ed18d-450b-443a-b538-2dc19c7b0366" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:50:29 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-db16c6b0-9d26-475c-96de-48c68d6d52d4 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "cinder-quobyte-498ed18d-450b-443a-b538-2dc19c7b0366" acquired by "delete_volume" :: waited 0.011s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:50:29 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8f1411-fdde-4d9d-872a-f6d10cc8c477]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:50:29 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-db16c6b0-9d26-475c-96de-48c68d6d52d4 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-498ed18d-450b-443a-b538-2dc19c7b0366 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:29 devstack sudo[89407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-498ed18d-450b-443a-b538-2dc19c7b0366
Apr 09 12:50:29 devstack sudo[89407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:30 devstack sudo[89407]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:30 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-db16c6b0-9d26-475c-96de-48c68d6d52d4 tempest-CreateVolumesFromSnapshotTest-1617940444 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-498ed18d-450b-443a-b538-2dc19c7b0366" returned: 0 in 0.712s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:30 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-db16c6b0-9d26-475c-96de-48c68d6d52d4 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-498ed18d-450b-443a-b538-2dc19c7b0366 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:30 devstack sudo[89412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-498ed18d-450b-443a-b538-2dc19c7b0366
Apr 09 12:50:30 devstack sudo[89412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:30 devstack sudo[89412]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:30 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-db16c6b0-9d26-475c-96de-48c68d6d52d4 tempest-CreateVolumesFromSnapshotTest-1617940444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-498ed18d-450b-443a-b538-2dc19c7b0366" returned: 0 in 0.569s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:30 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-db16c6b0-9d26-475c-96de-48c68d6d52d4 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "cinder-quobyte-498ed18d-450b-443a-b538-2dc19c7b0366" released by "delete_volume" :: held 1.316s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:50:30 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-db16c6b0-9d26-475c-96de-48c68d6d52d4 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Created reservations ['e90f3311-2cc9-41cf-9b26-c29d3a51d184', 'd7a51692-0fc4-484d-b529-ca2e4b9f9eaf', '64803c5b-5b0c-4317-868f-4eaedc2f0b75', '0a2f3c40-66d8-46c4-beae-24c2f8951fa5'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:50:30 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-db16c6b0-9d26-475c-96de-48c68d6d52d4 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:50:30 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-db16c6b0-9d26-475c-96de-48c68d6d52d4 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:50:30 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-db16c6b0-9d26-475c-96de-48c68d6d52d4 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:50:30 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-db16c6b0-9d26-475c-96de-48c68d6d52d4 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:50:30 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-db16c6b0-9d26-475c-96de-48c68d6d52d4 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:50:30 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-db16c6b0-9d26-475c-96de-48c68d6d52d4 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:31 devstack sudo[89415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:50:31 devstack sudo[89415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:31 devstack sudo[89415]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:31 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-db16c6b0-9d26-475c-96de-48c68d6d52d4 tempest-CreateVolumesFromSnapshotTest-1617940444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.550s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:31 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-db16c6b0-9d26-475c-96de-48c68d6d52d4 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:50:31 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-db16c6b0-9d26-475c-96de-48c68d6d52d4 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Deleted volume successfully.
Apr 09 12:50:31 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-db16c6b0-9d26-475c-96de-48c68d6d52d4 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "cinder-498ed18d-450b-443a-b538-2dc19c7b0366-delete_volume" released by "delete_volume" :: held 2.076s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:50:31 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-505d6b7a-7831-4637-a6c2-1aa4e359f3c3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Acquiring lock "cinder-5db82b0d-0575-4926-9432-e2ce277eef2c-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:50:31 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-505d6b7a-7831-4637-a6c2-1aa4e359f3c3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "cinder-5db82b0d-0575-4926-9432-e2ce277eef2c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:50:31 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-505d6b7a-7831-4637-a6c2-1aa4e359f3c3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Acquiring lock "cinder-quobyte-5db82b0d-0575-4926-9432-e2ce277eef2c" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:50:31 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-505d6b7a-7831-4637-a6c2-1aa4e359f3c3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "cinder-quobyte-5db82b0d-0575-4926-9432-e2ce277eef2c" acquired by "delete_volume" :: waited 0.013s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:50:31 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b0396b-4a2f-4747-87e3-abdfd218d478]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:50:31 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-505d6b7a-7831-4637-a6c2-1aa4e359f3c3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5db82b0d-0575-4926-9432-e2ce277eef2c {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:31 devstack sudo[89418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5db82b0d-0575-4926-9432-e2ce277eef2c
Apr 09 12:50:31 devstack sudo[89418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:32 devstack sudo[89418]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-505d6b7a-7831-4637-a6c2-1aa4e359f3c3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5db82b0d-0575-4926-9432-e2ce277eef2c" returned: 0 in 0.836s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-505d6b7a-7831-4637-a6c2-1aa4e359f3c3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5db82b0d-0575-4926-9432-e2ce277eef2c {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:32 devstack sudo[89424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5db82b0d-0575-4926-9432-e2ce277eef2c
Apr 09 12:50:32 devstack sudo[89424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:33 devstack sudo[89424]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:33 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-505d6b7a-7831-4637-a6c2-1aa4e359f3c3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5db82b0d-0575-4926-9432-e2ce277eef2c" returned: 0 in 0.778s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:33 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-505d6b7a-7831-4637-a6c2-1aa4e359f3c3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "cinder-quobyte-5db82b0d-0575-4926-9432-e2ce277eef2c" released by "delete_volume" :: held 1.667s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:50:33 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-505d6b7a-7831-4637-a6c2-1aa4e359f3c3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Created reservations ['9f9483dc-df78-4676-b289-293935c7f90e', '45a228b8-3166-468c-aaaa-1bf04573588e', 'cff94287-9b20-41c6-b10e-3bc9fee62527', 'c05a967b-8c8a-405f-9b2d-f198969217d8'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:50:33 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-505d6b7a-7831-4637-a6c2-1aa4e359f3c3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:50:33 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-505d6b7a-7831-4637-a6c2-1aa4e359f3c3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:50:33 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-505d6b7a-7831-4637-a6c2-1aa4e359f3c3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:50:33 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-505d6b7a-7831-4637-a6c2-1aa4e359f3c3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:50:33 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-505d6b7a-7831-4637-a6c2-1aa4e359f3c3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:50:33 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-505d6b7a-7831-4637-a6c2-1aa4e359f3c3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:33 devstack sudo[89427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:50:33 devstack sudo[89427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:34 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-427a6b09-c58b-456b-b07b-a9e69f6664c1 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Acquiring lock "cinder-b065253e-019b-4290-9b63-3e9df2f9ac3d-delete_snapshot" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:50:34 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-427a6b09-c58b-456b-b07b-a9e69f6664c1 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "cinder-b065253e-019b-4290-9b63-3e9df2f9ac3d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:50:34 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-427a6b09-c58b-456b-b07b-a9e69f6664c1 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Acquiring lock "cinder-quobyte-740f30ef-71bd-4830-8174-eb1da462cd0b" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:50:34 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-427a6b09-c58b-456b-b07b-a9e69f6664c1 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "cinder-quobyte-740f30ef-71bd-4830-8174-eb1da462cd0b" acquired by "delete_snapshot" :: waited 0.029s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:50:34 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-427a6b09-c58b-456b-b07b-a9e69f6664c1 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Acquiring lock "cinder-quobyte-b065253e-019b-4290-9b63-3e9df2f9ac3d" by "_delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:50:34 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-427a6b09-c58b-456b-b07b-a9e69f6664c1 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "cinder-quobyte-b065253e-019b-4290-9b63-3e9df2f9ac3d" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:50:34 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-427a6b09-c58b-456b-b07b-a9e69f6664c1 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Deleting offline snapshot b065253e-019b-4290-9b63-3e9df2f9ac3d of volume 740f30ef-71bd-4830-8174-eb1da462cd0b {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 12:50:34 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-427a6b09-c58b-456b-b07b-a9e69f6664c1 tempest-CreateVolumesFromSnapshotTest-1617940444 None] snapshot_file for this snap is: volume-740f30ef-71bd-4830-8174-eb1da462cd0b.b065253e-019b-4290-9b63-3e9df2f9ac3d {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 12:50:34 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c4f2d3-128a-4689-bf8d-87b98717a4c5]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:50:34 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-427a6b09-c58b-456b-b07b-a9e69f6664c1 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-740f30ef-71bd-4830-8174-eb1da462cd0b.b065253e-019b-4290-9b63-3e9df2f9ac3d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:34 devstack sudo[89430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-740f30ef-71bd-4830-8174-eb1da462cd0b.b065253e-019b-4290-9b63-3e9df2f9ac3d
Apr 09 12:50:34 devstack sudo[89430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:34 devstack sudo[89427]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:34 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-505d6b7a-7831-4637-a6c2-1aa4e359f3c3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.758s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:34 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-505d6b7a-7831-4637-a6c2-1aa4e359f3c3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:50:34 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-505d6b7a-7831-4637-a6c2-1aa4e359f3c3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Deleted volume successfully.
Apr 09 12:50:34 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-505d6b7a-7831-4637-a6c2-1aa4e359f3c3 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "cinder-5db82b0d-0575-4926-9432-e2ce277eef2c-delete_volume" released by "delete_volume" :: held 2.681s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:50:35 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-b66a5016-a081-42db-ab7c-605b19f2305c tempest-SnapshotDependencyTests-164748616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:50:35 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b66a5016-a081-42db-ab7c-605b19f2305c tempest-SnapshotDependencyTests-164748616 None] Flow 'volume_create_manager' (31752582-7e74-4b3f-b572-c7d89f2832b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:50:35 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b66a5016-a081-42db-ab7c-605b19f2305c tempest-SnapshotDependencyTests-164748616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa977be9-b374-4d0b-93d0-75ff81758a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:35 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b66a5016-a081-42db-ab7c-605b19f2305c tempest-SnapshotDependencyTests-164748616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa977be9-b374-4d0b-93d0-75ff81758a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-212704804',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68a77030-f36d-4da7-bd73-246040ab1990,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b06e642a1a44d9d9f8dac538d8148af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:50:35Z,use_quota=True,user_id='f2335413df6d47e9977ac67856f83784',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:35 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b66a5016-a081-42db-ab7c-605b19f2305c tempest-SnapshotDependencyTests-164748616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b412ba1-0fc0-4463-bbd7-0a9f8ce3850d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:35 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b66a5016-a081-42db-ab7c-605b19f2305c tempest-SnapshotDependencyTests-164748616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b412ba1-0fc0-4463-bbd7-0a9f8ce3850d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:35 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b66a5016-a081-42db-ab7c-605b19f2305c tempest-SnapshotDependencyTests-164748616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf303fba-cfe1-46c4-846d-0e49f41d57a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:35 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b66a5016-a081-42db-ab7c-605b19f2305c tempest-SnapshotDependencyTests-164748616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf303fba-cfe1-46c4-846d-0e49f41d57a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68a77030-f36d-4da7-bd73-246040ab1990', 'volume_name': 'volume-68a77030-f36d-4da7-bd73-246040ab1990', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:35 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b66a5016-a081-42db-ab7c-605b19f2305c tempest-SnapshotDependencyTests-164748616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdbff621-1353-401f-b42f-a694e10b2fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:35 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b66a5016-a081-42db-ab7c-605b19f2305c tempest-SnapshotDependencyTests-164748616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdbff621-1353-401f-b42f-a694e10b2fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:35 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b66a5016-a081-42db-ab7c-605b19f2305c tempest-SnapshotDependencyTests-164748616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbc65162-3dbb-4d07-ba9e-5bd502c787ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:35 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-b66a5016-a081-42db-ab7c-605b19f2305c tempest-SnapshotDependencyTests-164748616 None] Volume 68a77030-f36d-4da7-bd73-246040ab1990: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68a77030-f36d-4da7-bd73-246040ab1990', 'volume_size': 1}
Apr 09 12:50:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b66a5016-a081-42db-ab7c-605b19f2305c tempest-SnapshotDependencyTests-164748616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:50:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b66a5016-a081-42db-ab7c-605b19f2305c tempest-SnapshotDependencyTests-164748616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:50:35 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-b66a5016-a081-42db-ab7c-605b19f2305c tempest-SnapshotDependencyTests-164748616 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-212704804',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68a77030-f36d-4da7-bd73-246040ab1990,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b06e642a1a44d9d9f8dac538d8148af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:50:35Z,use_quota=True,user_id='f2335413df6d47e9977ac67856f83784',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:50:35 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-b66a5016-a081-42db-ab7c-605b19f2305c tempest-SnapshotDependencyTests-164748616 None] Creating volume 68a77030-f36d-4da7-bd73-246040ab1990 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:50:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b66a5016-a081-42db-ab7c-605b19f2305c tempest-SnapshotDependencyTests-164748616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:50:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b66a5016-a081-42db-ab7c-605b19f2305c tempest-SnapshotDependencyTests-164748616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:50:35 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-b66a5016-a081-42db-ab7c-605b19f2305c tempest-SnapshotDependencyTests-164748616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:50:35 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-b66a5016-a081-42db-ab7c-605b19f2305c tempest-SnapshotDependencyTests-164748616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:50:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b66a5016-a081-42db-ab7c-605b19f2305c tempest-SnapshotDependencyTests-164748616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:50:35 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-b66a5016-a081-42db-ab7c-605b19f2305c tempest-SnapshotDependencyTests-164748616 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:50:35 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-b66a5016-a081-42db-ab7c-605b19f2305c tempest-SnapshotDependencyTests-164748616 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:50:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b66a5016-a081-42db-ab7c-605b19f2305c tempest-SnapshotDependencyTests-164748616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:35 devstack sudo[89450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990 1073741824
Apr 09 12:50:35 devstack sudo[89450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:35 devstack sudo[89430]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-427a6b09-c58b-456b-b07b-a9e69f6664c1 tempest-CreateVolumesFromSnapshotTest-1617940444 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-740f30ef-71bd-4830-8174-eb1da462cd0b.b065253e-019b-4290-9b63-3e9df2f9ac3d" returned: 0 in 1.061s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:35 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-427a6b09-c58b-456b-b07b-a9e69f6664c1 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-740f30ef-71bd-4830-8174-eb1da462cd0b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:50:35 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[292e6a9c-4cdf-47ad-9354-2dac12416a57]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:50:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-427a6b09-c58b-456b-b07b-a9e69f6664c1 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-740f30ef-71bd-4830-8174-eb1da462cd0b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:35 devstack sudo[89452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-740f30ef-71bd-4830-8174-eb1da462cd0b
Apr 09 12:50:35 devstack sudo[89452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:36 devstack sudo[89452]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:36 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-427a6b09-c58b-456b-b07b-a9e69f6664c1 tempest-CreateVolumesFromSnapshotTest-1617940444 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-740f30ef-71bd-4830-8174-eb1da462cd0b" returned: 0 in 0.697s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:36 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-427a6b09-c58b-456b-b07b-a9e69f6664c1 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-740f30ef-71bd-4830-8174-eb1da462cd0b.b065253e-019b-4290-9b63-3e9df2f9ac3d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:36 devstack sudo[89460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-740f30ef-71bd-4830-8174-eb1da462cd0b.b065253e-019b-4290-9b63-3e9df2f9ac3d
Apr 09 12:50:36 devstack sudo[89460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:36 devstack sudo[89450]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:36 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b66a5016-a081-42db-ab7c-605b19f2305c tempest-SnapshotDependencyTests-164748616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990 1073741824" returned: 0 in 1.174s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:36 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b66a5016-a081-42db-ab7c-605b19f2305c tempest-SnapshotDependencyTests-164748616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:36 devstack sudo[89462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990
Apr 09 12:50:36 devstack sudo[89462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:36 devstack sudo[89460]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:36 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-427a6b09-c58b-456b-b07b-a9e69f6664c1 tempest-CreateVolumesFromSnapshotTest-1617940444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-740f30ef-71bd-4830-8174-eb1da462cd0b.b065253e-019b-4290-9b63-3e9df2f9ac3d" returned: 0 in 0.803s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:36 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-427a6b09-c58b-456b-b07b-a9e69f6664c1 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-740f30ef-71bd-4830-8174-eb1da462cd0b.b065253e-019b-4290-9b63-3e9df2f9ac3d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:36 devstack sudo[89467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-740f30ef-71bd-4830-8174-eb1da462cd0b.b065253e-019b-4290-9b63-3e9df2f9ac3d
Apr 09 12:50:36 devstack sudo[89467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:37 devstack sudo[89462]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:37 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b66a5016-a081-42db-ab7c-605b19f2305c tempest-SnapshotDependencyTests-164748616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990" returned: 0 in 0.765s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:37 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-b66a5016-a081-42db-ab7c-605b19f2305c tempest-SnapshotDependencyTests-164748616 None] <== create_volume: return (2023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:50:37 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b66a5016-a081-42db-ab7c-605b19f2305c tempest-SnapshotDependencyTests-164748616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.026s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:50:37 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b66a5016-a081-42db-ab7c-605b19f2305c tempest-SnapshotDependencyTests-164748616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbc65162-3dbb-4d07-ba9e-5bd502c787ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68a77030-f36d-4da7-bd73-246040ab1990', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:37 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b66a5016-a081-42db-ab7c-605b19f2305c tempest-SnapshotDependencyTests-164748616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc103ff2-a149-425b-b86b-38f4a7cf4a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:37 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-b66a5016-a081-42db-ab7c-605b19f2305c tempest-SnapshotDependencyTests-164748616 None] Volume volume-68a77030-f36d-4da7-bd73-246040ab1990 (68a77030-f36d-4da7-bd73-246040ab1990): created successfully
Apr 09 12:50:37 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b66a5016-a081-42db-ab7c-605b19f2305c tempest-SnapshotDependencyTests-164748616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc103ff2-a149-425b-b86b-38f4a7cf4a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:37 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b66a5016-a081-42db-ab7c-605b19f2305c tempest-SnapshotDependencyTests-164748616 None] Flow 'volume_create_manager' (31752582-7e74-4b3f-b572-c7d89f2832b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:50:37 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-b66a5016-a081-42db-ab7c-605b19f2305c tempest-SnapshotDependencyTests-164748616 None] Created volume successfully.
Apr 09 12:50:37 devstack sudo[89467]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:37 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-427a6b09-c58b-456b-b07b-a9e69f6664c1 tempest-CreateVolumesFromSnapshotTest-1617940444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-740f30ef-71bd-4830-8174-eb1da462cd0b.b065253e-019b-4290-9b63-3e9df2f9ac3d" returned: 0 in 0.563s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:37 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-427a6b09-c58b-456b-b07b-a9e69f6664c1 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "cinder-quobyte-b065253e-019b-4290-9b63-3e9df2f9ac3d" released by "_delete_snapshot" :: held 3.258s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:50:37 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-427a6b09-c58b-456b-b07b-a9e69f6664c1 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "cinder-quobyte-740f30ef-71bd-4830-8174-eb1da462cd0b" released by "delete_snapshot" :: held 3.283s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:50:37 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-427a6b09-c58b-456b-b07b-a9e69f6664c1 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Created reservations ['634d5e74-ae39-419f-84eb-1ca48d34088b', '0c6fca5d-8518-40b6-a83c-8c065ea13d96', '070c7362-7c43-4e80-87a9-2613a7edf300', 'f0c88c96-83f8-4557-a0e9-64b9087d1233'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:50:37 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-427a6b09-c58b-456b-b07b-a9e69f6664c1 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Delete snapshot completed successfully.
Apr 09 12:50:37 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-427a6b09-c58b-456b-b07b-a9e69f6664c1 tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "cinder-b065253e-019b-4290-9b63-3e9df2f9ac3d-delete_snapshot" released by "delete_snapshot" :: held 3.447s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:50:38 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-49bb6e0a-152c-43f2-bdb9-74963e18ea0c tempest-CreateVolumesFromSnapshotTest-1617940444 None] Acquiring lock "cinder-740f30ef-71bd-4830-8174-eb1da462cd0b-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:50:38 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-49bb6e0a-152c-43f2-bdb9-74963e18ea0c tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "cinder-740f30ef-71bd-4830-8174-eb1da462cd0b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:50:38 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-49bb6e0a-152c-43f2-bdb9-74963e18ea0c tempest-CreateVolumesFromSnapshotTest-1617940444 None] Acquiring lock "cinder-quobyte-740f30ef-71bd-4830-8174-eb1da462cd0b" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:50:38 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-49bb6e0a-152c-43f2-bdb9-74963e18ea0c tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "cinder-quobyte-740f30ef-71bd-4830-8174-eb1da462cd0b" acquired by "delete_volume" :: waited 0.011s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:50:38 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0d130e-ca73-4698-a1f6-61460980586e]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:50:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-49bb6e0a-152c-43f2-bdb9-74963e18ea0c tempest-CreateVolumesFromSnapshotTest-1617940444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-740f30ef-71bd-4830-8174-eb1da462cd0b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-2cf4380b-1192-4091-9d79-13e739043b66 tempest-SnapshotDependencyTests-164748616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:50:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-2cf4380b-1192-4091-9d79-13e739043b66 tempest-SnapshotDependencyTests-164748616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:50:38 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-2cf4380b-1192-4091-9d79-13e739043b66 tempest-SnapshotDependencyTests-164748616 None] Creating offline snapshot eb71ffe4-eb0c-49f2-a89e-b777ee858f0e of volume 68a77030-f36d-4da7-bd73-246040ab1990 {{(pid=82760) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 12:50:38 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb6fc14-0861-41e1-86ab-3b60a959e16b]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:50:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2cf4380b-1192-4091-9d79-13e739043b66 tempest-SnapshotDependencyTests-164748616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:38 devstack sudo[89472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-740f30ef-71bd-4830-8174-eb1da462cd0b
Apr 09 12:50:38 devstack sudo[89472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:38 devstack sudo[89473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990
Apr 09 12:50:38 devstack sudo[89473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:38 devstack sudo[89472]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-49bb6e0a-152c-43f2-bdb9-74963e18ea0c tempest-CreateVolumesFromSnapshotTest-1617940444 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-740f30ef-71bd-4830-8174-eb1da462cd0b" returned: 0 in 0.563s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-49bb6e0a-152c-43f2-bdb9-74963e18ea0c tempest-CreateVolumesFromSnapshotTest-1617940444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-740f30ef-71bd-4830-8174-eb1da462cd0b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:39 devstack sudo[89479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-740f30ef-71bd-4830-8174-eb1da462cd0b
Apr 09 12:50:39 devstack sudo[89479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:39 devstack sudo[89473]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2cf4380b-1192-4091-9d79-13e739043b66 tempest-SnapshotDependencyTests-164748616 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990" returned: 0 in 0.630s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2cf4380b-1192-4091-9d79-13e739043b66 tempest-SnapshotDependencyTests-164748616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990.eb71ffe4-eb0c-49f2-a89e-b777ee858f0e 1G {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:39 devstack sudo[89484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990.eb71ffe4-eb0c-49f2-a89e-b777ee858f0e 1G
Apr 09 12:50:39 devstack sudo[89484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:39 devstack sudo[89479]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-49bb6e0a-152c-43f2-bdb9-74963e18ea0c tempest-CreateVolumesFromSnapshotTest-1617940444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-740f30ef-71bd-4830-8174-eb1da462cd0b" returned: 0 in 0.547s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:39 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-49bb6e0a-152c-43f2-bdb9-74963e18ea0c tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "cinder-quobyte-740f30ef-71bd-4830-8174-eb1da462cd0b" released by "delete_volume" :: held 1.189s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:50:39 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-49bb6e0a-152c-43f2-bdb9-74963e18ea0c tempest-CreateVolumesFromSnapshotTest-1617940444 None] Created reservations ['fb041f87-7799-4af8-915c-ceafef6366f1', '1d2bac20-a28b-4af0-a966-22133b70b7a0', '8ccc91c6-31f8-41d4-a342-5f02dd6d3fbc', 'eadd2fc0-93cd-484f-95f7-c83b2d69b92a'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:50:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-49bb6e0a-152c-43f2-bdb9-74963e18ea0c tempest-CreateVolumesFromSnapshotTest-1617940444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:50:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-49bb6e0a-152c-43f2-bdb9-74963e18ea0c tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:50:39 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-49bb6e0a-152c-43f2-bdb9-74963e18ea0c tempest-CreateVolumesFromSnapshotTest-1617940444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:50:39 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-49bb6e0a-152c-43f2-bdb9-74963e18ea0c tempest-CreateVolumesFromSnapshotTest-1617940444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:50:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-49bb6e0a-152c-43f2-bdb9-74963e18ea0c tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:50:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-49bb6e0a-152c-43f2-bdb9-74963e18ea0c tempest-CreateVolumesFromSnapshotTest-1617940444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:39 devstack sudo[89490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:50:39 devstack sudo[89490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:39 devstack sudo[89484]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2cf4380b-1192-4091-9d79-13e739043b66 tempest-SnapshotDependencyTests-164748616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990.eb71ffe4-eb0c-49f2-a89e-b777ee858f0e 1G" returned: 0 in 0.741s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2cf4380b-1192-4091-9d79-13e739043b66 tempest-SnapshotDependencyTests-164748616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68a77030-f36d-4da7-bd73-246040ab1990 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990.eb71ffe4-eb0c-49f2-a89e-b777ee858f0e {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:39 devstack sudo[89492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68a77030-f36d-4da7-bd73-246040ab1990 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990.eb71ffe4-eb0c-49f2-a89e-b777ee858f0e
Apr 09 12:50:39 devstack sudo[89492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:40 devstack sudo[89490]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:40 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-49bb6e0a-152c-43f2-bdb9-74963e18ea0c tempest-CreateVolumesFromSnapshotTest-1617940444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.516s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:40 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-49bb6e0a-152c-43f2-bdb9-74963e18ea0c tempest-CreateVolumesFromSnapshotTest-1617940444 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:50:40 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-49bb6e0a-152c-43f2-bdb9-74963e18ea0c tempest-CreateVolumesFromSnapshotTest-1617940444 None] Deleted volume successfully.
Apr 09 12:50:40 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-49bb6e0a-152c-43f2-bdb9-74963e18ea0c tempest-CreateVolumesFromSnapshotTest-1617940444 None] Lock "cinder-740f30ef-71bd-4830-8174-eb1da462cd0b-delete_volume" released by "delete_volume" :: held 1.952s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:50:40 devstack sudo[89492]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:40 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2cf4380b-1192-4091-9d79-13e739043b66 tempest-SnapshotDependencyTests-164748616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68a77030-f36d-4da7-bd73-246040ab1990 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990.eb71ffe4-eb0c-49f2-a89e-b777ee858f0e" returned: 0 in 0.639s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:40 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-2cf4380b-1192-4091-9d79-13e739043b66 tempest-SnapshotDependencyTests-164748616 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990.eb71ffe4-eb0c-49f2-a89e-b777ee858f0e is being set with open permissions: ugo+rw
Apr 09 12:50:40 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2cf4380b-1192-4091-9d79-13e739043b66 tempest-SnapshotDependencyTests-164748616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990.eb71ffe4-eb0c-49f2-a89e-b777ee858f0e {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:40 devstack sudo[89506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990.eb71ffe4-eb0c-49f2-a89e-b777ee858f0e
Apr 09 12:50:40 devstack sudo[89506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:41 devstack sudo[89506]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:41 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2cf4380b-1192-4091-9d79-13e739043b66 tempest-SnapshotDependencyTests-164748616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990.eb71ffe4-eb0c-49f2-a89e-b777ee858f0e" returned: 0 in 0.469s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:41 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2cf4380b-1192-4091-9d79-13e739043b66 tempest-SnapshotDependencyTests-164748616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:41 devstack sudo[89538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990.info
Apr 09 12:50:41 devstack sudo[89538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:41 devstack sudo[89538]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:41 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2cf4380b-1192-4091-9d79-13e739043b66 tempest-SnapshotDependencyTests-164748616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990.info" returned: 0 in 0.648s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:41 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-2cf4380b-1192-4091-9d79-13e739043b66 tempest-SnapshotDependencyTests-164748616 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990.info is being set with open permissions: ugo+rw
Apr 09 12:50:41 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2cf4380b-1192-4091-9d79-13e739043b66 tempest-SnapshotDependencyTests-164748616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:41 devstack sudo[89542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990.info
Apr 09 12:50:41 devstack sudo[89542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:42 devstack sudo[89542]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:42 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2cf4380b-1192-4091-9d79-13e739043b66 tempest-SnapshotDependencyTests-164748616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990.info" returned: 0 in 0.639s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:42 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-2cf4380b-1192-4091-9d79-13e739043b66 tempest-SnapshotDependencyTests-164748616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.867s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:50:42 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-2cf4380b-1192-4091-9d79-13e739043b66 tempest-SnapshotDependencyTests-164748616 None] Create snapshot completed successfully
Apr 09 12:50:43 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-387fb6d7-cc9b-4325-8539-67c18ecd2859 tempest-CinderUnicodeTest-1872821075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:50:43 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-387fb6d7-cc9b-4325-8539-67c18ecd2859 tempest-CinderUnicodeTest-1872821075 None] Flow 'volume_create_manager' (1ccdc360-ad25-4a7b-b8fd-3c8b25097e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:50:43 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-387fb6d7-cc9b-4325-8539-67c18ecd2859 tempest-CinderUnicodeTest-1872821075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55c0075c-455f-40dc-bc09-e91b23e80e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:43 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-387fb6d7-cc9b-4325-8539-67c18ecd2859 tempest-CinderUnicodeTest-1872821075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55c0075c-455f-40dc-bc09-e91b23e80e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:50:43Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=425c3a38-6c53-48ee-b391-4b87236ddd95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b18d1f46b1dc443c844033cdf21b9f20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:50:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:50:44Z,use_quota=True,user_id='fce3d3f1355447dbbd1095164e01e4c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:43 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-387fb6d7-cc9b-4325-8539-67c18ecd2859 tempest-CinderUnicodeTest-1872821075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbe34090-be27-42d4-9966-9ac530379ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:43 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-387fb6d7-cc9b-4325-8539-67c18ecd2859 tempest-CinderUnicodeTest-1872821075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbe34090-be27-42d4-9966-9ac530379ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:43 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-387fb6d7-cc9b-4325-8539-67c18ecd2859 tempest-CinderUnicodeTest-1872821075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (385825a5-57fd-4a91-9162-45b40671f783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:43 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-387fb6d7-cc9b-4325-8539-67c18ecd2859 tempest-CinderUnicodeTest-1872821075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (385825a5-57fd-4a91-9162-45b40671f783) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '425c3a38-6c53-48ee-b391-4b87236ddd95', 'volume_name': 'volume-425c3a38-6c53-48ee-b391-4b87236ddd95', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:43 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-387fb6d7-cc9b-4325-8539-67c18ecd2859 tempest-CinderUnicodeTest-1872821075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bebe3fb-6a42-4ba0-ba0c-021965a8e2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:43 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-387fb6d7-cc9b-4325-8539-67c18ecd2859 tempest-CinderUnicodeTest-1872821075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bebe3fb-6a42-4ba0-ba0c-021965a8e2ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:43 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-387fb6d7-cc9b-4325-8539-67c18ecd2859 tempest-CinderUnicodeTest-1872821075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dde6604e-2118-4a55-a8ca-17edbdf4af57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:43 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-387fb6d7-cc9b-4325-8539-67c18ecd2859 tempest-CinderUnicodeTest-1872821075 None] Volume 425c3a38-6c53-48ee-b391-4b87236ddd95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-425c3a38-6c53-48ee-b391-4b87236ddd95', 'volume_size': 1}
Apr 09 12:50:43 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-387fb6d7-cc9b-4325-8539-67c18ecd2859 tempest-CinderUnicodeTest-1872821075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:50:43 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-387fb6d7-cc9b-4325-8539-67c18ecd2859 tempest-CinderUnicodeTest-1872821075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:50:43 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-387fb6d7-cc9b-4325-8539-67c18ecd2859 tempest-CinderUnicodeTest-1872821075 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:50:43Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=425c3a38-6c53-48ee-b391-4b87236ddd95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b18d1f46b1dc443c844033cdf21b9f20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:50:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:50:44Z,use_quota=True,user_id='fce3d3f1355447dbbd1095164e01e4c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:50:43 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-387fb6d7-cc9b-4325-8539-67c18ecd2859 tempest-CinderUnicodeTest-1872821075 None] Creating volume 425c3a38-6c53-48ee-b391-4b87236ddd95 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:50:43 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-387fb6d7-cc9b-4325-8539-67c18ecd2859 tempest-CinderUnicodeTest-1872821075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:50:43 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-387fb6d7-cc9b-4325-8539-67c18ecd2859 tempest-CinderUnicodeTest-1872821075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:50:43 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-387fb6d7-cc9b-4325-8539-67c18ecd2859 tempest-CinderUnicodeTest-1872821075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:50:43 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-387fb6d7-cc9b-4325-8539-67c18ecd2859 tempest-CinderUnicodeTest-1872821075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:50:43 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-387fb6d7-cc9b-4325-8539-67c18ecd2859 tempest-CinderUnicodeTest-1872821075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:50:43 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-387fb6d7-cc9b-4325-8539-67c18ecd2859 tempest-CinderUnicodeTest-1872821075 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:50:43 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-387fb6d7-cc9b-4325-8539-67c18ecd2859 tempest-CinderUnicodeTest-1872821075 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:50:43 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-387fb6d7-cc9b-4325-8539-67c18ecd2859 tempest-CinderUnicodeTest-1872821075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-425c3a38-6c53-48ee-b391-4b87236ddd95 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:43 devstack sudo[89573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-425c3a38-6c53-48ee-b391-4b87236ddd95 1073741824
Apr 09 12:50:43 devstack sudo[89573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:43 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-b95fddc9-1bd5-4ecd-aeff-11c542965532 tempest-SnapshotDependencyTests-164748616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:50:43 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b95fddc9-1bd5-4ecd-aeff-11c542965532 tempest-SnapshotDependencyTests-164748616 None] Flow 'volume_create_manager' (4e520d89-bc84-46a4-8a6d-9955d991166f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:50:43 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b95fddc9-1bd5-4ecd-aeff-11c542965532 tempest-SnapshotDependencyTests-164748616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c42098f-34a7-4edf-a7ed-fadec05e93de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:43 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b95fddc9-1bd5-4ecd-aeff-11c542965532 tempest-SnapshotDependencyTests-164748616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c42098f-34a7-4edf-a7ed-fadec05e93de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:50:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7da31a98-0c78-4036-b1ce-ebbb4f330084,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b06e642a1a44d9d9f8dac538d8148af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:50:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=eb71ffe4-eb0c-49f2-a89e-b777ee858f0e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:50:44Z,use_quota=True,user_id='f2335413df6d47e9977ac67856f83784',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:43 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b95fddc9-1bd5-4ecd-aeff-11c542965532 tempest-SnapshotDependencyTests-164748616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f2cb97-f544-4490-a81b-ebee1a260395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:43 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b95fddc9-1bd5-4ecd-aeff-11c542965532 tempest-SnapshotDependencyTests-164748616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f2cb97-f544-4490-a81b-ebee1a260395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:43 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b95fddc9-1bd5-4ecd-aeff-11c542965532 tempest-SnapshotDependencyTests-164748616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa6bb4da-61b3-4f64-977e-1229426d08c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:43 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b95fddc9-1bd5-4ecd-aeff-11c542965532 tempest-SnapshotDependencyTests-164748616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa6bb4da-61b3-4f64-977e-1229426d08c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7da31a98-0c78-4036-b1ce-ebbb4f330084', 'volume_name': 'volume-7da31a98-0c78-4036-b1ce-ebbb4f330084', 'volume_size': 1, 'snapshot_id': 'eb71ffe4-eb0c-49f2-a89e-b777ee858f0e'}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:43 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b95fddc9-1bd5-4ecd-aeff-11c542965532 tempest-SnapshotDependencyTests-164748616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cd10e34-f991-44bb-b295-c4612e39b627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:43 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b95fddc9-1bd5-4ecd-aeff-11c542965532 tempest-SnapshotDependencyTests-164748616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cd10e34-f991-44bb-b295-c4612e39b627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:43 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b95fddc9-1bd5-4ecd-aeff-11c542965532 tempest-SnapshotDependencyTests-164748616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8fe235b-c47f-4476-b5b5-be41b225508e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:43 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-b95fddc9-1bd5-4ecd-aeff-11c542965532 tempest-SnapshotDependencyTests-164748616 None] Volume 7da31a98-0c78-4036-b1ce-ebbb4f330084: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7da31a98-0c78-4036-b1ce-ebbb4f330084', 'volume_size': 1, 'snapshot_id': 'eb71ffe4-eb0c-49f2-a89e-b777ee858f0e'}
Apr 09 12:50:43 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b95fddc9-1bd5-4ecd-aeff-11c542965532 tempest-SnapshotDependencyTests-164748616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:50:44 devstack sudo[89573]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:44 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-387fb6d7-cc9b-4325-8539-67c18ecd2859 tempest-CinderUnicodeTest-1872821075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-425c3a38-6c53-48ee-b391-4b87236ddd95 1073741824" returned: 0 in 0.702s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:44 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-387fb6d7-cc9b-4325-8539-67c18ecd2859 tempest-CinderUnicodeTest-1872821075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-425c3a38-6c53-48ee-b391-4b87236ddd95 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:44 devstack sudo[89579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-425c3a38-6c53-48ee-b391-4b87236ddd95
Apr 09 12:50:44 devstack sudo[89579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:45 devstack sudo[89579]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:45 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-387fb6d7-cc9b-4325-8539-67c18ecd2859 tempest-CinderUnicodeTest-1872821075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-425c3a38-6c53-48ee-b391-4b87236ddd95" returned: 0 in 0.545s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:45 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-387fb6d7-cc9b-4325-8539-67c18ecd2859 tempest-CinderUnicodeTest-1872821075 None] <== create_volume: return (1279ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:50:45 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-387fb6d7-cc9b-4325-8539-67c18ecd2859 tempest-CinderUnicodeTest-1872821075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.283s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:50:45 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b95fddc9-1bd5-4ecd-aeff-11c542965532 tempest-SnapshotDependencyTests-164748616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.112s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:50:45 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-b95fddc9-1bd5-4ecd-aeff-11c542965532 tempest-SnapshotDependencyTests-164748616 None] Acquiring lock "cinder-quobyte-eb71ffe4-eb0c-49f2-a89e-b777ee858f0e-7da31a98-0c78-4036-b1ce-ebbb4f330084" by "_create_volume_from_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:50:45 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-387fb6d7-cc9b-4325-8539-67c18ecd2859 tempest-CinderUnicodeTest-1872821075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dde6604e-2118-4a55-a8ca-17edbdf4af57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-425c3a38-6c53-48ee-b391-4b87236ddd95', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:45 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-387fb6d7-cc9b-4325-8539-67c18ecd2859 tempest-CinderUnicodeTest-1872821075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7ef67b5-8304-4be0-9069-d14e47e7e64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:45 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-387fb6d7-cc9b-4325-8539-67c18ecd2859 tempest-CinderUnicodeTest-1872821075 None] Volume volume-425c3a38-6c53-48ee-b391-4b87236ddd95 (425c3a38-6c53-48ee-b391-4b87236ddd95): created successfully
Apr 09 12:50:45 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-387fb6d7-cc9b-4325-8539-67c18ecd2859 tempest-CinderUnicodeTest-1872821075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7ef67b5-8304-4be0-9069-d14e47e7e64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:45 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-387fb6d7-cc9b-4325-8539-67c18ecd2859 tempest-CinderUnicodeTest-1872821075 None] Flow 'volume_create_manager' (1ccdc360-ad25-4a7b-b8fd-3c8b25097e45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:50:45 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-b95fddc9-1bd5-4ecd-aeff-11c542965532 tempest-SnapshotDependencyTests-164748616 None] Lock "cinder-quobyte-eb71ffe4-eb0c-49f2-a89e-b777ee858f0e-7da31a98-0c78-4036-b1ce-ebbb4f330084" acquired by "_create_volume_from_snapshot" :: waited 0.050s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:50:45 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-b95fddc9-1bd5-4ecd-aeff-11c542965532 tempest-SnapshotDependencyTests-164748616 None] Creating volume 7da31a98-0c78-4036-b1ce-ebbb4f330084 from snapshot eb71ffe4-eb0c-49f2-a89e-b777ee858f0e {{(pid=82760) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 09 12:50:45 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b95fddc9-1bd5-4ecd-aeff-11c542965532 tempest-SnapshotDependencyTests-164748616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:50:45 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b95fddc9-1bd5-4ecd-aeff-11c542965532 tempest-SnapshotDependencyTests-164748616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:50:45 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-b95fddc9-1bd5-4ecd-aeff-11c542965532 tempest-SnapshotDependencyTests-164748616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:50:45 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-b95fddc9-1bd5-4ecd-aeff-11c542965532 tempest-SnapshotDependencyTests-164748616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:50:45 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b95fddc9-1bd5-4ecd-aeff-11c542965532 tempest-SnapshotDependencyTests-164748616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:50:45 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-b95fddc9-1bd5-4ecd-aeff-11c542965532 tempest-SnapshotDependencyTests-164748616 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:50:45 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-b95fddc9-1bd5-4ecd-aeff-11c542965532 tempest-SnapshotDependencyTests-164748616 None] Acquiring lock "cinder-quobyte-7da31a98-0c78-4036-b1ce-ebbb4f330084" by "_copy_volume_from_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:50:45 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-387fb6d7-cc9b-4325-8539-67c18ecd2859 tempest-CinderUnicodeTest-1872821075 None] Created volume successfully.
Apr 09 12:50:45 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-b95fddc9-1bd5-4ecd-aeff-11c542965532 tempest-SnapshotDependencyTests-164748616 None] Lock "cinder-quobyte-7da31a98-0c78-4036-b1ce-ebbb4f330084" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:50:45 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-b95fddc9-1bd5-4ecd-aeff-11c542965532 tempest-SnapshotDependencyTests-164748616 None] snapshot: eb71ffe4-eb0c-49f2-a89e-b777ee858f0e, volume: 7da31a98-0c78-4036-b1ce-ebbb4f330084,  {{(pid=82760) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 09 12:50:45 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b95fddc9-1bd5-4ecd-aeff-11c542965532 tempest-SnapshotDependencyTests-164748616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:50:45 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b95fddc9-1bd5-4ecd-aeff-11c542965532 tempest-SnapshotDependencyTests-164748616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:50:45 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-b95fddc9-1bd5-4ecd-aeff-11c542965532 tempest-SnapshotDependencyTests-164748616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:50:45 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-b95fddc9-1bd5-4ecd-aeff-11c542965532 tempest-SnapshotDependencyTests-164748616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:50:45 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b95fddc9-1bd5-4ecd-aeff-11c542965532 tempest-SnapshotDependencyTests-164748616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:50:45 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ec3d91-a8fe-4ae2-be6b-60dbf2ee8966]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:50:45 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b95fddc9-1bd5-4ecd-aeff-11c542965532 tempest-SnapshotDependencyTests-164748616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990.eb71ffe4-eb0c-49f2-a89e-b777ee858f0e {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:45 devstack sudo[89583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990.eb71ffe4-eb0c-49f2-a89e-b777ee858f0e
Apr 09 12:50:45 devstack sudo[89583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:45 devstack sudo[89583]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:45 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b95fddc9-1bd5-4ecd-aeff-11c542965532 tempest-SnapshotDependencyTests-164748616 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990.eb71ffe4-eb0c-49f2-a89e-b777ee858f0e" returned: 0 in 0.587s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:45 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-b95fddc9-1bd5-4ecd-aeff-11c542965532 tempest-SnapshotDependencyTests-164748616 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68a77030-f36d-4da7-bd73-246040ab1990(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:50:45 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-b95fddc9-1bd5-4ecd-aeff-11c542965532 tempest-SnapshotDependencyTests-164748616 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990 {{(pid=82760) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 09 12:50:45 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-b95fddc9-1bd5-4ecd-aeff-11c542965532 tempest-SnapshotDependencyTests-164748616 None] Creating direct copy from snapshot {{(pid=82760) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 09 12:50:45 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[258e70f2-f920-4c0f-b694-1a1547d5929a]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:50:45 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b95fddc9-1bd5-4ecd-aeff-11c542965532 tempest-SnapshotDependencyTests-164748616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:45 devstack sudo[89588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990
Apr 09 12:50:45 devstack sudo[89588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:46 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb8be15d-209a-46d4-801c-bd828d33e142 tempest-CinderUnicodeTest-1872821075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:50:46 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-fb8be15d-209a-46d4-801c-bd828d33e142 tempest-CinderUnicodeTest-1872821075 None] Flow 'volume_create_manager' (0445c9a2-ec78-4c2b-9e95-3b352d7b9813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:50:46 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-fb8be15d-209a-46d4-801c-bd828d33e142 tempest-CinderUnicodeTest-1872821075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b26730aa-d979-4888-8456-9be9b3819527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:46 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-fb8be15d-209a-46d4-801c-bd828d33e142 tempest-CinderUnicodeTest-1872821075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b26730aa-d979-4888-8456-9be9b3819527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:50:46Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1608283922',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc839233-7461-46f5-803c-a7b11fd368f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b18d1f46b1dc443c844033cdf21b9f20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:50:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:50:46Z,use_quota=True,user_id='fce3d3f1355447dbbd1095164e01e4c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:46 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-fb8be15d-209a-46d4-801c-bd828d33e142 tempest-CinderUnicodeTest-1872821075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ec373eb-527a-495e-9293-afe17df68fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:46 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-fb8be15d-209a-46d4-801c-bd828d33e142 tempest-CinderUnicodeTest-1872821075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ec373eb-527a-495e-9293-afe17df68fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:46 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-fb8be15d-209a-46d4-801c-bd828d33e142 tempest-CinderUnicodeTest-1872821075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78830f9b-58ac-4577-b95e-4d8f79ab51f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:46 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-fb8be15d-209a-46d4-801c-bd828d33e142 tempest-CinderUnicodeTest-1872821075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78830f9b-58ac-4577-b95e-4d8f79ab51f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc839233-7461-46f5-803c-a7b11fd368f7', 'volume_name': 'volume-dc839233-7461-46f5-803c-a7b11fd368f7', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:46 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-fb8be15d-209a-46d4-801c-bd828d33e142 tempest-CinderUnicodeTest-1872821075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b85f3cd2-cc6e-46ac-a3ad-c802307e25a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:46 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-fb8be15d-209a-46d4-801c-bd828d33e142 tempest-CinderUnicodeTest-1872821075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b85f3cd2-cc6e-46ac-a3ad-c802307e25a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:46 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-fb8be15d-209a-46d4-801c-bd828d33e142 tempest-CinderUnicodeTest-1872821075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (707d9f61-e991-4188-8238-8ebf6d1ee381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:46 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-fb8be15d-209a-46d4-801c-bd828d33e142 tempest-CinderUnicodeTest-1872821075 None] Volume dc839233-7461-46f5-803c-a7b11fd368f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc839233-7461-46f5-803c-a7b11fd368f7', 'volume_size': 1}
Apr 09 12:50:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-fb8be15d-209a-46d4-801c-bd828d33e142 tempest-CinderUnicodeTest-1872821075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:50:46 devstack sudo[89588]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b95fddc9-1bd5-4ecd-aeff-11c542965532 tempest-SnapshotDependencyTests-164748616 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990" returned: 0 in 0.762s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:46 devstack cinder-volume[82760]: DEBUG cinder.utils [None req-b95fddc9-1bd5-4ecd-aeff-11c542965532 tempest-SnapshotDependencyTests-164748616 None] Path /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7da31a98-0c78-4036-b1ce-ebbb4f330084 not found in is_blk_device check {{(pid=82760) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 09 12:50:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b95fddc9-1bd5-4ecd-aeff-11c542965532 tempest-SnapshotDependencyTests-164748616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7da31a98-0c78-4036-b1ce-ebbb4f330084 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:46 devstack sudo[89618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7da31a98-0c78-4036-b1ce-ebbb4f330084
Apr 09 12:50:46 devstack sudo[89618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:49 devstack sudo[89618]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:49 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b95fddc9-1bd5-4ecd-aeff-11c542965532 tempest-SnapshotDependencyTests-164748616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7da31a98-0c78-4036-b1ce-ebbb4f330084" returned: 0 in 3.215s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:49 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8c24f3-e8cc-4af9-9e80-27d92c8c2b00]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:50:49 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b95fddc9-1bd5-4ecd-aeff-11c542965532 tempest-SnapshotDependencyTests-164748616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:49 devstack sudo[89635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990
Apr 09 12:50:49 devstack sudo[89635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:50 devstack sudo[89635]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b95fddc9-1bd5-4ecd-aeff-11c542965532 tempest-SnapshotDependencyTests-164748616 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990" returned: 0 in 0.646s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:50 devstack cinder-volume[82760]: DEBUG cinder.image.image_utils [None req-b95fddc9-1bd5-4ecd-aeff-11c542965532 tempest-SnapshotDependencyTests-164748616 None] Image conversion details: src /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990, size 1024.00 MB, duration 3.22 sec, destination /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7da31a98-0c78-4036-b1ce-ebbb4f330084 {{(pid=82760) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 12:50:50 devstack cinder-volume[82760]: INFO cinder.image.image_utils [None req-b95fddc9-1bd5-4ecd-aeff-11c542965532 tempest-SnapshotDependencyTests-164748616 None] Converted 1024.00 MB image at 318.36 MB/s
Apr 09 12:50:50 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-b95fddc9-1bd5-4ecd-aeff-11c542965532 tempest-SnapshotDependencyTests-164748616 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7da31a98-0c78-4036-b1ce-ebbb4f330084 is being set with open permissions: ugo+rw
Apr 09 12:50:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b95fddc9-1bd5-4ecd-aeff-11c542965532 tempest-SnapshotDependencyTests-164748616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7da31a98-0c78-4036-b1ce-ebbb4f330084 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:50 devstack sudo[89640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7da31a98-0c78-4036-b1ce-ebbb4f330084
Apr 09 12:50:50 devstack sudo[89640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:50 devstack sudo[89640]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b95fddc9-1bd5-4ecd-aeff-11c542965532 tempest-SnapshotDependencyTests-164748616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7da31a98-0c78-4036-b1ce-ebbb4f330084" returned: 0 in 0.504s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:50 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-b95fddc9-1bd5-4ecd-aeff-11c542965532 tempest-SnapshotDependencyTests-164748616 None] Lock "cinder-quobyte-7da31a98-0c78-4036-b1ce-ebbb4f330084" released by "_copy_volume_from_snapshot" :: held 5.797s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:50:50 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-b95fddc9-1bd5-4ecd-aeff-11c542965532 tempest-SnapshotDependencyTests-164748616 None] Lock "cinder-quobyte-eb71ffe4-eb0c-49f2-a89e-b777ee858f0e-7da31a98-0c78-4036-b1ce-ebbb4f330084" released by "_create_volume_from_snapshot" :: held 5.826s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:50:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b95fddc9-1bd5-4ecd-aeff-11c542965532 tempest-SnapshotDependencyTests-164748616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.878s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:50:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-fb8be15d-209a-46d4-801c-bd828d33e142 tempest-CinderUnicodeTest-1872821075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.569s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:50:50 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-fb8be15d-209a-46d4-801c-bd828d33e142 tempest-CinderUnicodeTest-1872821075 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:50:46Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1608283922',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc839233-7461-46f5-803c-a7b11fd368f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b18d1f46b1dc443c844033cdf21b9f20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:50:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:50:46Z,use_quota=True,user_id='fce3d3f1355447dbbd1095164e01e4c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:50:50 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-fb8be15d-209a-46d4-801c-bd828d33e142 tempest-CinderUnicodeTest-1872821075 None] Creating volume dc839233-7461-46f5-803c-a7b11fd368f7 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:50:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-fb8be15d-209a-46d4-801c-bd828d33e142 tempest-CinderUnicodeTest-1872821075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:50:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-fb8be15d-209a-46d4-801c-bd828d33e142 tempest-CinderUnicodeTest-1872821075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:50:50 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-fb8be15d-209a-46d4-801c-bd828d33e142 tempest-CinderUnicodeTest-1872821075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:50:50 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-fb8be15d-209a-46d4-801c-bd828d33e142 tempest-CinderUnicodeTest-1872821075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:50:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-fb8be15d-209a-46d4-801c-bd828d33e142 tempest-CinderUnicodeTest-1872821075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:50:50 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-fb8be15d-209a-46d4-801c-bd828d33e142 tempest-CinderUnicodeTest-1872821075 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:50:50 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-fb8be15d-209a-46d4-801c-bd828d33e142 tempest-CinderUnicodeTest-1872821075 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:50:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-fb8be15d-209a-46d4-801c-bd828d33e142 tempest-CinderUnicodeTest-1872821075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dc839233-7461-46f5-803c-a7b11fd368f7 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:51 devstack sudo[89643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dc839233-7461-46f5-803c-a7b11fd368f7 1073741824
Apr 09 12:50:51 devstack sudo[89643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:51 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b95fddc9-1bd5-4ecd-aeff-11c542965532 tempest-SnapshotDependencyTests-164748616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8fe235b-c47f-4476-b5b5-be41b225508e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7da31a98-0c78-4036-b1ce-ebbb4f330084', 'volume_size': 1, 'snapshot_id': 'eb71ffe4-eb0c-49f2-a89e-b777ee858f0e'}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:51 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b95fddc9-1bd5-4ecd-aeff-11c542965532 tempest-SnapshotDependencyTests-164748616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8930594-ce7e-4b8d-9a4b-19443126881a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:51 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-b95fddc9-1bd5-4ecd-aeff-11c542965532 tempest-SnapshotDependencyTests-164748616 None] Volume volume-7da31a98-0c78-4036-b1ce-ebbb4f330084 (7da31a98-0c78-4036-b1ce-ebbb4f330084): created successfully
Apr 09 12:50:51 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b95fddc9-1bd5-4ecd-aeff-11c542965532 tempest-SnapshotDependencyTests-164748616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8930594-ce7e-4b8d-9a4b-19443126881a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:51 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b95fddc9-1bd5-4ecd-aeff-11c542965532 tempest-SnapshotDependencyTests-164748616 None] Flow 'volume_create_manager' (4e520d89-bc84-46a4-8a6d-9955d991166f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:50:51 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-b95fddc9-1bd5-4ecd-aeff-11c542965532 tempest-SnapshotDependencyTests-164748616 None] Created volume successfully.
Apr 09 12:50:51 devstack sudo[89643]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-fb8be15d-209a-46d4-801c-bd828d33e142 tempest-CinderUnicodeTest-1872821075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dc839233-7461-46f5-803c-a7b11fd368f7 1073741824" returned: 0 in 0.595s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-fb8be15d-209a-46d4-801c-bd828d33e142 tempest-CinderUnicodeTest-1872821075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dc839233-7461-46f5-803c-a7b11fd368f7 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:51 devstack sudo[89648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dc839233-7461-46f5-803c-a7b11fd368f7
Apr 09 12:50:51 devstack sudo[89648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:51 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-f1bd585d-fb37-459f-9179-90ec54693ff5 tempest-SnapshotDependencyTests-164748616 None] Acquiring lock "cinder-eb71ffe4-eb0c-49f2-a89e-b777ee858f0e-delete_snapshot" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:50:51 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-f1bd585d-fb37-459f-9179-90ec54693ff5 tempest-SnapshotDependencyTests-164748616 None] Lock "cinder-eb71ffe4-eb0c-49f2-a89e-b777ee858f0e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:50:51 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-f1bd585d-fb37-459f-9179-90ec54693ff5 tempest-SnapshotDependencyTests-164748616 None] Acquiring lock "cinder-quobyte-68a77030-f36d-4da7-bd73-246040ab1990" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:50:51 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-f1bd585d-fb37-459f-9179-90ec54693ff5 tempest-SnapshotDependencyTests-164748616 None] Lock "cinder-quobyte-68a77030-f36d-4da7-bd73-246040ab1990" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:50:51 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-f1bd585d-fb37-459f-9179-90ec54693ff5 tempest-SnapshotDependencyTests-164748616 None] Acquiring lock "cinder-quobyte-eb71ffe4-eb0c-49f2-a89e-b777ee858f0e" by "_delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:50:51 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-f1bd585d-fb37-459f-9179-90ec54693ff5 tempest-SnapshotDependencyTests-164748616 None] Lock "cinder-quobyte-eb71ffe4-eb0c-49f2-a89e-b777ee858f0e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:50:51 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-f1bd585d-fb37-459f-9179-90ec54693ff5 tempest-SnapshotDependencyTests-164748616 None] Deleting offline snapshot eb71ffe4-eb0c-49f2-a89e-b777ee858f0e of volume 68a77030-f36d-4da7-bd73-246040ab1990 {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 12:50:51 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-f1bd585d-fb37-459f-9179-90ec54693ff5 tempest-SnapshotDependencyTests-164748616 None] snapshot_file for this snap is: volume-68a77030-f36d-4da7-bd73-246040ab1990.eb71ffe4-eb0c-49f2-a89e-b777ee858f0e {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 12:50:51 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2173542-8ba5-4572-9f34-ca2217943409]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:50:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f1bd585d-fb37-459f-9179-90ec54693ff5 tempest-SnapshotDependencyTests-164748616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990.eb71ffe4-eb0c-49f2-a89e-b777ee858f0e {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:51 devstack sudo[89650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990.eb71ffe4-eb0c-49f2-a89e-b777ee858f0e
Apr 09 12:50:51 devstack sudo[89650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:52 devstack sudo[89648]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-fb8be15d-209a-46d4-801c-bd828d33e142 tempest-CinderUnicodeTest-1872821075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dc839233-7461-46f5-803c-a7b11fd368f7" returned: 0 in 0.534s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:52 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-fb8be15d-209a-46d4-801c-bd828d33e142 tempest-CinderUnicodeTest-1872821075 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:50:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-fb8be15d-209a-46d4-801c-bd828d33e142 tempest-CinderUnicodeTest-1872821075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:50:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-fb8be15d-209a-46d4-801c-bd828d33e142 tempest-CinderUnicodeTest-1872821075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (707d9f61-e991-4188-8238-8ebf6d1ee381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc839233-7461-46f5-803c-a7b11fd368f7', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-fb8be15d-209a-46d4-801c-bd828d33e142 tempest-CinderUnicodeTest-1872821075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (392b181f-30db-4711-b4b2-9c7748dd75d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:50:52 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-fb8be15d-209a-46d4-801c-bd828d33e142 tempest-CinderUnicodeTest-1872821075 None] Volume volume-dc839233-7461-46f5-803c-a7b11fd368f7 (dc839233-7461-46f5-803c-a7b11fd368f7): created successfully
Apr 09 12:50:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-fb8be15d-209a-46d4-801c-bd828d33e142 tempest-CinderUnicodeTest-1872821075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (392b181f-30db-4711-b4b2-9c7748dd75d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:50:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-fb8be15d-209a-46d4-801c-bd828d33e142 tempest-CinderUnicodeTest-1872821075 None] Flow 'volume_create_manager' (0445c9a2-ec78-4c2b-9e95-3b352d7b9813) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:50:52 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-fb8be15d-209a-46d4-801c-bd828d33e142 tempest-CinderUnicodeTest-1872821075 None] Created volume successfully.
Apr 09 12:50:52 devstack sudo[89650]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f1bd585d-fb37-459f-9179-90ec54693ff5 tempest-SnapshotDependencyTests-164748616 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990.eb71ffe4-eb0c-49f2-a89e-b777ee858f0e" returned: 0 in 0.569s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:52 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-f1bd585d-fb37-459f-9179-90ec54693ff5 tempest-SnapshotDependencyTests-164748616 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68a77030-f36d-4da7-bd73-246040ab1990(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:50:52 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c025f1b-f6a4-4abb-bc9a-3bcd2ee33e41]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:50:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f1bd585d-fb37-459f-9179-90ec54693ff5 tempest-SnapshotDependencyTests-164748616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:52 devstack sudo[89656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990
Apr 09 12:50:52 devstack sudo[89656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:52 devstack sudo[89656]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f1bd585d-fb37-459f-9179-90ec54693ff5 tempest-SnapshotDependencyTests-164748616 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990" returned: 0 in 0.579s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f1bd585d-fb37-459f-9179-90ec54693ff5 tempest-SnapshotDependencyTests-164748616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990.eb71ffe4-eb0c-49f2-a89e-b777ee858f0e {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:52 devstack sudo[89662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990.eb71ffe4-eb0c-49f2-a89e-b777ee858f0e
Apr 09 12:50:52 devstack sudo[89662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-3fed4cbe-98ef-4a3b-a500-a9b94b7898dc tempest-CinderUnicodeTest-1872821075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:50:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-3fed4cbe-98ef-4a3b-a500-a9b94b7898dc tempest-CinderUnicodeTest-1872821075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:50:53 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-3fed4cbe-98ef-4a3b-a500-a9b94b7898dc tempest-CinderUnicodeTest-1872821075 None] Creating offline snapshot dd98e03f-b4c7-49d5-8ac3-aa393df4fdf9 of volume dc839233-7461-46f5-803c-a7b11fd368f7 {{(pid=82760) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 12:50:53 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5914d57-efb7-4925-b86e-0956144c5455]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:50:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-3fed4cbe-98ef-4a3b-a500-a9b94b7898dc tempest-CinderUnicodeTest-1872821075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dc839233-7461-46f5-803c-a7b11fd368f7 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:53 devstack sudo[89664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dc839233-7461-46f5-803c-a7b11fd368f7
Apr 09 12:50:53 devstack sudo[89664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:53 devstack sudo[89662]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f1bd585d-fb37-459f-9179-90ec54693ff5 tempest-SnapshotDependencyTests-164748616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990.eb71ffe4-eb0c-49f2-a89e-b777ee858f0e" returned: 0 in 0.674s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f1bd585d-fb37-459f-9179-90ec54693ff5 tempest-SnapshotDependencyTests-164748616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990.eb71ffe4-eb0c-49f2-a89e-b777ee858f0e {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:53 devstack sudo[89669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990.eb71ffe4-eb0c-49f2-a89e-b777ee858f0e
Apr 09 12:50:53 devstack sudo[89669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:53 devstack sudo[89664]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-3fed4cbe-98ef-4a3b-a500-a9b94b7898dc tempest-CinderUnicodeTest-1872821075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dc839233-7461-46f5-803c-a7b11fd368f7" returned: 0 in 0.654s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-3fed4cbe-98ef-4a3b-a500-a9b94b7898dc tempest-CinderUnicodeTest-1872821075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dc839233-7461-46f5-803c-a7b11fd368f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dc839233-7461-46f5-803c-a7b11fd368f7.dd98e03f-b4c7-49d5-8ac3-aa393df4fdf9 1G {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:53 devstack sudo[89674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dc839233-7461-46f5-803c-a7b11fd368f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dc839233-7461-46f5-803c-a7b11fd368f7.dd98e03f-b4c7-49d5-8ac3-aa393df4fdf9 1G
Apr 09 12:50:53 devstack sudo[89674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:54 devstack sudo[89669]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f1bd585d-fb37-459f-9179-90ec54693ff5 tempest-SnapshotDependencyTests-164748616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990.eb71ffe4-eb0c-49f2-a89e-b777ee858f0e" returned: 0 in 0.535s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:54 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-f1bd585d-fb37-459f-9179-90ec54693ff5 tempest-SnapshotDependencyTests-164748616 None] Lock "cinder-quobyte-eb71ffe4-eb0c-49f2-a89e-b777ee858f0e" released by "_delete_snapshot" :: held 2.473s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:50:54 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-f1bd585d-fb37-459f-9179-90ec54693ff5 tempest-SnapshotDependencyTests-164748616 None] Lock "cinder-quobyte-68a77030-f36d-4da7-bd73-246040ab1990" released by "delete_snapshot" :: held 2.492s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:50:54 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-f1bd585d-fb37-459f-9179-90ec54693ff5 tempest-SnapshotDependencyTests-164748616 None] Created reservations ['768b9045-d4a0-4d18-867b-2c0f365211bb', 'e638e6ad-1fae-4541-ba6a-2a61dddb2d7a', 'eff379a0-cea1-4129-a8df-c5c9e52337f8', 'f0f688f4-7154-4393-a1ef-ac68c531a0ec'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:50:54 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-f1bd585d-fb37-459f-9179-90ec54693ff5 tempest-SnapshotDependencyTests-164748616 None] Delete snapshot completed successfully.
Apr 09 12:50:54 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-f1bd585d-fb37-459f-9179-90ec54693ff5 tempest-SnapshotDependencyTests-164748616 None] Lock "cinder-eb71ffe4-eb0c-49f2-a89e-b777ee858f0e-delete_snapshot" released by "delete_snapshot" :: held 2.627s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:50:54 devstack sudo[89674]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-3fed4cbe-98ef-4a3b-a500-a9b94b7898dc tempest-CinderUnicodeTest-1872821075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dc839233-7461-46f5-803c-a7b11fd368f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dc839233-7461-46f5-803c-a7b11fd368f7.dd98e03f-b4c7-49d5-8ac3-aa393df4fdf9 1G" returned: 0 in 0.648s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-3fed4cbe-98ef-4a3b-a500-a9b94b7898dc tempest-CinderUnicodeTest-1872821075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc839233-7461-46f5-803c-a7b11fd368f7 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dc839233-7461-46f5-803c-a7b11fd368f7.dd98e03f-b4c7-49d5-8ac3-aa393df4fdf9 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:54 devstack sudo[89681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc839233-7461-46f5-803c-a7b11fd368f7 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dc839233-7461-46f5-803c-a7b11fd368f7.dd98e03f-b4c7-49d5-8ac3-aa393df4fdf9
Apr 09 12:50:54 devstack sudo[89681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:54 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-145f3c47-b484-4d63-9675-67787adb0723 tempest-SnapshotDependencyTests-164748616 None] Acquiring lock "cinder-68a77030-f36d-4da7-bd73-246040ab1990-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:50:54 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-145f3c47-b484-4d63-9675-67787adb0723 tempest-SnapshotDependencyTests-164748616 None] Lock "cinder-68a77030-f36d-4da7-bd73-246040ab1990-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:50:54 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-145f3c47-b484-4d63-9675-67787adb0723 tempest-SnapshotDependencyTests-164748616 None] Acquiring lock "cinder-quobyte-68a77030-f36d-4da7-bd73-246040ab1990" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:50:54 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-145f3c47-b484-4d63-9675-67787adb0723 tempest-SnapshotDependencyTests-164748616 None] Lock "cinder-quobyte-68a77030-f36d-4da7-bd73-246040ab1990" acquired by "delete_volume" :: waited 0.010s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:50:54 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[4557abc7-fd2e-4b2d-b294-e2c1164c1f24]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:50:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-145f3c47-b484-4d63-9675-67787adb0723 tempest-SnapshotDependencyTests-164748616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:54 devstack sudo[89687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990
Apr 09 12:50:54 devstack sudo[89687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:55 devstack sudo[89681]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-3fed4cbe-98ef-4a3b-a500-a9b94b7898dc tempest-CinderUnicodeTest-1872821075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc839233-7461-46f5-803c-a7b11fd368f7 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dc839233-7461-46f5-803c-a7b11fd368f7.dd98e03f-b4c7-49d5-8ac3-aa393df4fdf9" returned: 0 in 0.571s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:55 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-3fed4cbe-98ef-4a3b-a500-a9b94b7898dc tempest-CinderUnicodeTest-1872821075 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dc839233-7461-46f5-803c-a7b11fd368f7.dd98e03f-b4c7-49d5-8ac3-aa393df4fdf9 is being set with open permissions: ugo+rw
Apr 09 12:50:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-3fed4cbe-98ef-4a3b-a500-a9b94b7898dc tempest-CinderUnicodeTest-1872821075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dc839233-7461-46f5-803c-a7b11fd368f7.dd98e03f-b4c7-49d5-8ac3-aa393df4fdf9 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:55 devstack sudo[89690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dc839233-7461-46f5-803c-a7b11fd368f7.dd98e03f-b4c7-49d5-8ac3-aa393df4fdf9
Apr 09 12:50:55 devstack sudo[89690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:55 devstack sudo[89687]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-145f3c47-b484-4d63-9675-67787adb0723 tempest-SnapshotDependencyTests-164748616 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990" returned: 0 in 0.619s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-145f3c47-b484-4d63-9675-67787adb0723 tempest-SnapshotDependencyTests-164748616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:55 devstack sudo[89690]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-3fed4cbe-98ef-4a3b-a500-a9b94b7898dc tempest-CinderUnicodeTest-1872821075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dc839233-7461-46f5-803c-a7b11fd368f7.dd98e03f-b4c7-49d5-8ac3-aa393df4fdf9" returned: 0 in 0.522s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:55 devstack sudo[89696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990
Apr 09 12:50:55 devstack sudo[89696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-3fed4cbe-98ef-4a3b-a500-a9b94b7898dc tempest-CinderUnicodeTest-1872821075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dc839233-7461-46f5-803c-a7b11fd368f7.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:55 devstack sudo[89698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dc839233-7461-46f5-803c-a7b11fd368f7.info
Apr 09 12:50:55 devstack sudo[89698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:56 devstack sudo[89698]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-3fed4cbe-98ef-4a3b-a500-a9b94b7898dc tempest-CinderUnicodeTest-1872821075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dc839233-7461-46f5-803c-a7b11fd368f7.info" returned: 0 in 0.513s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:56 devstack sudo[89696]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:56 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-3fed4cbe-98ef-4a3b-a500-a9b94b7898dc tempest-CinderUnicodeTest-1872821075 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dc839233-7461-46f5-803c-a7b11fd368f7.info is being set with open permissions: ugo+rw
Apr 09 12:50:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-3fed4cbe-98ef-4a3b-a500-a9b94b7898dc tempest-CinderUnicodeTest-1872821075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dc839233-7461-46f5-803c-a7b11fd368f7.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-145f3c47-b484-4d63-9675-67787adb0723 tempest-SnapshotDependencyTests-164748616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-68a77030-f36d-4da7-bd73-246040ab1990" returned: 0 in 0.565s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:56 devstack sudo[89702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dc839233-7461-46f5-803c-a7b11fd368f7.info
Apr 09 12:50:56 devstack sudo[89702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:56 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-145f3c47-b484-4d63-9675-67787adb0723 tempest-SnapshotDependencyTests-164748616 None] Lock "cinder-quobyte-68a77030-f36d-4da7-bd73-246040ab1990" released by "delete_volume" :: held 1.222s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:50:56 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-145f3c47-b484-4d63-9675-67787adb0723 tempest-SnapshotDependencyTests-164748616 None] Created reservations ['da008a76-8a5e-41a0-ad22-f0db0bb4b93d', 'aa84f3f3-af08-42d4-8fb7-1ca1be238514', '7df52c69-6281-404d-87b2-56e42020e34f', '17a6a8b4-6555-43f1-b05f-cc450562dca6'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:50:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-145f3c47-b484-4d63-9675-67787adb0723 tempest-SnapshotDependencyTests-164748616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:50:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-145f3c47-b484-4d63-9675-67787adb0723 tempest-SnapshotDependencyTests-164748616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:50:56 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-145f3c47-b484-4d63-9675-67787adb0723 tempest-SnapshotDependencyTests-164748616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:50:56 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-145f3c47-b484-4d63-9675-67787adb0723 tempest-SnapshotDependencyTests-164748616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:50:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-145f3c47-b484-4d63-9675-67787adb0723 tempest-SnapshotDependencyTests-164748616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:50:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-145f3c47-b484-4d63-9675-67787adb0723 tempest-SnapshotDependencyTests-164748616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:56 devstack sudo[89704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:50:56 devstack sudo[89704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:56 devstack sudo[89702]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-3fed4cbe-98ef-4a3b-a500-a9b94b7898dc tempest-CinderUnicodeTest-1872821075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dc839233-7461-46f5-803c-a7b11fd368f7.info" returned: 0 in 0.519s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-3fed4cbe-98ef-4a3b-a500-a9b94b7898dc tempest-CinderUnicodeTest-1872821075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.504s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:50:56 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-3fed4cbe-98ef-4a3b-a500-a9b94b7898dc tempest-CinderUnicodeTest-1872821075 None] Create snapshot completed successfully
Apr 09 12:50:56 devstack sudo[89704]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-145f3c47-b484-4d63-9675-67787adb0723 tempest-SnapshotDependencyTests-164748616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.515s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:56 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-145f3c47-b484-4d63-9675-67787adb0723 tempest-SnapshotDependencyTests-164748616 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:50:56 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-145f3c47-b484-4d63-9675-67787adb0723 tempest-SnapshotDependencyTests-164748616 None] Deleted volume successfully.
Apr 09 12:50:56 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-145f3c47-b484-4d63-9675-67787adb0723 tempest-SnapshotDependencyTests-164748616 None] Lock "cinder-68a77030-f36d-4da7-bd73-246040ab1990-delete_volume" released by "delete_volume" :: held 1.910s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:50:57 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-8fe47b11-e2cf-49af-b2cd-2e695e19732c tempest-SnapshotDependencyTests-164748616 None] Acquiring lock "cinder-7da31a98-0c78-4036-b1ce-ebbb4f330084-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:50:57 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-8fe47b11-e2cf-49af-b2cd-2e695e19732c tempest-SnapshotDependencyTests-164748616 None] Lock "cinder-7da31a98-0c78-4036-b1ce-ebbb4f330084-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:50:57 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-8fe47b11-e2cf-49af-b2cd-2e695e19732c tempest-SnapshotDependencyTests-164748616 None] Acquiring lock "cinder-quobyte-7da31a98-0c78-4036-b1ce-ebbb4f330084" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:50:57 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-8fe47b11-e2cf-49af-b2cd-2e695e19732c tempest-SnapshotDependencyTests-164748616 None] Lock "cinder-quobyte-7da31a98-0c78-4036-b1ce-ebbb4f330084" acquired by "delete_volume" :: waited 0.014s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:50:57 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a1a792-1e46-46f8-9c66-536663c03d02]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:50:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-8fe47b11-e2cf-49af-b2cd-2e695e19732c tempest-SnapshotDependencyTests-164748616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7da31a98-0c78-4036-b1ce-ebbb4f330084 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:57 devstack sudo[89708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7da31a98-0c78-4036-b1ce-ebbb4f330084
Apr 09 12:50:57 devstack sudo[89708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:57 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-34d5498a-8249-481c-8dfa-382538131f84 tempest-CinderUnicodeTest-1872821075 None] Acquiring lock "cinder-dd98e03f-b4c7-49d5-8ac3-aa393df4fdf9-delete_snapshot" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:50:57 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-34d5498a-8249-481c-8dfa-382538131f84 tempest-CinderUnicodeTest-1872821075 None] Lock "cinder-dd98e03f-b4c7-49d5-8ac3-aa393df4fdf9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:50:57 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-34d5498a-8249-481c-8dfa-382538131f84 tempest-CinderUnicodeTest-1872821075 None] Acquiring lock "cinder-quobyte-dc839233-7461-46f5-803c-a7b11fd368f7" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:50:57 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-34d5498a-8249-481c-8dfa-382538131f84 tempest-CinderUnicodeTest-1872821075 None] Lock "cinder-quobyte-dc839233-7461-46f5-803c-a7b11fd368f7" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:50:57 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-34d5498a-8249-481c-8dfa-382538131f84 tempest-CinderUnicodeTest-1872821075 None] Acquiring lock "cinder-quobyte-dd98e03f-b4c7-49d5-8ac3-aa393df4fdf9" by "_delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:50:57 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-34d5498a-8249-481c-8dfa-382538131f84 tempest-CinderUnicodeTest-1872821075 None] Lock "cinder-quobyte-dd98e03f-b4c7-49d5-8ac3-aa393df4fdf9" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:50:57 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-34d5498a-8249-481c-8dfa-382538131f84 tempest-CinderUnicodeTest-1872821075 None] Deleting offline snapshot dd98e03f-b4c7-49d5-8ac3-aa393df4fdf9 of volume dc839233-7461-46f5-803c-a7b11fd368f7 {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 12:50:57 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-34d5498a-8249-481c-8dfa-382538131f84 tempest-CinderUnicodeTest-1872821075 None] snapshot_file for this snap is: volume-dc839233-7461-46f5-803c-a7b11fd368f7.dd98e03f-b4c7-49d5-8ac3-aa393df4fdf9 {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 12:50:57 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdde509a-b06f-4b58-815c-ba1bb28f6eda]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:50:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-34d5498a-8249-481c-8dfa-382538131f84 tempest-CinderUnicodeTest-1872821075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dc839233-7461-46f5-803c-a7b11fd368f7.dd98e03f-b4c7-49d5-8ac3-aa393df4fdf9 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:57 devstack sudo[89710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dc839233-7461-46f5-803c-a7b11fd368f7.dd98e03f-b4c7-49d5-8ac3-aa393df4fdf9
Apr 09 12:50:57 devstack sudo[89710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:57 devstack sudo[89708]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-8fe47b11-e2cf-49af-b2cd-2e695e19732c tempest-SnapshotDependencyTests-164748616 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7da31a98-0c78-4036-b1ce-ebbb4f330084" returned: 0 in 0.636s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-8fe47b11-e2cf-49af-b2cd-2e695e19732c tempest-SnapshotDependencyTests-164748616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7da31a98-0c78-4036-b1ce-ebbb4f330084 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:57 devstack sudo[89715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7da31a98-0c78-4036-b1ce-ebbb4f330084
Apr 09 12:50:57 devstack sudo[89715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:57 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-5eb39f81-dc58-4107-9ad8-6e27ab916236 tempest-VolumesNegativeTest-1971064052 None] Acquiring lock "cinder-6b3937ed-fe96-4e1e-9fe3-8cc9b08c750a-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:50:57 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-5eb39f81-dc58-4107-9ad8-6e27ab916236 tempest-VolumesNegativeTest-1971064052 None] Lock "cinder-6b3937ed-fe96-4e1e-9fe3-8cc9b08c750a-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:50:57 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-5eb39f81-dc58-4107-9ad8-6e27ab916236 tempest-VolumesNegativeTest-1971064052 None] Acquiring lock "cinder-quobyte-6b3937ed-fe96-4e1e-9fe3-8cc9b08c750a" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:50:57 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-5eb39f81-dc58-4107-9ad8-6e27ab916236 tempest-VolumesNegativeTest-1971064052 None] Lock "cinder-quobyte-6b3937ed-fe96-4e1e-9fe3-8cc9b08c750a" acquired by "delete_volume" :: waited 0.010s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:50:57 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[845e6dbf-8fd4-4123-9504-e0309c4802fc]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:50:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-5eb39f81-dc58-4107-9ad8-6e27ab916236 tempest-VolumesNegativeTest-1971064052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6b3937ed-fe96-4e1e-9fe3-8cc9b08c750a {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:57 devstack sudo[89717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6b3937ed-fe96-4e1e-9fe3-8cc9b08c750a
Apr 09 12:50:57 devstack sudo[89717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:58 devstack sudo[89710]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-34d5498a-8249-481c-8dfa-382538131f84 tempest-CinderUnicodeTest-1872821075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dc839233-7461-46f5-803c-a7b11fd368f7.dd98e03f-b4c7-49d5-8ac3-aa393df4fdf9" returned: 0 in 0.676s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:58 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-34d5498a-8249-481c-8dfa-382538131f84 tempest-CinderUnicodeTest-1872821075 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc839233-7461-46f5-803c-a7b11fd368f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:50:58 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0728dc5-78c9-48b1-82e3-103195724497]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:50:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-34d5498a-8249-481c-8dfa-382538131f84 tempest-CinderUnicodeTest-1872821075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dc839233-7461-46f5-803c-a7b11fd368f7 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:58 devstack sudo[89722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dc839233-7461-46f5-803c-a7b11fd368f7
Apr 09 12:50:58 devstack sudo[89722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:58 devstack sudo[89715]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-8fe47b11-e2cf-49af-b2cd-2e695e19732c tempest-SnapshotDependencyTests-164748616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7da31a98-0c78-4036-b1ce-ebbb4f330084" returned: 0 in 0.516s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:58 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-8fe47b11-e2cf-49af-b2cd-2e695e19732c tempest-SnapshotDependencyTests-164748616 None] Lock "cinder-quobyte-7da31a98-0c78-4036-b1ce-ebbb4f330084" released by "delete_volume" :: held 1.191s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:50:58 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-8fe47b11-e2cf-49af-b2cd-2e695e19732c tempest-SnapshotDependencyTests-164748616 None] Created reservations ['f08e7ef7-24b6-4afa-aca3-2ca62a286e35', '07059fe3-11f9-4f77-aa1e-4de215c538f7', '4ab6d1a8-9feb-4460-8863-8b89023548ce', '454dfea7-95fc-4e98-aace-62dd7fa2d3af'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:50:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-8fe47b11-e2cf-49af-b2cd-2e695e19732c tempest-SnapshotDependencyTests-164748616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:50:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-8fe47b11-e2cf-49af-b2cd-2e695e19732c tempest-SnapshotDependencyTests-164748616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:50:58 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-8fe47b11-e2cf-49af-b2cd-2e695e19732c tempest-SnapshotDependencyTests-164748616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:50:58 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-8fe47b11-e2cf-49af-b2cd-2e695e19732c tempest-SnapshotDependencyTests-164748616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:50:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-8fe47b11-e2cf-49af-b2cd-2e695e19732c tempest-SnapshotDependencyTests-164748616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:50:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-8fe47b11-e2cf-49af-b2cd-2e695e19732c tempest-SnapshotDependencyTests-164748616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:58 devstack sudo[89728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:50:58 devstack sudo[89728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:58 devstack sudo[89717]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-5eb39f81-dc58-4107-9ad8-6e27ab916236 tempest-VolumesNegativeTest-1971064052 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6b3937ed-fe96-4e1e-9fe3-8cc9b08c750a" returned: 0 in 0.559s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-5eb39f81-dc58-4107-9ad8-6e27ab916236 tempest-VolumesNegativeTest-1971064052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6b3937ed-fe96-4e1e-9fe3-8cc9b08c750a {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:58 devstack sudo[89730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6b3937ed-fe96-4e1e-9fe3-8cc9b08c750a
Apr 09 12:50:58 devstack sudo[89730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:58 devstack sudo[89722]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-34d5498a-8249-481c-8dfa-382538131f84 tempest-CinderUnicodeTest-1872821075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dc839233-7461-46f5-803c-a7b11fd368f7" returned: 0 in 0.569s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-34d5498a-8249-481c-8dfa-382538131f84 tempest-CinderUnicodeTest-1872821075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dc839233-7461-46f5-803c-a7b11fd368f7.dd98e03f-b4c7-49d5-8ac3-aa393df4fdf9 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:58 devstack sudo[89735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dc839233-7461-46f5-803c-a7b11fd368f7.dd98e03f-b4c7-49d5-8ac3-aa393df4fdf9
Apr 09 12:50:58 devstack sudo[89735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:58 devstack sudo[89728]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-8fe47b11-e2cf-49af-b2cd-2e695e19732c tempest-SnapshotDependencyTests-164748616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.447s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:58 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-8fe47b11-e2cf-49af-b2cd-2e695e19732c tempest-SnapshotDependencyTests-164748616 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:50:58 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-8fe47b11-e2cf-49af-b2cd-2e695e19732c tempest-SnapshotDependencyTests-164748616 None] Deleted volume successfully.
Apr 09 12:50:58 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-8fe47b11-e2cf-49af-b2cd-2e695e19732c tempest-SnapshotDependencyTests-164748616 None] Lock "cinder-7da31a98-0c78-4036-b1ce-ebbb4f330084-delete_volume" released by "delete_volume" :: held 1.819s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:50:58 devstack sudo[89730]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-5eb39f81-dc58-4107-9ad8-6e27ab916236 tempest-VolumesNegativeTest-1971064052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6b3937ed-fe96-4e1e-9fe3-8cc9b08c750a" returned: 0 in 0.481s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:58 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-5eb39f81-dc58-4107-9ad8-6e27ab916236 tempest-VolumesNegativeTest-1971064052 None] Lock "cinder-quobyte-6b3937ed-fe96-4e1e-9fe3-8cc9b08c750a" released by "delete_volume" :: held 1.074s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:50:59 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-5eb39f81-dc58-4107-9ad8-6e27ab916236 tempest-VolumesNegativeTest-1971064052 None] Created reservations ['2e8e8896-e1b2-4757-ab5d-aaee5cd9b826', '31d2e5d6-9d12-4de2-a62a-90bcaea1fe25', '3a8aab83-49f9-4653-a199-b65076445895', '13acc96b-fbb7-4337-969e-269729b0227d'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:50:59 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-5eb39f81-dc58-4107-9ad8-6e27ab916236 tempest-VolumesNegativeTest-1971064052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:50:59 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-5eb39f81-dc58-4107-9ad8-6e27ab916236 tempest-VolumesNegativeTest-1971064052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:50:59 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-5eb39f81-dc58-4107-9ad8-6e27ab916236 tempest-VolumesNegativeTest-1971064052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:50:59 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-5eb39f81-dc58-4107-9ad8-6e27ab916236 tempest-VolumesNegativeTest-1971064052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:50:59 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-5eb39f81-dc58-4107-9ad8-6e27ab916236 tempest-VolumesNegativeTest-1971064052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:50:59 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-5eb39f81-dc58-4107-9ad8-6e27ab916236 tempest-VolumesNegativeTest-1971064052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:59 devstack sudo[89739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:50:59 devstack sudo[89739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:59 devstack sudo[89735]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:59 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-34d5498a-8249-481c-8dfa-382538131f84 tempest-CinderUnicodeTest-1872821075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dc839233-7461-46f5-803c-a7b11fd368f7.dd98e03f-b4c7-49d5-8ac3-aa393df4fdf9" returned: 0 in 0.530s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:59 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-34d5498a-8249-481c-8dfa-382538131f84 tempest-CinderUnicodeTest-1872821075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dc839233-7461-46f5-803c-a7b11fd368f7.dd98e03f-b4c7-49d5-8ac3-aa393df4fdf9 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:50:59 devstack sudo[89744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dc839233-7461-46f5-803c-a7b11fd368f7.dd98e03f-b4c7-49d5-8ac3-aa393df4fdf9
Apr 09 12:50:59 devstack sudo[89744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:50:59 devstack sudo[89739]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:59 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-5eb39f81-dc58-4107-9ad8-6e27ab916236 tempest-VolumesNegativeTest-1971064052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.509s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:59 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-5eb39f81-dc58-4107-9ad8-6e27ab916236 tempest-VolumesNegativeTest-1971064052 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:50:59 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-5eb39f81-dc58-4107-9ad8-6e27ab916236 tempest-VolumesNegativeTest-1971064052 None] Deleted volume successfully.
Apr 09 12:50:59 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-5eb39f81-dc58-4107-9ad8-6e27ab916236 tempest-VolumesNegativeTest-1971064052 None] Lock "cinder-6b3937ed-fe96-4e1e-9fe3-8cc9b08c750a-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:50:59 devstack sudo[89744]: pam_unix(sudo:session): session closed for user root
Apr 09 12:50:59 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-34d5498a-8249-481c-8dfa-382538131f84 tempest-CinderUnicodeTest-1872821075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dc839233-7461-46f5-803c-a7b11fd368f7.dd98e03f-b4c7-49d5-8ac3-aa393df4fdf9" returned: 0 in 0.507s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:50:59 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-34d5498a-8249-481c-8dfa-382538131f84 tempest-CinderUnicodeTest-1872821075 None] Lock "cinder-quobyte-dd98e03f-b4c7-49d5-8ac3-aa393df4fdf9" released by "_delete_snapshot" :: held 2.353s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:50:59 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-34d5498a-8249-481c-8dfa-382538131f84 tempest-CinderUnicodeTest-1872821075 None] Lock "cinder-quobyte-dc839233-7461-46f5-803c-a7b11fd368f7" released by "delete_snapshot" :: held 2.367s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:50:59 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-34d5498a-8249-481c-8dfa-382538131f84 tempest-CinderUnicodeTest-1872821075 None] Created reservations ['f1b30bdf-1f59-4f51-9c19-5e5e60ab85af', 'fad72fcf-88fa-491c-95be-27a900fee033', '699046f6-7a43-4f72-a7e5-772076e433b8', '0f2b64fe-a3fc-4393-9985-b0e2aabb5973'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:50:59 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-34d5498a-8249-481c-8dfa-382538131f84 tempest-CinderUnicodeTest-1872821075 None] Delete snapshot completed successfully.
Apr 09 12:50:59 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-34d5498a-8249-481c-8dfa-382538131f84 tempest-CinderUnicodeTest-1872821075 None] Lock "cinder-dd98e03f-b4c7-49d5-8ac3-aa393df4fdf9-delete_snapshot" released by "delete_snapshot" :: held 2.515s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:51:00 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-93db1dad-a5fd-4964-87ab-de5a0dd86add tempest-CinderUnicodeTest-1872821075 None] Acquiring lock "cinder-dc839233-7461-46f5-803c-a7b11fd368f7-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:51:00 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-93db1dad-a5fd-4964-87ab-de5a0dd86add tempest-CinderUnicodeTest-1872821075 None] Lock "cinder-dc839233-7461-46f5-803c-a7b11fd368f7-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:51:00 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-93db1dad-a5fd-4964-87ab-de5a0dd86add tempest-CinderUnicodeTest-1872821075 None] Acquiring lock "cinder-quobyte-dc839233-7461-46f5-803c-a7b11fd368f7" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:51:00 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-93db1dad-a5fd-4964-87ab-de5a0dd86add tempest-CinderUnicodeTest-1872821075 None] Lock "cinder-quobyte-dc839233-7461-46f5-803c-a7b11fd368f7" acquired by "delete_volume" :: waited 0.009s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:51:00 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[78125cf5-38aa-4673-8f02-c3164f5bea9c]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:51:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-93db1dad-a5fd-4964-87ab-de5a0dd86add tempest-CinderUnicodeTest-1872821075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dc839233-7461-46f5-803c-a7b11fd368f7 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:00 devstack sudo[89748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dc839233-7461-46f5-803c-a7b11fd368f7
Apr 09 12:51:00 devstack sudo[89748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:01 devstack sudo[89748]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-93db1dad-a5fd-4964-87ab-de5a0dd86add tempest-CinderUnicodeTest-1872821075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dc839233-7461-46f5-803c-a7b11fd368f7" returned: 0 in 0.630s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-93db1dad-a5fd-4964-87ab-de5a0dd86add tempest-CinderUnicodeTest-1872821075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dc839233-7461-46f5-803c-a7b11fd368f7 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:01 devstack sudo[89754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dc839233-7461-46f5-803c-a7b11fd368f7
Apr 09 12:51:01 devstack sudo[89754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:01 devstack sudo[89754]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-93db1dad-a5fd-4964-87ab-de5a0dd86add tempest-CinderUnicodeTest-1872821075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-dc839233-7461-46f5-803c-a7b11fd368f7" returned: 0 in 0.681s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:01 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-93db1dad-a5fd-4964-87ab-de5a0dd86add tempest-CinderUnicodeTest-1872821075 None] Lock "cinder-quobyte-dc839233-7461-46f5-803c-a7b11fd368f7" released by "delete_volume" :: held 1.363s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:51:01 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-93db1dad-a5fd-4964-87ab-de5a0dd86add tempest-CinderUnicodeTest-1872821075 None] Created reservations ['11022a3d-0d43-4df8-aa42-e9f203d43bf7', '86978072-982f-4d0f-a244-1ab5073d2842', '22ed0f45-f62f-45f4-bdac-27650f3ce7c2', '815dfd0e-7e5b-4439-a696-8650246a35ce'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:51:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-93db1dad-a5fd-4964-87ab-de5a0dd86add tempest-CinderUnicodeTest-1872821075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:51:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-93db1dad-a5fd-4964-87ab-de5a0dd86add tempest-CinderUnicodeTest-1872821075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:51:02 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-93db1dad-a5fd-4964-87ab-de5a0dd86add tempest-CinderUnicodeTest-1872821075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:51:02 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-93db1dad-a5fd-4964-87ab-de5a0dd86add tempest-CinderUnicodeTest-1872821075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:51:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-93db1dad-a5fd-4964-87ab-de5a0dd86add tempest-CinderUnicodeTest-1872821075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:51:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-93db1dad-a5fd-4964-87ab-de5a0dd86add tempest-CinderUnicodeTest-1872821075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:02 devstack sudo[89757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:51:02 devstack sudo[89757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:02 devstack sudo[89757]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-93db1dad-a5fd-4964-87ab-de5a0dd86add tempest-CinderUnicodeTest-1872821075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.587s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:02 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-93db1dad-a5fd-4964-87ab-de5a0dd86add tempest-CinderUnicodeTest-1872821075 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:51:02 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-93db1dad-a5fd-4964-87ab-de5a0dd86add tempest-CinderUnicodeTest-1872821075 None] Deleted volume successfully.
Apr 09 12:51:02 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-93db1dad-a5fd-4964-87ab-de5a0dd86add tempest-CinderUnicodeTest-1872821075 None] Lock "cinder-dc839233-7461-46f5-803c-a7b11fd368f7-delete_volume" released by "delete_volume" :: held 2.152s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:51:02 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-43348fc7-01b0-4312-930d-f02ca14eab8d tempest-CinderUnicodeTest-1872821075 None] Acquiring lock "cinder-425c3a38-6c53-48ee-b391-4b87236ddd95-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:51:02 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-43348fc7-01b0-4312-930d-f02ca14eab8d tempest-CinderUnicodeTest-1872821075 None] Lock "cinder-425c3a38-6c53-48ee-b391-4b87236ddd95-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:51:02 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-43348fc7-01b0-4312-930d-f02ca14eab8d tempest-CinderUnicodeTest-1872821075 None] Acquiring lock "cinder-quobyte-425c3a38-6c53-48ee-b391-4b87236ddd95" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:51:02 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-43348fc7-01b0-4312-930d-f02ca14eab8d tempest-CinderUnicodeTest-1872821075 None] Lock "cinder-quobyte-425c3a38-6c53-48ee-b391-4b87236ddd95" acquired by "delete_volume" :: waited 0.020s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:51:02 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[0448b8e9-5fee-475b-a9ff-2d2b90b84410]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:51:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-43348fc7-01b0-4312-930d-f02ca14eab8d tempest-CinderUnicodeTest-1872821075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-425c3a38-6c53-48ee-b391-4b87236ddd95 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:03 devstack sudo[89762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-425c3a38-6c53-48ee-b391-4b87236ddd95
Apr 09 12:51:03 devstack sudo[89762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:03 devstack sudo[89762]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-43348fc7-01b0-4312-930d-f02ca14eab8d tempest-CinderUnicodeTest-1872821075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-425c3a38-6c53-48ee-b391-4b87236ddd95" returned: 0 in 0.603s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-43348fc7-01b0-4312-930d-f02ca14eab8d tempest-CinderUnicodeTest-1872821075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-425c3a38-6c53-48ee-b391-4b87236ddd95 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:03 devstack sudo[89767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-425c3a38-6c53-48ee-b391-4b87236ddd95
Apr 09 12:51:03 devstack sudo[89767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:04 devstack sudo[89767]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-43348fc7-01b0-4312-930d-f02ca14eab8d tempest-CinderUnicodeTest-1872821075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-425c3a38-6c53-48ee-b391-4b87236ddd95" returned: 0 in 0.545s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:04 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-43348fc7-01b0-4312-930d-f02ca14eab8d tempest-CinderUnicodeTest-1872821075 None] Lock "cinder-quobyte-425c3a38-6c53-48ee-b391-4b87236ddd95" released by "delete_volume" :: held 1.211s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:51:04 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-43348fc7-01b0-4312-930d-f02ca14eab8d tempest-CinderUnicodeTest-1872821075 None] Created reservations ['b1d783c9-1b08-4f5e-9211-f35b9922a868', '4b75e220-b300-48ee-a347-7d4607458aeb', '476d2c17-df37-4474-95bc-9289e65a3a8b', 'bbd9ab56-8716-4ebc-8e74-cc7c8a2f63b9'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:51:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-43348fc7-01b0-4312-930d-f02ca14eab8d tempest-CinderUnicodeTest-1872821075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:51:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-43348fc7-01b0-4312-930d-f02ca14eab8d tempest-CinderUnicodeTest-1872821075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:51:04 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-43348fc7-01b0-4312-930d-f02ca14eab8d tempest-CinderUnicodeTest-1872821075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:51:04 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-43348fc7-01b0-4312-930d-f02ca14eab8d tempest-CinderUnicodeTest-1872821075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:51:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-43348fc7-01b0-4312-930d-f02ca14eab8d tempest-CinderUnicodeTest-1872821075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:51:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-43348fc7-01b0-4312-930d-f02ca14eab8d tempest-CinderUnicodeTest-1872821075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:04 devstack sudo[89770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:51:04 devstack sudo[89770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:04 devstack sudo[89770]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-43348fc7-01b0-4312-930d-f02ca14eab8d tempest-CinderUnicodeTest-1872821075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.603s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:04 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-43348fc7-01b0-4312-930d-f02ca14eab8d tempest-CinderUnicodeTest-1872821075 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:51:04 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-43348fc7-01b0-4312-930d-f02ca14eab8d tempest-CinderUnicodeTest-1872821075 None] Deleted volume successfully.
Apr 09 12:51:04 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-43348fc7-01b0-4312-930d-f02ca14eab8d tempest-CinderUnicodeTest-1872821075 None] Lock "cinder-425c3a38-6c53-48ee-b391-4b87236ddd95-delete_volume" released by "delete_volume" :: held 1.998s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:51:09 devstack cinder-volume[82760]: DEBUG oslo_service.periodic_task [None req-f8337202-8290-4658-916e-19cfa929172e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82760) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 09 12:51:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f8337202-8290-4658-916e-19cfa929172e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:51:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f8337202-8290-4658-916e-19cfa929172e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:51:09 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f8337202-8290-4658-916e-19cfa929172e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:51:09 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f8337202-8290-4658-916e-19cfa929172e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:51:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f8337202-8290-4658-916e-19cfa929172e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:51:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f8337202-8290-4658-916e-19cfa929172e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:09 devstack sudo[89775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:51:09 devstack sudo[89775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:09 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6e615d5-a94e-468a-bd0b-ca69f55caf80 tempest-VolumesSnapshotTestJSON-1009628386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:51:09 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b6e615d5-a94e-468a-bd0b-ca69f55caf80 tempest-VolumesSnapshotTestJSON-1009628386 None] Flow 'volume_create_manager' (034bb6c3-fd3b-4ce3-981a-a13e6906c4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:51:09 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b6e615d5-a94e-468a-bd0b-ca69f55caf80 tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1a49039-9bf2-4d07-95eb-465ce48cb726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:51:09 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b6e615d5-a94e-468a-bd0b-ca69f55caf80 tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1a49039-9bf2-4d07-95eb-465ce48cb726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1856565388',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c460d75-189d-4352-b006-4ff355a29e10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a57942a178c4c36b9659cdc4330dba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:51:10Z,use_quota=True,user_id='e3df37ccd75b425b92b2ddd0c45c4aef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:51:09 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b6e615d5-a94e-468a-bd0b-ca69f55caf80 tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd79d716-cf00-46f1-91bc-1993aabf529c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:51:09 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b6e615d5-a94e-468a-bd0b-ca69f55caf80 tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd79d716-cf00-46f1-91bc-1993aabf529c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:51:09 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b6e615d5-a94e-468a-bd0b-ca69f55caf80 tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56ecb0ca-2f18-49aa-9231-c5639775cfe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:51:09 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b6e615d5-a94e-468a-bd0b-ca69f55caf80 tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56ecb0ca-2f18-49aa-9231-c5639775cfe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c460d75-189d-4352-b006-4ff355a29e10', 'volume_name': 'volume-8c460d75-189d-4352-b006-4ff355a29e10', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:51:09 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b6e615d5-a94e-468a-bd0b-ca69f55caf80 tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b11f8c-aca5-4b29-88c4-a246f90ed64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:51:09 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b6e615d5-a94e-468a-bd0b-ca69f55caf80 tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b11f8c-aca5-4b29-88c4-a246f90ed64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:51:09 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b6e615d5-a94e-468a-bd0b-ca69f55caf80 tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c32c7829-4fcf-443a-be4d-5c95c7ce1251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:51:09 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-b6e615d5-a94e-468a-bd0b-ca69f55caf80 tempest-VolumesSnapshotTestJSON-1009628386 None] Volume 8c460d75-189d-4352-b006-4ff355a29e10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c460d75-189d-4352-b006-4ff355a29e10', 'volume_size': 1}
Apr 09 12:51:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b6e615d5-a94e-468a-bd0b-ca69f55caf80 tempest-VolumesSnapshotTestJSON-1009628386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:51:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b6e615d5-a94e-468a-bd0b-ca69f55caf80 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:51:09 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-b6e615d5-a94e-468a-bd0b-ca69f55caf80 tempest-VolumesSnapshotTestJSON-1009628386 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1856565388',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c460d75-189d-4352-b006-4ff355a29e10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a57942a178c4c36b9659cdc4330dba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:51:10Z,use_quota=True,user_id='e3df37ccd75b425b92b2ddd0c45c4aef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:51:09 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-b6e615d5-a94e-468a-bd0b-ca69f55caf80 tempest-VolumesSnapshotTestJSON-1009628386 None] Creating volume 8c460d75-189d-4352-b006-4ff355a29e10 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:51:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b6e615d5-a94e-468a-bd0b-ca69f55caf80 tempest-VolumesSnapshotTestJSON-1009628386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:51:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b6e615d5-a94e-468a-bd0b-ca69f55caf80 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:51:09 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-b6e615d5-a94e-468a-bd0b-ca69f55caf80 tempest-VolumesSnapshotTestJSON-1009628386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:51:09 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-b6e615d5-a94e-468a-bd0b-ca69f55caf80 tempest-VolumesSnapshotTestJSON-1009628386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:51:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b6e615d5-a94e-468a-bd0b-ca69f55caf80 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:51:09 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-b6e615d5-a94e-468a-bd0b-ca69f55caf80 tempest-VolumesSnapshotTestJSON-1009628386 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:51:09 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-b6e615d5-a94e-468a-bd0b-ca69f55caf80 tempest-VolumesSnapshotTestJSON-1009628386 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:51:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b6e615d5-a94e-468a-bd0b-ca69f55caf80 tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8c460d75-189d-4352-b006-4ff355a29e10 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:09 devstack sudo[89777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8c460d75-189d-4352-b006-4ff355a29e10 1073741824
Apr 09 12:51:09 devstack sudo[89777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:09 devstack sudo[89775]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f8337202-8290-4658-916e-19cfa929172e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.591s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:09 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-f8337202-8290-4658-916e-19cfa929172e None None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:51:10 devstack sudo[89777]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b6e615d5-a94e-468a-bd0b-ca69f55caf80 tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8c460d75-189d-4352-b006-4ff355a29e10 1073741824" returned: 0 in 0.560s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b6e615d5-a94e-468a-bd0b-ca69f55caf80 tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8c460d75-189d-4352-b006-4ff355a29e10 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:10 devstack sudo[89783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8c460d75-189d-4352-b006-4ff355a29e10
Apr 09 12:51:10 devstack sudo[89783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:10 devstack sudo[89783]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b6e615d5-a94e-468a-bd0b-ca69f55caf80 tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8c460d75-189d-4352-b006-4ff355a29e10" returned: 0 in 0.417s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:10 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-b6e615d5-a94e-468a-bd0b-ca69f55caf80 tempest-VolumesSnapshotTestJSON-1009628386 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:51:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b6e615d5-a94e-468a-bd0b-ca69f55caf80 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:51:10 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b6e615d5-a94e-468a-bd0b-ca69f55caf80 tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c32c7829-4fcf-443a-be4d-5c95c7ce1251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c460d75-189d-4352-b006-4ff355a29e10', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:51:10 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b6e615d5-a94e-468a-bd0b-ca69f55caf80 tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01e0db12-03aa-4887-8bbd-1744882c7763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:51:10 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-b6e615d5-a94e-468a-bd0b-ca69f55caf80 tempest-VolumesSnapshotTestJSON-1009628386 None] Volume volume-8c460d75-189d-4352-b006-4ff355a29e10 (8c460d75-189d-4352-b006-4ff355a29e10): created successfully
Apr 09 12:51:10 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b6e615d5-a94e-468a-bd0b-ca69f55caf80 tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01e0db12-03aa-4887-8bbd-1744882c7763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:51:10 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-b6e615d5-a94e-468a-bd0b-ca69f55caf80 tempest-VolumesSnapshotTestJSON-1009628386 None] Flow 'volume_create_manager' (034bb6c3-fd3b-4ce3-981a-a13e6906c4d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:51:10 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-b6e615d5-a94e-468a-bd0b-ca69f55caf80 tempest-VolumesSnapshotTestJSON-1009628386 None] Created volume successfully.
Apr 09 12:51:12 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-cd37af5e-b94e-444e-8c24-559e5ba0a9c2 tempest-VolumesSnapshotTestJSON-1009628386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:51:12 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-cd37af5e-b94e-444e-8c24-559e5ba0a9c2 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:51:12 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-cd37af5e-b94e-444e-8c24-559e5ba0a9c2 tempest-VolumesSnapshotTestJSON-1009628386 None] Creating offline snapshot 5ed0cf2f-7fd1-4bf2-9197-c38fd9b44e86 of volume 8c460d75-189d-4352-b006-4ff355a29e10 {{(pid=82760) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 12:51:12 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e0bef2-cfde-4025-90d6-219dbd6b0f41]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:51:12 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-cd37af5e-b94e-444e-8c24-559e5ba0a9c2 tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8c460d75-189d-4352-b006-4ff355a29e10 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:12 devstack sudo[89787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8c460d75-189d-4352-b006-4ff355a29e10
Apr 09 12:51:12 devstack sudo[89787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:12 devstack sudo[89787]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:12 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-cd37af5e-b94e-444e-8c24-559e5ba0a9c2 tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8c460d75-189d-4352-b006-4ff355a29e10" returned: 0 in 0.743s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:12 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-cd37af5e-b94e-444e-8c24-559e5ba0a9c2 tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8c460d75-189d-4352-b006-4ff355a29e10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8c460d75-189d-4352-b006-4ff355a29e10.5ed0cf2f-7fd1-4bf2-9197-c38fd9b44e86 1G {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:12 devstack sudo[89793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8c460d75-189d-4352-b006-4ff355a29e10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8c460d75-189d-4352-b006-4ff355a29e10.5ed0cf2f-7fd1-4bf2-9197-c38fd9b44e86 1G
Apr 09 12:51:12 devstack sudo[89793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:13 devstack sudo[89793]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:13 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-cd37af5e-b94e-444e-8c24-559e5ba0a9c2 tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8c460d75-189d-4352-b006-4ff355a29e10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8c460d75-189d-4352-b006-4ff355a29e10.5ed0cf2f-7fd1-4bf2-9197-c38fd9b44e86 1G" returned: 0 in 0.521s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:13 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-cd37af5e-b94e-444e-8c24-559e5ba0a9c2 tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c460d75-189d-4352-b006-4ff355a29e10 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8c460d75-189d-4352-b006-4ff355a29e10.5ed0cf2f-7fd1-4bf2-9197-c38fd9b44e86 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:13 devstack sudo[89798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c460d75-189d-4352-b006-4ff355a29e10 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8c460d75-189d-4352-b006-4ff355a29e10.5ed0cf2f-7fd1-4bf2-9197-c38fd9b44e86
Apr 09 12:51:13 devstack sudo[89798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:13 devstack sudo[89798]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:13 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-cd37af5e-b94e-444e-8c24-559e5ba0a9c2 tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c460d75-189d-4352-b006-4ff355a29e10 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8c460d75-189d-4352-b006-4ff355a29e10.5ed0cf2f-7fd1-4bf2-9197-c38fd9b44e86" returned: 0 in 0.462s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:13 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-cd37af5e-b94e-444e-8c24-559e5ba0a9c2 tempest-VolumesSnapshotTestJSON-1009628386 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8c460d75-189d-4352-b006-4ff355a29e10.5ed0cf2f-7fd1-4bf2-9197-c38fd9b44e86 is being set with open permissions: ugo+rw
Apr 09 12:51:13 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-cd37af5e-b94e-444e-8c24-559e5ba0a9c2 tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8c460d75-189d-4352-b006-4ff355a29e10.5ed0cf2f-7fd1-4bf2-9197-c38fd9b44e86 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:13 devstack sudo[89803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8c460d75-189d-4352-b006-4ff355a29e10.5ed0cf2f-7fd1-4bf2-9197-c38fd9b44e86
Apr 09 12:51:13 devstack sudo[89803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:14 devstack sudo[89803]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-cd37af5e-b94e-444e-8c24-559e5ba0a9c2 tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8c460d75-189d-4352-b006-4ff355a29e10.5ed0cf2f-7fd1-4bf2-9197-c38fd9b44e86" returned: 0 in 0.441s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-cd37af5e-b94e-444e-8c24-559e5ba0a9c2 tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8c460d75-189d-4352-b006-4ff355a29e10.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:14 devstack sudo[89806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8c460d75-189d-4352-b006-4ff355a29e10.info
Apr 09 12:51:14 devstack sudo[89806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:14 devstack sudo[89806]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-cd37af5e-b94e-444e-8c24-559e5ba0a9c2 tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8c460d75-189d-4352-b006-4ff355a29e10.info" returned: 0 in 0.453s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:14 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-cd37af5e-b94e-444e-8c24-559e5ba0a9c2 tempest-VolumesSnapshotTestJSON-1009628386 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8c460d75-189d-4352-b006-4ff355a29e10.info is being set with open permissions: ugo+rw
Apr 09 12:51:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-cd37af5e-b94e-444e-8c24-559e5ba0a9c2 tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8c460d75-189d-4352-b006-4ff355a29e10.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:14 devstack sudo[89809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8c460d75-189d-4352-b006-4ff355a29e10.info
Apr 09 12:51:14 devstack sudo[89809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:15 devstack sudo[89809]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:15 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-cd37af5e-b94e-444e-8c24-559e5ba0a9c2 tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8c460d75-189d-4352-b006-4ff355a29e10.info" returned: 0 in 0.470s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:15 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-cd37af5e-b94e-444e-8c24-559e5ba0a9c2 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.164s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:51:15 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-cd37af5e-b94e-444e-8c24-559e5ba0a9c2 tempest-VolumesSnapshotTestJSON-1009628386 None] Create snapshot completed successfully
Apr 09 12:51:16 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-80805822-8a6c-4721-b5ea-fd99b8fcdf54 tempest-VolumesSnapshotTestJSON-1009628386 None] Acquiring lock "cinder-5ed0cf2f-7fd1-4bf2-9197-c38fd9b44e86-delete_snapshot" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:51:16 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-80805822-8a6c-4721-b5ea-fd99b8fcdf54 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "cinder-5ed0cf2f-7fd1-4bf2-9197-c38fd9b44e86-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:51:16 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-80805822-8a6c-4721-b5ea-fd99b8fcdf54 tempest-VolumesSnapshotTestJSON-1009628386 None] Acquiring lock "cinder-quobyte-8c460d75-189d-4352-b006-4ff355a29e10" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:51:16 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-80805822-8a6c-4721-b5ea-fd99b8fcdf54 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "cinder-quobyte-8c460d75-189d-4352-b006-4ff355a29e10" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:51:16 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-80805822-8a6c-4721-b5ea-fd99b8fcdf54 tempest-VolumesSnapshotTestJSON-1009628386 None] Acquiring lock "cinder-quobyte-5ed0cf2f-7fd1-4bf2-9197-c38fd9b44e86" by "_delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:51:16 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-80805822-8a6c-4721-b5ea-fd99b8fcdf54 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "cinder-quobyte-5ed0cf2f-7fd1-4bf2-9197-c38fd9b44e86" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:51:16 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-80805822-8a6c-4721-b5ea-fd99b8fcdf54 tempest-VolumesSnapshotTestJSON-1009628386 None] Deleting offline snapshot 5ed0cf2f-7fd1-4bf2-9197-c38fd9b44e86 of volume 8c460d75-189d-4352-b006-4ff355a29e10 {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 12:51:16 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-80805822-8a6c-4721-b5ea-fd99b8fcdf54 tempest-VolumesSnapshotTestJSON-1009628386 None] snapshot_file for this snap is: volume-8c460d75-189d-4352-b006-4ff355a29e10.5ed0cf2f-7fd1-4bf2-9197-c38fd9b44e86 {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 12:51:16 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c1a964-f28f-4a68-b15f-5fb6905a149e]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:51:16 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-80805822-8a6c-4721-b5ea-fd99b8fcdf54 tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8c460d75-189d-4352-b006-4ff355a29e10.5ed0cf2f-7fd1-4bf2-9197-c38fd9b44e86 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:16 devstack sudo[89812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8c460d75-189d-4352-b006-4ff355a29e10.5ed0cf2f-7fd1-4bf2-9197-c38fd9b44e86
Apr 09 12:51:16 devstack sudo[89812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:17 devstack sudo[89812]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:17 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-80805822-8a6c-4721-b5ea-fd99b8fcdf54 tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8c460d75-189d-4352-b006-4ff355a29e10.5ed0cf2f-7fd1-4bf2-9197-c38fd9b44e86" returned: 0 in 0.562s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:17 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-80805822-8a6c-4721-b5ea-fd99b8fcdf54 tempest-VolumesSnapshotTestJSON-1009628386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c460d75-189d-4352-b006-4ff355a29e10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:51:17 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[c256cac5-1361-43a2-bed0-4ac8068db486]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:51:17 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-80805822-8a6c-4721-b5ea-fd99b8fcdf54 tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8c460d75-189d-4352-b006-4ff355a29e10 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:17 devstack sudo[89817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8c460d75-189d-4352-b006-4ff355a29e10
Apr 09 12:51:17 devstack sudo[89817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:17 devstack sudo[89817]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:17 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-80805822-8a6c-4721-b5ea-fd99b8fcdf54 tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8c460d75-189d-4352-b006-4ff355a29e10" returned: 0 in 0.539s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:17 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-80805822-8a6c-4721-b5ea-fd99b8fcdf54 tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8c460d75-189d-4352-b006-4ff355a29e10.5ed0cf2f-7fd1-4bf2-9197-c38fd9b44e86 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:17 devstack sudo[89822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8c460d75-189d-4352-b006-4ff355a29e10.5ed0cf2f-7fd1-4bf2-9197-c38fd9b44e86
Apr 09 12:51:17 devstack sudo[89822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:18 devstack sudo[89822]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-80805822-8a6c-4721-b5ea-fd99b8fcdf54 tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8c460d75-189d-4352-b006-4ff355a29e10.5ed0cf2f-7fd1-4bf2-9197-c38fd9b44e86" returned: 0 in 0.579s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-80805822-8a6c-4721-b5ea-fd99b8fcdf54 tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8c460d75-189d-4352-b006-4ff355a29e10.5ed0cf2f-7fd1-4bf2-9197-c38fd9b44e86 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:18 devstack sudo[89827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8c460d75-189d-4352-b006-4ff355a29e10.5ed0cf2f-7fd1-4bf2-9197-c38fd9b44e86
Apr 09 12:51:18 devstack sudo[89827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:18 devstack sudo[89827]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-80805822-8a6c-4721-b5ea-fd99b8fcdf54 tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8c460d75-189d-4352-b006-4ff355a29e10.5ed0cf2f-7fd1-4bf2-9197-c38fd9b44e86" returned: 0 in 0.558s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:18 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-80805822-8a6c-4721-b5ea-fd99b8fcdf54 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "cinder-quobyte-5ed0cf2f-7fd1-4bf2-9197-c38fd9b44e86" released by "_delete_snapshot" :: held 2.312s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:51:18 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-80805822-8a6c-4721-b5ea-fd99b8fcdf54 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "cinder-quobyte-8c460d75-189d-4352-b006-4ff355a29e10" released by "delete_snapshot" :: held 2.326s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:51:18 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-80805822-8a6c-4721-b5ea-fd99b8fcdf54 tempest-VolumesSnapshotTestJSON-1009628386 None] Created reservations ['75956129-23b3-4b97-89ff-099b036d28b3', 'ccb0ac77-4469-44b0-8d51-e7f5ec8bdab7', '077eb900-5281-4f72-84e7-5da8d58086d3', '2985582c-e31f-400a-afe0-c3e02fe7c44b'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:51:18 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-80805822-8a6c-4721-b5ea-fd99b8fcdf54 tempest-VolumesSnapshotTestJSON-1009628386 None] Delete snapshot completed successfully.
Apr 09 12:51:18 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-80805822-8a6c-4721-b5ea-fd99b8fcdf54 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "cinder-5ed0cf2f-7fd1-4bf2-9197-c38fd9b44e86-delete_snapshot" released by "delete_snapshot" :: held 2.499s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:51:20 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-6868674f-e88b-42bc-ae3e-2b20b324d237 tempest-VolumesSnapshotTestJSON-1009628386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:51:20 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-6868674f-e88b-42bc-ae3e-2b20b324d237 tempest-VolumesSnapshotTestJSON-1009628386 None] Flow 'volume_create_manager' (c597a533-e395-47f1-9645-c7110df52a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:51:20 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-6868674f-e88b-42bc-ae3e-2b20b324d237 tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (330eaa5c-0b31-4c6b-96aa-4b8474f7b88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:51:20 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-6868674f-e88b-42bc-ae3e-2b20b324d237 tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (330eaa5c-0b31-4c6b-96aa-4b8474f7b88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-69715926',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38e811d1-482d-4030-ace2-3684502be09b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a57942a178c4c36b9659cdc4330dba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:51:20Z,use_quota=True,user_id='e3df37ccd75b425b92b2ddd0c45c4aef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:51:20 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-6868674f-e88b-42bc-ae3e-2b20b324d237 tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb4318c3-b1fd-494a-8189-e1ccc8ea82a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:51:20 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-6868674f-e88b-42bc-ae3e-2b20b324d237 tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb4318c3-b1fd-494a-8189-e1ccc8ea82a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:51:20 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-6868674f-e88b-42bc-ae3e-2b20b324d237 tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (730dddf5-e97f-404f-92fd-a0d84af2cddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:51:20 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-6868674f-e88b-42bc-ae3e-2b20b324d237 tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (730dddf5-e97f-404f-92fd-a0d84af2cddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38e811d1-482d-4030-ace2-3684502be09b', 'volume_name': 'volume-38e811d1-482d-4030-ace2-3684502be09b', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:51:20 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-6868674f-e88b-42bc-ae3e-2b20b324d237 tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28b85997-0c9a-4039-b088-469faa23b15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:51:20 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-6868674f-e88b-42bc-ae3e-2b20b324d237 tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28b85997-0c9a-4039-b088-469faa23b15d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:51:20 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-6868674f-e88b-42bc-ae3e-2b20b324d237 tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74dad537-c67d-468d-a6d1-90c365a57ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:51:20 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-6868674f-e88b-42bc-ae3e-2b20b324d237 tempest-VolumesSnapshotTestJSON-1009628386 None] Volume 38e811d1-482d-4030-ace2-3684502be09b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38e811d1-482d-4030-ace2-3684502be09b', 'volume_size': 1}
Apr 09 12:51:20 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-6868674f-e88b-42bc-ae3e-2b20b324d237 tempest-VolumesSnapshotTestJSON-1009628386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:51:20 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-6868674f-e88b-42bc-ae3e-2b20b324d237 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:51:20 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-6868674f-e88b-42bc-ae3e-2b20b324d237 tempest-VolumesSnapshotTestJSON-1009628386 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-69715926',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38e811d1-482d-4030-ace2-3684502be09b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a57942a178c4c36b9659cdc4330dba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:51:20Z,use_quota=True,user_id='e3df37ccd75b425b92b2ddd0c45c4aef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:51:20 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-6868674f-e88b-42bc-ae3e-2b20b324d237 tempest-VolumesSnapshotTestJSON-1009628386 None] Creating volume 38e811d1-482d-4030-ace2-3684502be09b {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:51:20 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-6868674f-e88b-42bc-ae3e-2b20b324d237 tempest-VolumesSnapshotTestJSON-1009628386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:51:20 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-6868674f-e88b-42bc-ae3e-2b20b324d237 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:51:20 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-6868674f-e88b-42bc-ae3e-2b20b324d237 tempest-VolumesSnapshotTestJSON-1009628386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:51:20 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-6868674f-e88b-42bc-ae3e-2b20b324d237 tempest-VolumesSnapshotTestJSON-1009628386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:51:20 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-6868674f-e88b-42bc-ae3e-2b20b324d237 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:51:20 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-6868674f-e88b-42bc-ae3e-2b20b324d237 tempest-VolumesSnapshotTestJSON-1009628386 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:51:20 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-6868674f-e88b-42bc-ae3e-2b20b324d237 tempest-VolumesSnapshotTestJSON-1009628386 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:51:20 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6868674f-e88b-42bc-ae3e-2b20b324d237 tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:20 devstack sudo[89830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b 1073741824
Apr 09 12:51:20 devstack sudo[89830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:20 devstack sudo[89830]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:20 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6868674f-e88b-42bc-ae3e-2b20b324d237 tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b 1073741824" returned: 0 in 0.739s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:20 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6868674f-e88b-42bc-ae3e-2b20b324d237 tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:20 devstack sudo[89835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b
Apr 09 12:51:20 devstack sudo[89835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:21 devstack sudo[89835]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:21 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6868674f-e88b-42bc-ae3e-2b20b324d237 tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b" returned: 0 in 0.574s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:21 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-6868674f-e88b-42bc-ae3e-2b20b324d237 tempest-VolumesSnapshotTestJSON-1009628386 None] <== create_volume: return (1349ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:51:21 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-6868674f-e88b-42bc-ae3e-2b20b324d237 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.352s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:51:21 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-6868674f-e88b-42bc-ae3e-2b20b324d237 tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74dad537-c67d-468d-a6d1-90c365a57ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38e811d1-482d-4030-ace2-3684502be09b', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:51:21 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-6868674f-e88b-42bc-ae3e-2b20b324d237 tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3480714e-6792-4094-9814-c36969cc14f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:51:21 devstack cinder-volume[82760]: DEBUG dbcounter [-] [82760] Writing DB stats cinder:SELECT=104,cinder:INSERT=41,cinder:UPDATE=156,cinder:DELETE=8 {{(pid=82760) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 12:51:21 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-6868674f-e88b-42bc-ae3e-2b20b324d237 tempest-VolumesSnapshotTestJSON-1009628386 None] Volume volume-38e811d1-482d-4030-ace2-3684502be09b (38e811d1-482d-4030-ace2-3684502be09b): created successfully
Apr 09 12:51:21 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-6868674f-e88b-42bc-ae3e-2b20b324d237 tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3480714e-6792-4094-9814-c36969cc14f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:51:21 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-6868674f-e88b-42bc-ae3e-2b20b324d237 tempest-VolumesSnapshotTestJSON-1009628386 None] Flow 'volume_create_manager' (c597a533-e395-47f1-9645-c7110df52a0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:51:21 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-6868674f-e88b-42bc-ae3e-2b20b324d237 tempest-VolumesSnapshotTestJSON-1009628386 None] Created volume successfully.
Apr 09 12:51:22 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-6214cdee-fda2-4fb2-bf1e-414c117eca16 tempest-VolumesSnapshotTestJSON-1009628386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:51:22 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-6214cdee-fda2-4fb2-bf1e-414c117eca16 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:51:22 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-6214cdee-fda2-4fb2-bf1e-414c117eca16 tempest-VolumesSnapshotTestJSON-1009628386 None] Creating offline snapshot 6763e89c-1eee-4073-8757-0e4a49f50ea3 of volume 38e811d1-482d-4030-ace2-3684502be09b {{(pid=82760) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 12:51:22 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[658fec88-85aa-4471-bd26-93732158eab1]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:51:22 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6214cdee-fda2-4fb2-bf1e-414c117eca16 tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:22 devstack sudo[89840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b
Apr 09 12:51:22 devstack sudo[89840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:22 devstack sudo[89840]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:22 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6214cdee-fda2-4fb2-bf1e-414c117eca16 tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b" returned: 0 in 0.544s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:22 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6214cdee-fda2-4fb2-bf1e-414c117eca16 tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b.6763e89c-1eee-4073-8757-0e4a49f50ea3 1G {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:22 devstack sudo[89846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b.6763e89c-1eee-4073-8757-0e4a49f50ea3 1G
Apr 09 12:51:22 devstack sudo[89846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:23 devstack sudo[89846]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6214cdee-fda2-4fb2-bf1e-414c117eca16 tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b.6763e89c-1eee-4073-8757-0e4a49f50ea3 1G" returned: 0 in 0.657s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6214cdee-fda2-4fb2-bf1e-414c117eca16 tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38e811d1-482d-4030-ace2-3684502be09b -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b.6763e89c-1eee-4073-8757-0e4a49f50ea3 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:23 devstack sudo[89857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38e811d1-482d-4030-ace2-3684502be09b -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b.6763e89c-1eee-4073-8757-0e4a49f50ea3
Apr 09 12:51:23 devstack sudo[89857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:24 devstack sudo[89857]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6214cdee-fda2-4fb2-bf1e-414c117eca16 tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38e811d1-482d-4030-ace2-3684502be09b -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b.6763e89c-1eee-4073-8757-0e4a49f50ea3" returned: 0 in 0.608s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:24 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-6214cdee-fda2-4fb2-bf1e-414c117eca16 tempest-VolumesSnapshotTestJSON-1009628386 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b.6763e89c-1eee-4073-8757-0e4a49f50ea3 is being set with open permissions: ugo+rw
Apr 09 12:51:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6214cdee-fda2-4fb2-bf1e-414c117eca16 tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b.6763e89c-1eee-4073-8757-0e4a49f50ea3 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:24 devstack sudo[89862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b.6763e89c-1eee-4073-8757-0e4a49f50ea3
Apr 09 12:51:24 devstack sudo[89862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:24 devstack sudo[89862]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6214cdee-fda2-4fb2-bf1e-414c117eca16 tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b.6763e89c-1eee-4073-8757-0e4a49f50ea3" returned: 0 in 0.536s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6214cdee-fda2-4fb2-bf1e-414c117eca16 tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:24 devstack sudo[89865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b.info
Apr 09 12:51:24 devstack sudo[89865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:25 devstack sudo[89865]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6214cdee-fda2-4fb2-bf1e-414c117eca16 tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b.info" returned: 0 in 0.504s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:25 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-6214cdee-fda2-4fb2-bf1e-414c117eca16 tempest-VolumesSnapshotTestJSON-1009628386 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b.info is being set with open permissions: ugo+rw
Apr 09 12:51:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6214cdee-fda2-4fb2-bf1e-414c117eca16 tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:25 devstack sudo[89868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b.info
Apr 09 12:51:25 devstack sudo[89868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:25 devstack sudo[89868]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6214cdee-fda2-4fb2-bf1e-414c117eca16 tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b.info" returned: 0 in 0.460s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-6214cdee-fda2-4fb2-bf1e-414c117eca16 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.388s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:51:25 devstack cinder-volume[82760]: DEBUG dbcounter [-] [82760] Writing DB stats cinder:UPDATE=118,cinder:SELECT=114,cinder:INSERT=28,cinder:DELETE=14 {{(pid=82760) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 12:51:25 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-6214cdee-fda2-4fb2-bf1e-414c117eca16 tempest-VolumesSnapshotTestJSON-1009628386 None] Create snapshot completed successfully
Apr 09 12:51:26 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-89ea9ead-6e27-4909-a8a3-b2ff87927859 tempest-VolumesSnapshotTestJSON-1009628386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:51:26 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-89ea9ead-6e27-4909-a8a3-b2ff87927859 tempest-VolumesSnapshotTestJSON-1009628386 None] Flow 'volume_create_manager' (76192f86-cfb4-44d4-afff-9ab235bd29d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:51:26 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-89ea9ead-6e27-4909-a8a3-b2ff87927859 tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c748394e-d25d-4140-9d89-ecce106d6700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:51:26 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-89ea9ead-6e27-4909-a8a3-b2ff87927859 tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c748394e-d25d-4140-9d89-ecce106d6700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:51:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-576519510',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9a673b3-bc2d-431b-b202-eed5169fa65e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a57942a178c4c36b9659cdc4330dba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:51:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=6763e89c-1eee-4073-8757-0e4a49f50ea3,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:51:27Z,use_quota=True,user_id='e3df37ccd75b425b92b2ddd0c45c4aef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:51:26 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-89ea9ead-6e27-4909-a8a3-b2ff87927859 tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf1b623d-5835-4ec4-a15b-752f990817ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:51:26 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-89ea9ead-6e27-4909-a8a3-b2ff87927859 tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf1b623d-5835-4ec4-a15b-752f990817ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:51:26 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-89ea9ead-6e27-4909-a8a3-b2ff87927859 tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (170088c3-5d20-45ae-b836-67028e4b0242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:51:26 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-89ea9ead-6e27-4909-a8a3-b2ff87927859 tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (170088c3-5d20-45ae-b836-67028e4b0242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b9a673b3-bc2d-431b-b202-eed5169fa65e', 'volume_name': 'volume-b9a673b3-bc2d-431b-b202-eed5169fa65e', 'volume_size': 2, 'snapshot_id': '6763e89c-1eee-4073-8757-0e4a49f50ea3'}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:51:26 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-89ea9ead-6e27-4909-a8a3-b2ff87927859 tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d3b4b8a-0e12-47f4-9f27-89214d5400a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:51:26 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-89ea9ead-6e27-4909-a8a3-b2ff87927859 tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d3b4b8a-0e12-47f4-9f27-89214d5400a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:51:26 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-89ea9ead-6e27-4909-a8a3-b2ff87927859 tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (562a4cdc-4c19-4614-9c5d-875bbe45ba1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:51:26 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-89ea9ead-6e27-4909-a8a3-b2ff87927859 tempest-VolumesSnapshotTestJSON-1009628386 None] Volume b9a673b3-bc2d-431b-b202-eed5169fa65e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b9a673b3-bc2d-431b-b202-eed5169fa65e', 'volume_size': 2, 'snapshot_id': '6763e89c-1eee-4073-8757-0e4a49f50ea3'}
Apr 09 12:51:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-89ea9ead-6e27-4909-a8a3-b2ff87927859 tempest-VolumesSnapshotTestJSON-1009628386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:51:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-89ea9ead-6e27-4909-a8a3-b2ff87927859 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:51:26 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-89ea9ead-6e27-4909-a8a3-b2ff87927859 tempest-VolumesSnapshotTestJSON-1009628386 None] Acquiring lock "cinder-quobyte-6763e89c-1eee-4073-8757-0e4a49f50ea3-b9a673b3-bc2d-431b-b202-eed5169fa65e" by "_create_volume_from_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:51:26 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-89ea9ead-6e27-4909-a8a3-b2ff87927859 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "cinder-quobyte-6763e89c-1eee-4073-8757-0e4a49f50ea3-b9a673b3-bc2d-431b-b202-eed5169fa65e" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:51:26 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-89ea9ead-6e27-4909-a8a3-b2ff87927859 tempest-VolumesSnapshotTestJSON-1009628386 None] Creating volume b9a673b3-bc2d-431b-b202-eed5169fa65e from snapshot 6763e89c-1eee-4073-8757-0e4a49f50ea3 {{(pid=82760) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 09 12:51:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-89ea9ead-6e27-4909-a8a3-b2ff87927859 tempest-VolumesSnapshotTestJSON-1009628386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:51:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-89ea9ead-6e27-4909-a8a3-b2ff87927859 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:51:26 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-89ea9ead-6e27-4909-a8a3-b2ff87927859 tempest-VolumesSnapshotTestJSON-1009628386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:51:26 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-89ea9ead-6e27-4909-a8a3-b2ff87927859 tempest-VolumesSnapshotTestJSON-1009628386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:51:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-89ea9ead-6e27-4909-a8a3-b2ff87927859 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:51:26 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-89ea9ead-6e27-4909-a8a3-b2ff87927859 tempest-VolumesSnapshotTestJSON-1009628386 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:51:26 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-89ea9ead-6e27-4909-a8a3-b2ff87927859 tempest-VolumesSnapshotTestJSON-1009628386 None] Acquiring lock "cinder-quobyte-b9a673b3-bc2d-431b-b202-eed5169fa65e" by "_copy_volume_from_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:51:26 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-89ea9ead-6e27-4909-a8a3-b2ff87927859 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "cinder-quobyte-b9a673b3-bc2d-431b-b202-eed5169fa65e" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:51:26 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-89ea9ead-6e27-4909-a8a3-b2ff87927859 tempest-VolumesSnapshotTestJSON-1009628386 None] snapshot: 6763e89c-1eee-4073-8757-0e4a49f50ea3, volume: b9a673b3-bc2d-431b-b202-eed5169fa65e,  {{(pid=82760) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 09 12:51:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-89ea9ead-6e27-4909-a8a3-b2ff87927859 tempest-VolumesSnapshotTestJSON-1009628386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:51:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-89ea9ead-6e27-4909-a8a3-b2ff87927859 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:51:26 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-89ea9ead-6e27-4909-a8a3-b2ff87927859 tempest-VolumesSnapshotTestJSON-1009628386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:51:26 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-89ea9ead-6e27-4909-a8a3-b2ff87927859 tempest-VolumesSnapshotTestJSON-1009628386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:51:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-89ea9ead-6e27-4909-a8a3-b2ff87927859 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:51:26 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1dcd3b-9867-4788-b491-614db5231cf5]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:51:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-89ea9ead-6e27-4909-a8a3-b2ff87927859 tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b.6763e89c-1eee-4073-8757-0e4a49f50ea3 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:27 devstack sudo[89871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b.6763e89c-1eee-4073-8757-0e4a49f50ea3
Apr 09 12:51:27 devstack sudo[89871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:27 devstack sudo[89871]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-89ea9ead-6e27-4909-a8a3-b2ff87927859 tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b.6763e89c-1eee-4073-8757-0e4a49f50ea3" returned: 0 in 0.556s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:27 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-89ea9ead-6e27-4909-a8a3-b2ff87927859 tempest-VolumesSnapshotTestJSON-1009628386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38e811d1-482d-4030-ace2-3684502be09b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:51:27 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-89ea9ead-6e27-4909-a8a3-b2ff87927859 tempest-VolumesSnapshotTestJSON-1009628386 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b {{(pid=82760) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 09 12:51:27 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-89ea9ead-6e27-4909-a8a3-b2ff87927859 tempest-VolumesSnapshotTestJSON-1009628386 None] Creating direct copy from snapshot {{(pid=82760) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 09 12:51:27 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa749e58-cda3-4c24-af34-e2c4116d6630]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:51:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-89ea9ead-6e27-4909-a8a3-b2ff87927859 tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:27 devstack sudo[89876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b
Apr 09 12:51:27 devstack sudo[89876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:28 devstack sudo[89876]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:28 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-89ea9ead-6e27-4909-a8a3-b2ff87927859 tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b" returned: 0 in 0.509s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:28 devstack cinder-volume[82760]: DEBUG cinder.utils [None req-89ea9ead-6e27-4909-a8a3-b2ff87927859 tempest-VolumesSnapshotTestJSON-1009628386 None] Path /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-b9a673b3-bc2d-431b-b202-eed5169fa65e not found in is_blk_device check {{(pid=82760) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 09 12:51:28 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-89ea9ead-6e27-4909-a8a3-b2ff87927859 tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-b9a673b3-bc2d-431b-b202-eed5169fa65e {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:28 devstack sudo[89881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-b9a673b3-bc2d-431b-b202-eed5169fa65e
Apr 09 12:51:28 devstack sudo[89881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:30 devstack sudo[89881]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:30 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-89ea9ead-6e27-4909-a8a3-b2ff87927859 tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-b9a673b3-bc2d-431b-b202-eed5169fa65e" returned: 0 in 2.422s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:30 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbdef61-a146-4960-ab0f-b226e40b3aa2]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:51:30 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-89ea9ead-6e27-4909-a8a3-b2ff87927859 tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:30 devstack sudo[89893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b
Apr 09 12:51:30 devstack sudo[89893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:31 devstack sudo[89893]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:31 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-89ea9ead-6e27-4909-a8a3-b2ff87927859 tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b" returned: 0 in 0.644s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:31 devstack cinder-volume[82760]: DEBUG cinder.image.image_utils [None req-89ea9ead-6e27-4909-a8a3-b2ff87927859 tempest-VolumesSnapshotTestJSON-1009628386 None] Image conversion details: src /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b, size 1024.00 MB, duration 2.42 sec, destination /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-b9a673b3-bc2d-431b-b202-eed5169fa65e {{(pid=82760) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 12:51:31 devstack cinder-volume[82760]: INFO cinder.image.image_utils [None req-89ea9ead-6e27-4909-a8a3-b2ff87927859 tempest-VolumesSnapshotTestJSON-1009628386 None] Converted 1024.00 MB image at 422.52 MB/s
Apr 09 12:51:31 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-89ea9ead-6e27-4909-a8a3-b2ff87927859 tempest-VolumesSnapshotTestJSON-1009628386 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-b9a673b3-bc2d-431b-b202-eed5169fa65e is being set with open permissions: ugo+rw
Apr 09 12:51:31 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-89ea9ead-6e27-4909-a8a3-b2ff87927859 tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-b9a673b3-bc2d-431b-b202-eed5169fa65e {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:31 devstack sudo[89898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-b9a673b3-bc2d-431b-b202-eed5169fa65e
Apr 09 12:51:31 devstack sudo[89898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:31 devstack sudo[89898]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:31 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-89ea9ead-6e27-4909-a8a3-b2ff87927859 tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-b9a673b3-bc2d-431b-b202-eed5169fa65e" returned: 0 in 0.485s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:31 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-89ea9ead-6e27-4909-a8a3-b2ff87927859 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "cinder-quobyte-b9a673b3-bc2d-431b-b202-eed5169fa65e" released by "_copy_volume_from_snapshot" :: held 4.689s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:51:31 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-89ea9ead-6e27-4909-a8a3-b2ff87927859 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "cinder-quobyte-6763e89c-1eee-4073-8757-0e4a49f50ea3-b9a673b3-bc2d-431b-b202-eed5169fa65e" released by "_create_volume_from_snapshot" :: held 4.711s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:51:31 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-89ea9ead-6e27-4909-a8a3-b2ff87927859 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.721s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:51:31 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-89ea9ead-6e27-4909-a8a3-b2ff87927859 tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (562a4cdc-4c19-4614-9c5d-875bbe45ba1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9a673b3-bc2d-431b-b202-eed5169fa65e', 'volume_size': 2, 'snapshot_id': '6763e89c-1eee-4073-8757-0e4a49f50ea3'}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:51:31 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-89ea9ead-6e27-4909-a8a3-b2ff87927859 tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d232038-3cc7-4698-8917-edf153c20159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:51:31 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-89ea9ead-6e27-4909-a8a3-b2ff87927859 tempest-VolumesSnapshotTestJSON-1009628386 None] Volume volume-b9a673b3-bc2d-431b-b202-eed5169fa65e (b9a673b3-bc2d-431b-b202-eed5169fa65e): created successfully
Apr 09 12:51:31 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-89ea9ead-6e27-4909-a8a3-b2ff87927859 tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d232038-3cc7-4698-8917-edf153c20159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:51:31 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-89ea9ead-6e27-4909-a8a3-b2ff87927859 tempest-VolumesSnapshotTestJSON-1009628386 None] Flow 'volume_create_manager' (76192f86-cfb4-44d4-afff-9ab235bd29d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:51:31 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-89ea9ead-6e27-4909-a8a3-b2ff87927859 tempest-VolumesSnapshotTestJSON-1009628386 None] Created volume successfully.
Apr 09 12:51:32 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-0f0c49a1-2a92-4b0f-afe3-b3d1445d66cd tempest-VolumesSnapshotTestJSON-1009628386 None] Acquiring lock "cinder-b9a673b3-bc2d-431b-b202-eed5169fa65e-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:51:32 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-0f0c49a1-2a92-4b0f-afe3-b3d1445d66cd tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "cinder-b9a673b3-bc2d-431b-b202-eed5169fa65e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:51:32 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-0f0c49a1-2a92-4b0f-afe3-b3d1445d66cd tempest-VolumesSnapshotTestJSON-1009628386 None] Acquiring lock "cinder-quobyte-b9a673b3-bc2d-431b-b202-eed5169fa65e" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:51:32 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-0f0c49a1-2a92-4b0f-afe3-b3d1445d66cd tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "cinder-quobyte-b9a673b3-bc2d-431b-b202-eed5169fa65e" acquired by "delete_volume" :: waited 0.011s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:51:32 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a8b9af-9584-4677-8628-e12c61e814b7]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:51:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-0f0c49a1-2a92-4b0f-afe3-b3d1445d66cd tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-b9a673b3-bc2d-431b-b202-eed5169fa65e {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:32 devstack sudo[89902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-b9a673b3-bc2d-431b-b202-eed5169fa65e
Apr 09 12:51:32 devstack sudo[89902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:33 devstack sudo[89902]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:33 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-0f0c49a1-2a92-4b0f-afe3-b3d1445d66cd tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-b9a673b3-bc2d-431b-b202-eed5169fa65e" returned: 0 in 0.501s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:33 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-0f0c49a1-2a92-4b0f-afe3-b3d1445d66cd tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-b9a673b3-bc2d-431b-b202-eed5169fa65e {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:33 devstack sudo[89907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-b9a673b3-bc2d-431b-b202-eed5169fa65e
Apr 09 12:51:33 devstack sudo[89907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:33 devstack sudo[89907]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:33 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-0f0c49a1-2a92-4b0f-afe3-b3d1445d66cd tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-b9a673b3-bc2d-431b-b202-eed5169fa65e" returned: 0 in 0.418s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:33 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-0f0c49a1-2a92-4b0f-afe3-b3d1445d66cd tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "cinder-quobyte-b9a673b3-bc2d-431b-b202-eed5169fa65e" released by "delete_volume" :: held 0.961s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:51:33 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-0f0c49a1-2a92-4b0f-afe3-b3d1445d66cd tempest-VolumesSnapshotTestJSON-1009628386 None] Created reservations ['6558401a-391c-4611-84a4-ffa91e752290', 'b2b20a4f-4941-4d69-a37f-99635719b8ba', '01d99d25-9d05-4e9b-8986-254955e2b17f', '73a87239-e58a-4637-8fd9-e4d6c290f62e'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:51:33 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-0f0c49a1-2a92-4b0f-afe3-b3d1445d66cd tempest-VolumesSnapshotTestJSON-1009628386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:51:33 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-0f0c49a1-2a92-4b0f-afe3-b3d1445d66cd tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:51:33 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-0f0c49a1-2a92-4b0f-afe3-b3d1445d66cd tempest-VolumesSnapshotTestJSON-1009628386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:51:33 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-0f0c49a1-2a92-4b0f-afe3-b3d1445d66cd tempest-VolumesSnapshotTestJSON-1009628386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:51:33 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-0f0c49a1-2a92-4b0f-afe3-b3d1445d66cd tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:51:33 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-0f0c49a1-2a92-4b0f-afe3-b3d1445d66cd tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:33 devstack sudo[89910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:51:33 devstack sudo[89910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:33 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-cd1ff464-03cd-41e8-a5f0-7a2b698eadd0 tempest-VolumesSnapshotTestJSON-1009628386 None] Acquiring lock "cinder-6763e89c-1eee-4073-8757-0e4a49f50ea3-delete_snapshot" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:51:33 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-cd1ff464-03cd-41e8-a5f0-7a2b698eadd0 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "cinder-6763e89c-1eee-4073-8757-0e4a49f50ea3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:51:33 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-cd1ff464-03cd-41e8-a5f0-7a2b698eadd0 tempest-VolumesSnapshotTestJSON-1009628386 None] Acquiring lock "cinder-quobyte-38e811d1-482d-4030-ace2-3684502be09b" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:51:33 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-cd1ff464-03cd-41e8-a5f0-7a2b698eadd0 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "cinder-quobyte-38e811d1-482d-4030-ace2-3684502be09b" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:51:33 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-cd1ff464-03cd-41e8-a5f0-7a2b698eadd0 tempest-VolumesSnapshotTestJSON-1009628386 None] Acquiring lock "cinder-quobyte-6763e89c-1eee-4073-8757-0e4a49f50ea3" by "_delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:51:33 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-cd1ff464-03cd-41e8-a5f0-7a2b698eadd0 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "cinder-quobyte-6763e89c-1eee-4073-8757-0e4a49f50ea3" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:51:33 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-cd1ff464-03cd-41e8-a5f0-7a2b698eadd0 tempest-VolumesSnapshotTestJSON-1009628386 None] Deleting offline snapshot 6763e89c-1eee-4073-8757-0e4a49f50ea3 of volume 38e811d1-482d-4030-ace2-3684502be09b {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 12:51:33 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-cd1ff464-03cd-41e8-a5f0-7a2b698eadd0 tempest-VolumesSnapshotTestJSON-1009628386 None] snapshot_file for this snap is: volume-38e811d1-482d-4030-ace2-3684502be09b.6763e89c-1eee-4073-8757-0e4a49f50ea3 {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 12:51:33 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc7fb55d-147b-47bd-bbca-b1300daaf8c2]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:51:33 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-cd1ff464-03cd-41e8-a5f0-7a2b698eadd0 tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b.6763e89c-1eee-4073-8757-0e4a49f50ea3 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:33 devstack sudo[89912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b.6763e89c-1eee-4073-8757-0e4a49f50ea3
Apr 09 12:51:33 devstack sudo[89912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:34 devstack sudo[89910]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:34 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-0f0c49a1-2a92-4b0f-afe3-b3d1445d66cd tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.625s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:34 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-0f0c49a1-2a92-4b0f-afe3-b3d1445d66cd tempest-VolumesSnapshotTestJSON-1009628386 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:51:34 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-0f0c49a1-2a92-4b0f-afe3-b3d1445d66cd tempest-VolumesSnapshotTestJSON-1009628386 None] Deleted volume successfully.
Apr 09 12:51:34 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-0f0c49a1-2a92-4b0f-afe3-b3d1445d66cd tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "cinder-b9a673b3-bc2d-431b-b202-eed5169fa65e-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:51:34 devstack sudo[89912]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:34 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-cd1ff464-03cd-41e8-a5f0-7a2b698eadd0 tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b.6763e89c-1eee-4073-8757-0e4a49f50ea3" returned: 0 in 0.556s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:34 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-cd1ff464-03cd-41e8-a5f0-7a2b698eadd0 tempest-VolumesSnapshotTestJSON-1009628386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38e811d1-482d-4030-ace2-3684502be09b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:51:34 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[7366a46d-1650-4e4c-8b24-082670b32359]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:51:34 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-cd1ff464-03cd-41e8-a5f0-7a2b698eadd0 tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:34 devstack sudo[89918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b
Apr 09 12:51:34 devstack sudo[89918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:35 devstack sudo[89918]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-cd1ff464-03cd-41e8-a5f0-7a2b698eadd0 tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b" returned: 0 in 0.686s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-cd1ff464-03cd-41e8-a5f0-7a2b698eadd0 tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b.6763e89c-1eee-4073-8757-0e4a49f50ea3 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:35 devstack sudo[89923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b.6763e89c-1eee-4073-8757-0e4a49f50ea3
Apr 09 12:51:35 devstack sudo[89923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:35 devstack sudo[89923]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-cd1ff464-03cd-41e8-a5f0-7a2b698eadd0 tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b.6763e89c-1eee-4073-8757-0e4a49f50ea3" returned: 0 in 0.591s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-cd1ff464-03cd-41e8-a5f0-7a2b698eadd0 tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b.6763e89c-1eee-4073-8757-0e4a49f50ea3 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:35 devstack sudo[89928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b.6763e89c-1eee-4073-8757-0e4a49f50ea3
Apr 09 12:51:35 devstack sudo[89928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:36 devstack sudo[89928]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:36 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-cd1ff464-03cd-41e8-a5f0-7a2b698eadd0 tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b.6763e89c-1eee-4073-8757-0e4a49f50ea3" returned: 0 in 0.448s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:36 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-cd1ff464-03cd-41e8-a5f0-7a2b698eadd0 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "cinder-quobyte-6763e89c-1eee-4073-8757-0e4a49f50ea3" released by "_delete_snapshot" :: held 2.355s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:51:36 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-cd1ff464-03cd-41e8-a5f0-7a2b698eadd0 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "cinder-quobyte-38e811d1-482d-4030-ace2-3684502be09b" released by "delete_snapshot" :: held 2.368s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:51:36 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-cd1ff464-03cd-41e8-a5f0-7a2b698eadd0 tempest-VolumesSnapshotTestJSON-1009628386 None] Created reservations ['1dba77db-e2d3-4962-90b1-d77cff8a8bf0', '23790713-9f80-4d86-b8ac-bcaa1ad98228', '9224b3d3-2cfb-4607-a069-ca6b65bcdac2', '507657f9-4652-45e2-8ddd-bb86ac4463e5'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:51:36 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-cd1ff464-03cd-41e8-a5f0-7a2b698eadd0 tempest-VolumesSnapshotTestJSON-1009628386 None] Delete snapshot completed successfully.
Apr 09 12:51:36 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-cd1ff464-03cd-41e8-a5f0-7a2b698eadd0 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "cinder-6763e89c-1eee-4073-8757-0e4a49f50ea3-delete_snapshot" released by "delete_snapshot" :: held 2.498s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:51:37 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-50296cd7-90ba-44ca-8bdc-f84a4f4f0f3a tempest-VolumesSnapshotTestJSON-1009628386 None] Acquiring lock "cinder-38e811d1-482d-4030-ace2-3684502be09b-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:51:37 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-50296cd7-90ba-44ca-8bdc-f84a4f4f0f3a tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "cinder-38e811d1-482d-4030-ace2-3684502be09b-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:51:37 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-50296cd7-90ba-44ca-8bdc-f84a4f4f0f3a tempest-VolumesSnapshotTestJSON-1009628386 None] Acquiring lock "cinder-quobyte-38e811d1-482d-4030-ace2-3684502be09b" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:51:37 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-50296cd7-90ba-44ca-8bdc-f84a4f4f0f3a tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "cinder-quobyte-38e811d1-482d-4030-ace2-3684502be09b" acquired by "delete_volume" :: waited 0.008s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:51:37 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c9c500-c5e1-4296-bbe9-76d654d2d93e]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:51:37 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-50296cd7-90ba-44ca-8bdc-f84a4f4f0f3a tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:37 devstack sudo[89931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b
Apr 09 12:51:37 devstack sudo[89931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:37 devstack sudo[89931]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:37 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-50296cd7-90ba-44ca-8bdc-f84a4f4f0f3a tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b" returned: 0 in 0.604s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:37 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-50296cd7-90ba-44ca-8bdc-f84a4f4f0f3a tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:37 devstack sudo[89936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b
Apr 09 12:51:37 devstack sudo[89936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:38 devstack sudo[89936]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-50296cd7-90ba-44ca-8bdc-f84a4f4f0f3a tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-38e811d1-482d-4030-ace2-3684502be09b" returned: 0 in 0.560s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:38 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-50296cd7-90ba-44ca-8bdc-f84a4f4f0f3a tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "cinder-quobyte-38e811d1-482d-4030-ace2-3684502be09b" released by "delete_volume" :: held 1.203s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:51:38 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-50296cd7-90ba-44ca-8bdc-f84a4f4f0f3a tempest-VolumesSnapshotTestJSON-1009628386 None] Created reservations ['1ec0580d-6ecb-47ee-9c24-07e787d3ff5f', 'cd7ac54a-9f61-4dd2-a870-2fe57a3ea253', 'df343c3e-0fd8-46f6-bfe2-d5d72f21e652', '371ea88a-c782-48c9-a4de-f8a725cc2adb'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:51:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-50296cd7-90ba-44ca-8bdc-f84a4f4f0f3a tempest-VolumesSnapshotTestJSON-1009628386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:51:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-50296cd7-90ba-44ca-8bdc-f84a4f4f0f3a tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:51:38 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-50296cd7-90ba-44ca-8bdc-f84a4f4f0f3a tempest-VolumesSnapshotTestJSON-1009628386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:51:38 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-50296cd7-90ba-44ca-8bdc-f84a4f4f0f3a tempest-VolumesSnapshotTestJSON-1009628386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:51:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-50296cd7-90ba-44ca-8bdc-f84a4f4f0f3a tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:51:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-50296cd7-90ba-44ca-8bdc-f84a4f4f0f3a tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:38 devstack sudo[89939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:51:38 devstack sudo[89939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:38 devstack sudo[89939]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-50296cd7-90ba-44ca-8bdc-f84a4f4f0f3a tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.524s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:38 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-50296cd7-90ba-44ca-8bdc-f84a4f4f0f3a tempest-VolumesSnapshotTestJSON-1009628386 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:51:38 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-50296cd7-90ba-44ca-8bdc-f84a4f4f0f3a tempest-VolumesSnapshotTestJSON-1009628386 None] Deleted volume successfully.
Apr 09 12:51:39 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-50296cd7-90ba-44ca-8bdc-f84a4f4f0f3a tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "cinder-38e811d1-482d-4030-ace2-3684502be09b-delete_volume" released by "delete_volume" :: held 1.894s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:51:39 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-aae2be28-ca59-485a-925e-9d5781f1aa8f tempest-VolumesSnapshotTestJSON-1009628386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:51:39 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-aae2be28-ca59-485a-925e-9d5781f1aa8f tempest-VolumesSnapshotTestJSON-1009628386 None] Flow 'volume_create_manager' (bb002dc5-d70e-4621-9c65-f20e03d192b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:51:39 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-aae2be28-ca59-485a-925e-9d5781f1aa8f tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e4e91fe-14c0-40b8-8cc9-d11aa4f67f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:51:39 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-aae2be28-ca59-485a-925e-9d5781f1aa8f tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e4e91fe-14c0-40b8-8cc9-d11aa4f67f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:51:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-875309705',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea425e07-190c-4a78-a001-22a58a013f15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a57942a178c4c36b9659cdc4330dba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:51:40Z,use_quota=True,user_id='e3df37ccd75b425b92b2ddd0c45c4aef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:51:39 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-aae2be28-ca59-485a-925e-9d5781f1aa8f tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68b462f3-e995-43ce-b407-465e66916559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:51:39 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-aae2be28-ca59-485a-925e-9d5781f1aa8f tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68b462f3-e995-43ce-b407-465e66916559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:51:39 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-aae2be28-ca59-485a-925e-9d5781f1aa8f tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee8581fc-6cf5-484c-827b-00b21b703aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:51:39 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-aae2be28-ca59-485a-925e-9d5781f1aa8f tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee8581fc-6cf5-484c-827b-00b21b703aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea425e07-190c-4a78-a001-22a58a013f15', 'volume_name': 'volume-ea425e07-190c-4a78-a001-22a58a013f15', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:51:39 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-aae2be28-ca59-485a-925e-9d5781f1aa8f tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7e21d62-64fb-4bc6-bb0f-f13738cbb723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:51:39 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-aae2be28-ca59-485a-925e-9d5781f1aa8f tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7e21d62-64fb-4bc6-bb0f-f13738cbb723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:51:39 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-aae2be28-ca59-485a-925e-9d5781f1aa8f tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fa2ba10-c223-4af5-a15e-e9de48050051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:51:39 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-aae2be28-ca59-485a-925e-9d5781f1aa8f tempest-VolumesSnapshotTestJSON-1009628386 None] Volume ea425e07-190c-4a78-a001-22a58a013f15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea425e07-190c-4a78-a001-22a58a013f15', 'volume_size': 1}
Apr 09 12:51:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-aae2be28-ca59-485a-925e-9d5781f1aa8f tempest-VolumesSnapshotTestJSON-1009628386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:51:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-aae2be28-ca59-485a-925e-9d5781f1aa8f tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:51:39 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-aae2be28-ca59-485a-925e-9d5781f1aa8f tempest-VolumesSnapshotTestJSON-1009628386 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:51:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-875309705',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea425e07-190c-4a78-a001-22a58a013f15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a57942a178c4c36b9659cdc4330dba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:51:40Z,use_quota=True,user_id='e3df37ccd75b425b92b2ddd0c45c4aef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:51:39 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-aae2be28-ca59-485a-925e-9d5781f1aa8f tempest-VolumesSnapshotTestJSON-1009628386 None] Creating volume ea425e07-190c-4a78-a001-22a58a013f15 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:51:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-aae2be28-ca59-485a-925e-9d5781f1aa8f tempest-VolumesSnapshotTestJSON-1009628386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:51:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-aae2be28-ca59-485a-925e-9d5781f1aa8f tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:51:39 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-aae2be28-ca59-485a-925e-9d5781f1aa8f tempest-VolumesSnapshotTestJSON-1009628386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:51:39 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-aae2be28-ca59-485a-925e-9d5781f1aa8f tempest-VolumesSnapshotTestJSON-1009628386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:51:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-aae2be28-ca59-485a-925e-9d5781f1aa8f tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:51:39 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-aae2be28-ca59-485a-925e-9d5781f1aa8f tempest-VolumesSnapshotTestJSON-1009628386 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:51:39 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-aae2be28-ca59-485a-925e-9d5781f1aa8f tempest-VolumesSnapshotTestJSON-1009628386 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:51:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-aae2be28-ca59-485a-925e-9d5781f1aa8f tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:39 devstack sudo[89942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15 1073741824
Apr 09 12:51:39 devstack sudo[89942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:40 devstack sudo[89942]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:40 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-aae2be28-ca59-485a-925e-9d5781f1aa8f tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15 1073741824" returned: 0 in 0.605s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:40 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-aae2be28-ca59-485a-925e-9d5781f1aa8f tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:40 devstack sudo[89947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15
Apr 09 12:51:40 devstack sudo[89947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:40 devstack sudo[89947]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:40 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-aae2be28-ca59-485a-925e-9d5781f1aa8f tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15" returned: 0 in 0.473s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:40 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-aae2be28-ca59-485a-925e-9d5781f1aa8f tempest-VolumesSnapshotTestJSON-1009628386 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:51:40 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-aae2be28-ca59-485a-925e-9d5781f1aa8f tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:51:40 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-aae2be28-ca59-485a-925e-9d5781f1aa8f tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fa2ba10-c223-4af5-a15e-e9de48050051) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea425e07-190c-4a78-a001-22a58a013f15', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:51:40 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-aae2be28-ca59-485a-925e-9d5781f1aa8f tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (649939a1-32e0-452e-8a25-ea5da5947695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:51:40 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-aae2be28-ca59-485a-925e-9d5781f1aa8f tempest-VolumesSnapshotTestJSON-1009628386 None] Volume volume-ea425e07-190c-4a78-a001-22a58a013f15 (ea425e07-190c-4a78-a001-22a58a013f15): created successfully
Apr 09 12:51:40 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-aae2be28-ca59-485a-925e-9d5781f1aa8f tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (649939a1-32e0-452e-8a25-ea5da5947695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:51:41 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-aae2be28-ca59-485a-925e-9d5781f1aa8f tempest-VolumesSnapshotTestJSON-1009628386 None] Flow 'volume_create_manager' (bb002dc5-d70e-4621-9c65-f20e03d192b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:51:41 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-aae2be28-ca59-485a-925e-9d5781f1aa8f tempest-VolumesSnapshotTestJSON-1009628386 None] Created volume successfully.
Apr 09 12:51:42 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-2c0599db-661a-418e-a16e-2d19d9890046 tempest-VolumesSnapshotTestJSON-1009628386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:51:42 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-2c0599db-661a-418e-a16e-2d19d9890046 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:51:42 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-2c0599db-661a-418e-a16e-2d19d9890046 tempest-VolumesSnapshotTestJSON-1009628386 None] Creating offline snapshot ac9af6b2-b390-42c9-927d-da69436b07b8 of volume ea425e07-190c-4a78-a001-22a58a013f15 {{(pid=82760) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 12:51:42 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae30545b-edcf-4588-a13b-216aadf90771]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:51:42 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2c0599db-661a-418e-a16e-2d19d9890046 tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:42 devstack sudo[89984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15
Apr 09 12:51:42 devstack sudo[89984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:42 devstack sudo[89984]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:42 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2c0599db-661a-418e-a16e-2d19d9890046 tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15" returned: 0 in 0.607s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:42 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2c0599db-661a-418e-a16e-2d19d9890046 tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15.ac9af6b2-b390-42c9-927d-da69436b07b8 1G {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:42 devstack sudo[89990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15.ac9af6b2-b390-42c9-927d-da69436b07b8 1G
Apr 09 12:51:42 devstack sudo[89990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:43 devstack sudo[89990]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:43 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2c0599db-661a-418e-a16e-2d19d9890046 tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15.ac9af6b2-b390-42c9-927d-da69436b07b8 1G" returned: 0 in 0.633s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:43 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2c0599db-661a-418e-a16e-2d19d9890046 tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea425e07-190c-4a78-a001-22a58a013f15 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15.ac9af6b2-b390-42c9-927d-da69436b07b8 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:43 devstack sudo[89995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea425e07-190c-4a78-a001-22a58a013f15 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15.ac9af6b2-b390-42c9-927d-da69436b07b8
Apr 09 12:51:43 devstack sudo[89995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:43 devstack sudo[89995]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:43 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2c0599db-661a-418e-a16e-2d19d9890046 tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea425e07-190c-4a78-a001-22a58a013f15 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15.ac9af6b2-b390-42c9-927d-da69436b07b8" returned: 0 in 0.637s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:43 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-2c0599db-661a-418e-a16e-2d19d9890046 tempest-VolumesSnapshotTestJSON-1009628386 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15.ac9af6b2-b390-42c9-927d-da69436b07b8 is being set with open permissions: ugo+rw
Apr 09 12:51:43 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2c0599db-661a-418e-a16e-2d19d9890046 tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15.ac9af6b2-b390-42c9-927d-da69436b07b8 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:43 devstack sudo[90000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15.ac9af6b2-b390-42c9-927d-da69436b07b8
Apr 09 12:51:43 devstack sudo[90000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:44 devstack sudo[90000]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:44 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2c0599db-661a-418e-a16e-2d19d9890046 tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15.ac9af6b2-b390-42c9-927d-da69436b07b8" returned: 0 in 0.573s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:44 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2c0599db-661a-418e-a16e-2d19d9890046 tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:44 devstack sudo[90003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15.info
Apr 09 12:51:44 devstack sudo[90003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:45 devstack sudo[90003]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:45 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2c0599db-661a-418e-a16e-2d19d9890046 tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15.info" returned: 0 in 0.530s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:45 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-2c0599db-661a-418e-a16e-2d19d9890046 tempest-VolumesSnapshotTestJSON-1009628386 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15.info is being set with open permissions: ugo+rw
Apr 09 12:51:45 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2c0599db-661a-418e-a16e-2d19d9890046 tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:45 devstack sudo[90006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15.info
Apr 09 12:51:45 devstack sudo[90006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:45 devstack sudo[90006]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:45 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2c0599db-661a-418e-a16e-2d19d9890046 tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15.info" returned: 0 in 0.484s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:45 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-2c0599db-661a-418e-a16e-2d19d9890046 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.539s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:51:45 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-2c0599db-661a-418e-a16e-2d19d9890046 tempest-VolumesSnapshotTestJSON-1009628386 None] Create snapshot completed successfully
Apr 09 12:51:46 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-d20ec26d-7937-491f-ac6f-a7fc9fb41bb8 tempest-VolumesSnapshotTestJSON-1009628386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:51:46 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d20ec26d-7937-491f-ac6f-a7fc9fb41bb8 tempest-VolumesSnapshotTestJSON-1009628386 None] Flow 'volume_create_manager' (1209d558-2d70-45a1-9db5-2f475cf697bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:51:46 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d20ec26d-7937-491f-ac6f-a7fc9fb41bb8 tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06897142-4e10-42e9-9dfd-ae8533016b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:51:46 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d20ec26d-7937-491f-ac6f-a7fc9fb41bb8 tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06897142-4e10-42e9-9dfd-ae8533016b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:51:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2085718144',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b14ebc5-14cd-4dcf-b453-8452c405676c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a57942a178c4c36b9659cdc4330dba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:51:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ac9af6b2-b390-42c9-927d-da69436b07b8,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:51:47Z,use_quota=True,user_id='e3df37ccd75b425b92b2ddd0c45c4aef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:51:46 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d20ec26d-7937-491f-ac6f-a7fc9fb41bb8 tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (895becef-6c0e-4470-b25b-6e4c26b527db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:51:46 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d20ec26d-7937-491f-ac6f-a7fc9fb41bb8 tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (895becef-6c0e-4470-b25b-6e4c26b527db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:51:46 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d20ec26d-7937-491f-ac6f-a7fc9fb41bb8 tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62d41e0e-23d4-4a40-a77f-b36c3cb2e39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:51:46 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d20ec26d-7937-491f-ac6f-a7fc9fb41bb8 tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62d41e0e-23d4-4a40-a77f-b36c3cb2e39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7b14ebc5-14cd-4dcf-b453-8452c405676c', 'volume_name': 'volume-7b14ebc5-14cd-4dcf-b453-8452c405676c', 'volume_size': 1, 'snapshot_id': 'ac9af6b2-b390-42c9-927d-da69436b07b8'}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:51:46 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d20ec26d-7937-491f-ac6f-a7fc9fb41bb8 tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25bbf49e-8fc5-42da-84ad-a66351b1e92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:51:46 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d20ec26d-7937-491f-ac6f-a7fc9fb41bb8 tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25bbf49e-8fc5-42da-84ad-a66351b1e92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:51:46 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d20ec26d-7937-491f-ac6f-a7fc9fb41bb8 tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfb1f9e2-2438-4f4c-94fa-c6783b10a3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:51:46 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-d20ec26d-7937-491f-ac6f-a7fc9fb41bb8 tempest-VolumesSnapshotTestJSON-1009628386 None] Volume 7b14ebc5-14cd-4dcf-b453-8452c405676c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7b14ebc5-14cd-4dcf-b453-8452c405676c', 'volume_size': 1, 'snapshot_id': 'ac9af6b2-b390-42c9-927d-da69436b07b8'}
Apr 09 12:51:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d20ec26d-7937-491f-ac6f-a7fc9fb41bb8 tempest-VolumesSnapshotTestJSON-1009628386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:51:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d20ec26d-7937-491f-ac6f-a7fc9fb41bb8 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:51:46 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-d20ec26d-7937-491f-ac6f-a7fc9fb41bb8 tempest-VolumesSnapshotTestJSON-1009628386 None] Acquiring lock "cinder-quobyte-ac9af6b2-b390-42c9-927d-da69436b07b8-7b14ebc5-14cd-4dcf-b453-8452c405676c" by "_create_volume_from_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:51:46 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-d20ec26d-7937-491f-ac6f-a7fc9fb41bb8 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "cinder-quobyte-ac9af6b2-b390-42c9-927d-da69436b07b8-7b14ebc5-14cd-4dcf-b453-8452c405676c" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:51:46 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-d20ec26d-7937-491f-ac6f-a7fc9fb41bb8 tempest-VolumesSnapshotTestJSON-1009628386 None] Creating volume 7b14ebc5-14cd-4dcf-b453-8452c405676c from snapshot ac9af6b2-b390-42c9-927d-da69436b07b8 {{(pid=82760) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 09 12:51:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d20ec26d-7937-491f-ac6f-a7fc9fb41bb8 tempest-VolumesSnapshotTestJSON-1009628386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:51:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d20ec26d-7937-491f-ac6f-a7fc9fb41bb8 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:51:46 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-d20ec26d-7937-491f-ac6f-a7fc9fb41bb8 tempest-VolumesSnapshotTestJSON-1009628386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:51:46 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-d20ec26d-7937-491f-ac6f-a7fc9fb41bb8 tempest-VolumesSnapshotTestJSON-1009628386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:51:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d20ec26d-7937-491f-ac6f-a7fc9fb41bb8 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:51:46 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-d20ec26d-7937-491f-ac6f-a7fc9fb41bb8 tempest-VolumesSnapshotTestJSON-1009628386 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:51:46 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-d20ec26d-7937-491f-ac6f-a7fc9fb41bb8 tempest-VolumesSnapshotTestJSON-1009628386 None] Acquiring lock "cinder-quobyte-7b14ebc5-14cd-4dcf-b453-8452c405676c" by "_copy_volume_from_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:51:46 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-d20ec26d-7937-491f-ac6f-a7fc9fb41bb8 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "cinder-quobyte-7b14ebc5-14cd-4dcf-b453-8452c405676c" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:51:46 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-d20ec26d-7937-491f-ac6f-a7fc9fb41bb8 tempest-VolumesSnapshotTestJSON-1009628386 None] snapshot: ac9af6b2-b390-42c9-927d-da69436b07b8, volume: 7b14ebc5-14cd-4dcf-b453-8452c405676c,  {{(pid=82760) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 09 12:51:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d20ec26d-7937-491f-ac6f-a7fc9fb41bb8 tempest-VolumesSnapshotTestJSON-1009628386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:51:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d20ec26d-7937-491f-ac6f-a7fc9fb41bb8 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:51:46 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-d20ec26d-7937-491f-ac6f-a7fc9fb41bb8 tempest-VolumesSnapshotTestJSON-1009628386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:51:46 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-d20ec26d-7937-491f-ac6f-a7fc9fb41bb8 tempest-VolumesSnapshotTestJSON-1009628386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:51:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d20ec26d-7937-491f-ac6f-a7fc9fb41bb8 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:51:46 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[06bb1186-9136-4b1c-8c33-d4e7d4853f8f]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:51:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d20ec26d-7937-491f-ac6f-a7fc9fb41bb8 tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15.ac9af6b2-b390-42c9-927d-da69436b07b8 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:46 devstack sudo[90009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15.ac9af6b2-b390-42c9-927d-da69436b07b8
Apr 09 12:51:46 devstack sudo[90009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:47 devstack sudo[90009]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:47 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d20ec26d-7937-491f-ac6f-a7fc9fb41bb8 tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15.ac9af6b2-b390-42c9-927d-da69436b07b8" returned: 0 in 0.636s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:47 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-d20ec26d-7937-491f-ac6f-a7fc9fb41bb8 tempest-VolumesSnapshotTestJSON-1009628386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea425e07-190c-4a78-a001-22a58a013f15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:51:47 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-d20ec26d-7937-491f-ac6f-a7fc9fb41bb8 tempest-VolumesSnapshotTestJSON-1009628386 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15 {{(pid=82760) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 09 12:51:47 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-d20ec26d-7937-491f-ac6f-a7fc9fb41bb8 tempest-VolumesSnapshotTestJSON-1009628386 None] Creating direct copy from snapshot {{(pid=82760) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 09 12:51:47 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc17d36-8796-47d0-a37d-3230a1eda82a]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:51:47 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d20ec26d-7937-491f-ac6f-a7fc9fb41bb8 tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:47 devstack sudo[90014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15
Apr 09 12:51:47 devstack sudo[90014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:48 devstack sudo[90014]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:48 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d20ec26d-7937-491f-ac6f-a7fc9fb41bb8 tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15" returned: 0 in 0.623s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:48 devstack cinder-volume[82760]: DEBUG cinder.utils [None req-d20ec26d-7937-491f-ac6f-a7fc9fb41bb8 tempest-VolumesSnapshotTestJSON-1009628386 None] Path /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7b14ebc5-14cd-4dcf-b453-8452c405676c not found in is_blk_device check {{(pid=82760) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 09 12:51:48 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d20ec26d-7937-491f-ac6f-a7fc9fb41bb8 tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7b14ebc5-14cd-4dcf-b453-8452c405676c {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:48 devstack sudo[90019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7b14ebc5-14cd-4dcf-b453-8452c405676c
Apr 09 12:51:48 devstack sudo[90019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:50 devstack sudo[90019]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d20ec26d-7937-491f-ac6f-a7fc9fb41bb8 tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7b14ebc5-14cd-4dcf-b453-8452c405676c" returned: 0 in 2.571s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:50 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[67845e8d-d77a-43f3-acd1-68d478373ee5]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:51:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d20ec26d-7937-491f-ac6f-a7fc9fb41bb8 tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:50 devstack sudo[90031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15
Apr 09 12:51:50 devstack sudo[90031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:51 devstack sudo[90031]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d20ec26d-7937-491f-ac6f-a7fc9fb41bb8 tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15" returned: 0 in 0.739s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:51 devstack cinder-volume[82760]: DEBUG cinder.image.image_utils [None req-d20ec26d-7937-491f-ac6f-a7fc9fb41bb8 tempest-VolumesSnapshotTestJSON-1009628386 None] Image conversion details: src /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15, size 1024.00 MB, duration 2.57 sec, destination /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7b14ebc5-14cd-4dcf-b453-8452c405676c {{(pid=82760) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 12:51:51 devstack cinder-volume[82760]: INFO cinder.image.image_utils [None req-d20ec26d-7937-491f-ac6f-a7fc9fb41bb8 tempest-VolumesSnapshotTestJSON-1009628386 None] Converted 1024.00 MB image at 397.86 MB/s
Apr 09 12:51:51 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-d20ec26d-7937-491f-ac6f-a7fc9fb41bb8 tempest-VolumesSnapshotTestJSON-1009628386 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7b14ebc5-14cd-4dcf-b453-8452c405676c is being set with open permissions: ugo+rw
Apr 09 12:51:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d20ec26d-7937-491f-ac6f-a7fc9fb41bb8 tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7b14ebc5-14cd-4dcf-b453-8452c405676c {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:51 devstack sudo[90036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7b14ebc5-14cd-4dcf-b453-8452c405676c
Apr 09 12:51:51 devstack sudo[90036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:51 devstack sudo[90036]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d20ec26d-7937-491f-ac6f-a7fc9fb41bb8 tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7b14ebc5-14cd-4dcf-b453-8452c405676c" returned: 0 in 0.609s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:51 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-d20ec26d-7937-491f-ac6f-a7fc9fb41bb8 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "cinder-quobyte-7b14ebc5-14cd-4dcf-b453-8452c405676c" released by "_copy_volume_from_snapshot" :: held 5.266s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:51:51 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-d20ec26d-7937-491f-ac6f-a7fc9fb41bb8 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "cinder-quobyte-ac9af6b2-b390-42c9-927d-da69436b07b8-7b14ebc5-14cd-4dcf-b453-8452c405676c" released by "_create_volume_from_snapshot" :: held 5.291s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:51:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d20ec26d-7937-491f-ac6f-a7fc9fb41bb8 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.300s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:51:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d20ec26d-7937-491f-ac6f-a7fc9fb41bb8 tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfb1f9e2-2438-4f4c-94fa-c6783b10a3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b14ebc5-14cd-4dcf-b453-8452c405676c', 'volume_size': 1, 'snapshot_id': 'ac9af6b2-b390-42c9-927d-da69436b07b8'}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:51:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d20ec26d-7937-491f-ac6f-a7fc9fb41bb8 tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d99d1d89-8f84-4e51-8172-64c299393b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:51:52 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-d20ec26d-7937-491f-ac6f-a7fc9fb41bb8 tempest-VolumesSnapshotTestJSON-1009628386 None] Volume volume-7b14ebc5-14cd-4dcf-b453-8452c405676c (7b14ebc5-14cd-4dcf-b453-8452c405676c): created successfully
Apr 09 12:51:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d20ec26d-7937-491f-ac6f-a7fc9fb41bb8 tempest-VolumesSnapshotTestJSON-1009628386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d99d1d89-8f84-4e51-8172-64c299393b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:51:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d20ec26d-7937-491f-ac6f-a7fc9fb41bb8 tempest-VolumesSnapshotTestJSON-1009628386 None] Flow 'volume_create_manager' (1209d558-2d70-45a1-9db5-2f475cf697bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:51:52 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-d20ec26d-7937-491f-ac6f-a7fc9fb41bb8 tempest-VolumesSnapshotTestJSON-1009628386 None] Created volume successfully.
Apr 09 12:51:53 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-50e46ce5-fc22-4dd2-a920-6ac8c287d63f tempest-VolumesSnapshotTestJSON-1009628386 None] Acquiring lock "cinder-7b14ebc5-14cd-4dcf-b453-8452c405676c-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:51:53 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-50e46ce5-fc22-4dd2-a920-6ac8c287d63f tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "cinder-7b14ebc5-14cd-4dcf-b453-8452c405676c-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:51:53 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-50e46ce5-fc22-4dd2-a920-6ac8c287d63f tempest-VolumesSnapshotTestJSON-1009628386 None] Acquiring lock "cinder-quobyte-7b14ebc5-14cd-4dcf-b453-8452c405676c" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:51:53 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-50e46ce5-fc22-4dd2-a920-6ac8c287d63f tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "cinder-quobyte-7b14ebc5-14cd-4dcf-b453-8452c405676c" acquired by "delete_volume" :: waited 0.010s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:51:53 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac3f3f4-5949-4dd4-94bf-e91e85eb525a]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:51:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-50e46ce5-fc22-4dd2-a920-6ac8c287d63f tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7b14ebc5-14cd-4dcf-b453-8452c405676c {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:53 devstack sudo[90040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7b14ebc5-14cd-4dcf-b453-8452c405676c
Apr 09 12:51:53 devstack sudo[90040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:53 devstack sudo[90040]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-50e46ce5-fc22-4dd2-a920-6ac8c287d63f tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7b14ebc5-14cd-4dcf-b453-8452c405676c" returned: 0 in 0.618s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-50e46ce5-fc22-4dd2-a920-6ac8c287d63f tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7b14ebc5-14cd-4dcf-b453-8452c405676c {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:53 devstack sudo[90045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7b14ebc5-14cd-4dcf-b453-8452c405676c
Apr 09 12:51:53 devstack sudo[90045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:54 devstack sudo[90045]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-50e46ce5-fc22-4dd2-a920-6ac8c287d63f tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-7b14ebc5-14cd-4dcf-b453-8452c405676c" returned: 0 in 0.569s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:54 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-50e46ce5-fc22-4dd2-a920-6ac8c287d63f tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "cinder-quobyte-7b14ebc5-14cd-4dcf-b453-8452c405676c" released by "delete_volume" :: held 1.224s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:51:54 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-50e46ce5-fc22-4dd2-a920-6ac8c287d63f tempest-VolumesSnapshotTestJSON-1009628386 None] Created reservations ['f415318d-e8b2-4799-a6bf-d0eaff238d9a', 'c7e21a9a-1632-4fe8-bba8-52d886db49c8', 'ad75ef31-ae6a-409e-a84e-6dfd0c74f275', 'b2ef5523-032f-49c3-b3cd-13b7ae6f1c77'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:51:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-50e46ce5-fc22-4dd2-a920-6ac8c287d63f tempest-VolumesSnapshotTestJSON-1009628386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:51:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-50e46ce5-fc22-4dd2-a920-6ac8c287d63f tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:51:54 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-50e46ce5-fc22-4dd2-a920-6ac8c287d63f tempest-VolumesSnapshotTestJSON-1009628386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:51:54 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-50e46ce5-fc22-4dd2-a920-6ac8c287d63f tempest-VolumesSnapshotTestJSON-1009628386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:51:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-50e46ce5-fc22-4dd2-a920-6ac8c287d63f tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:51:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-50e46ce5-fc22-4dd2-a920-6ac8c287d63f tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:54 devstack sudo[90048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:51:54 devstack sudo[90048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:55 devstack sudo[90048]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-50e46ce5-fc22-4dd2-a920-6ac8c287d63f tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.554s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:55 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-50e46ce5-fc22-4dd2-a920-6ac8c287d63f tempest-VolumesSnapshotTestJSON-1009628386 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:51:55 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-50e46ce5-fc22-4dd2-a920-6ac8c287d63f tempest-VolumesSnapshotTestJSON-1009628386 None] Deleted volume successfully.
Apr 09 12:51:55 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-50e46ce5-fc22-4dd2-a920-6ac8c287d63f tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "cinder-7b14ebc5-14cd-4dcf-b453-8452c405676c-delete_volume" released by "delete_volume" :: held 1.965s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:51:55 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-09c4711f-14ce-4eb2-9c6e-7af542a2d0e0 tempest-VolumesSnapshotTestJSON-1009628386 None] Acquiring lock "cinder-ac9af6b2-b390-42c9-927d-da69436b07b8-delete_snapshot" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:51:55 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-09c4711f-14ce-4eb2-9c6e-7af542a2d0e0 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "cinder-ac9af6b2-b390-42c9-927d-da69436b07b8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:51:55 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-09c4711f-14ce-4eb2-9c6e-7af542a2d0e0 tempest-VolumesSnapshotTestJSON-1009628386 None] Acquiring lock "cinder-quobyte-ea425e07-190c-4a78-a001-22a58a013f15" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:51:55 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-09c4711f-14ce-4eb2-9c6e-7af542a2d0e0 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "cinder-quobyte-ea425e07-190c-4a78-a001-22a58a013f15" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:51:55 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-09c4711f-14ce-4eb2-9c6e-7af542a2d0e0 tempest-VolumesSnapshotTestJSON-1009628386 None] Acquiring lock "cinder-quobyte-ac9af6b2-b390-42c9-927d-da69436b07b8" by "_delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:51:55 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-09c4711f-14ce-4eb2-9c6e-7af542a2d0e0 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "cinder-quobyte-ac9af6b2-b390-42c9-927d-da69436b07b8" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:51:55 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-09c4711f-14ce-4eb2-9c6e-7af542a2d0e0 tempest-VolumesSnapshotTestJSON-1009628386 None] Deleting offline snapshot ac9af6b2-b390-42c9-927d-da69436b07b8 of volume ea425e07-190c-4a78-a001-22a58a013f15 {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 12:51:55 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-09c4711f-14ce-4eb2-9c6e-7af542a2d0e0 tempest-VolumesSnapshotTestJSON-1009628386 None] snapshot_file for this snap is: volume-ea425e07-190c-4a78-a001-22a58a013f15.ac9af6b2-b390-42c9-927d-da69436b07b8 {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 12:51:55 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f28c53-2a8f-47c9-8480-8adb458d661e]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:51:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-09c4711f-14ce-4eb2-9c6e-7af542a2d0e0 tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15.ac9af6b2-b390-42c9-927d-da69436b07b8 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:55 devstack sudo[90051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15.ac9af6b2-b390-42c9-927d-da69436b07b8
Apr 09 12:51:55 devstack sudo[90051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:56 devstack sudo[90051]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-09c4711f-14ce-4eb2-9c6e-7af542a2d0e0 tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15.ac9af6b2-b390-42c9-927d-da69436b07b8" returned: 0 in 0.691s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:56 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-09c4711f-14ce-4eb2-9c6e-7af542a2d0e0 tempest-VolumesSnapshotTestJSON-1009628386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea425e07-190c-4a78-a001-22a58a013f15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:51:56 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[0963064b-ec9b-437f-b953-f00e94e71d51]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:51:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-09c4711f-14ce-4eb2-9c6e-7af542a2d0e0 tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:56 devstack sudo[90056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15
Apr 09 12:51:56 devstack sudo[90056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:57 devstack sudo[90056]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-09c4711f-14ce-4eb2-9c6e-7af542a2d0e0 tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15" returned: 0 in 0.735s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-09c4711f-14ce-4eb2-9c6e-7af542a2d0e0 tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15.ac9af6b2-b390-42c9-927d-da69436b07b8 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:57 devstack sudo[90062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15.ac9af6b2-b390-42c9-927d-da69436b07b8
Apr 09 12:51:57 devstack sudo[90062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:57 devstack sudo[90062]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-09c4711f-14ce-4eb2-9c6e-7af542a2d0e0 tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15.ac9af6b2-b390-42c9-927d-da69436b07b8" returned: 0 in 0.573s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-09c4711f-14ce-4eb2-9c6e-7af542a2d0e0 tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15.ac9af6b2-b390-42c9-927d-da69436b07b8 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:57 devstack sudo[90067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15.ac9af6b2-b390-42c9-927d-da69436b07b8
Apr 09 12:51:57 devstack sudo[90067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:58 devstack sudo[90067]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-09c4711f-14ce-4eb2-9c6e-7af542a2d0e0 tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15.ac9af6b2-b390-42c9-927d-da69436b07b8" returned: 0 in 0.520s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:58 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-09c4711f-14ce-4eb2-9c6e-7af542a2d0e0 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "cinder-quobyte-ac9af6b2-b390-42c9-927d-da69436b07b8" released by "_delete_snapshot" :: held 2.606s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:51:58 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-09c4711f-14ce-4eb2-9c6e-7af542a2d0e0 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "cinder-quobyte-ea425e07-190c-4a78-a001-22a58a013f15" released by "delete_snapshot" :: held 2.623s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:51:58 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-09c4711f-14ce-4eb2-9c6e-7af542a2d0e0 tempest-VolumesSnapshotTestJSON-1009628386 None] Created reservations ['6f769092-c1c0-4306-8bc9-98619d3fd43a', 'ed28ba1e-4d8c-4669-a6ce-c1b285a4dd86', 'f5957fa3-60db-4f30-8951-dedf70c726d1', 'dadca76a-9800-4b52-8cc5-6088a5348aef'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:51:58 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-09c4711f-14ce-4eb2-9c6e-7af542a2d0e0 tempest-VolumesSnapshotTestJSON-1009628386 None] Delete snapshot completed successfully.
Apr 09 12:51:58 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-09c4711f-14ce-4eb2-9c6e-7af542a2d0e0 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "cinder-ac9af6b2-b390-42c9-927d-da69436b07b8-delete_snapshot" released by "delete_snapshot" :: held 2.726s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:51:58 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-8548759b-cada-4852-a1ca-8b111285ed62 tempest-VolumesSnapshotTestJSON-1009628386 None] Acquiring lock "cinder-ea425e07-190c-4a78-a001-22a58a013f15-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:51:58 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-8548759b-cada-4852-a1ca-8b111285ed62 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "cinder-ea425e07-190c-4a78-a001-22a58a013f15-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:51:58 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-8548759b-cada-4852-a1ca-8b111285ed62 tempest-VolumesSnapshotTestJSON-1009628386 None] Acquiring lock "cinder-quobyte-ea425e07-190c-4a78-a001-22a58a013f15" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:51:58 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-8548759b-cada-4852-a1ca-8b111285ed62 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "cinder-quobyte-ea425e07-190c-4a78-a001-22a58a013f15" acquired by "delete_volume" :: waited 0.014s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:51:58 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[d488623e-853f-42c6-84dc-c7aff01118a3]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:51:58 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-8548759b-cada-4852-a1ca-8b111285ed62 tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:58 devstack sudo[90070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15
Apr 09 12:51:58 devstack sudo[90070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:51:59 devstack sudo[90070]: pam_unix(sudo:session): session closed for user root
Apr 09 12:51:59 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-8548759b-cada-4852-a1ca-8b111285ed62 tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15" returned: 0 in 0.762s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:51:59 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-8548759b-cada-4852-a1ca-8b111285ed62 tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:51:59 devstack sudo[90075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15
Apr 09 12:51:59 devstack sudo[90075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:00 devstack sudo[90075]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-8548759b-cada-4852-a1ca-8b111285ed62 tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-ea425e07-190c-4a78-a001-22a58a013f15" returned: 0 in 0.595s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:00 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-8548759b-cada-4852-a1ca-8b111285ed62 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "cinder-quobyte-ea425e07-190c-4a78-a001-22a58a013f15" released by "delete_volume" :: held 1.414s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:52:00 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-8548759b-cada-4852-a1ca-8b111285ed62 tempest-VolumesSnapshotTestJSON-1009628386 None] Created reservations ['d17947aa-dc64-49a4-a844-6f99baa21fbf', '8c289dc2-3af8-4b4a-b3b8-fb7bf9ad7fbe', '05d7a5ad-b5ca-4952-a399-ceb3b8f18a43', '4e69bd17-e47e-4792-a683-aeeb4d2a517a'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:52:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-8548759b-cada-4852-a1ca-8b111285ed62 tempest-VolumesSnapshotTestJSON-1009628386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-8548759b-cada-4852-a1ca-8b111285ed62 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:52:00 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-8548759b-cada-4852-a1ca-8b111285ed62 tempest-VolumesSnapshotTestJSON-1009628386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:52:00 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-8548759b-cada-4852-a1ca-8b111285ed62 tempest-VolumesSnapshotTestJSON-1009628386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:52:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-8548759b-cada-4852-a1ca-8b111285ed62 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:52:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-8548759b-cada-4852-a1ca-8b111285ed62 tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:00 devstack sudo[90080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:52:00 devstack sudo[90080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:00 devstack sudo[90080]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-8548759b-cada-4852-a1ca-8b111285ed62 tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.582s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:00 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-8548759b-cada-4852-a1ca-8b111285ed62 tempest-VolumesSnapshotTestJSON-1009628386 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:52:00 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-8548759b-cada-4852-a1ca-8b111285ed62 tempest-VolumesSnapshotTestJSON-1009628386 None] Deleted volume successfully.
Apr 09 12:52:00 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-8548759b-cada-4852-a1ca-8b111285ed62 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "cinder-ea425e07-190c-4a78-a001-22a58a013f15-delete_volume" released by "delete_volume" :: held 2.202s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:52:01 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-e58ee866-7437-4fa0-bbf8-f8210ff4c8a7 tempest-VolumesSnapshotTestJSON-1009628386 None] Acquiring lock "cinder-8c460d75-189d-4352-b006-4ff355a29e10-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:52:01 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-e58ee866-7437-4fa0-bbf8-f8210ff4c8a7 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "cinder-8c460d75-189d-4352-b006-4ff355a29e10-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:52:01 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-e58ee866-7437-4fa0-bbf8-f8210ff4c8a7 tempest-VolumesSnapshotTestJSON-1009628386 None] Acquiring lock "cinder-quobyte-8c460d75-189d-4352-b006-4ff355a29e10" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:52:01 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-e58ee866-7437-4fa0-bbf8-f8210ff4c8a7 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "cinder-quobyte-8c460d75-189d-4352-b006-4ff355a29e10" acquired by "delete_volume" :: waited 0.013s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:52:01 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a78c36-790f-4ed8-b35c-0691adfbf16e]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:52:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e58ee866-7437-4fa0-bbf8-f8210ff4c8a7 tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8c460d75-189d-4352-b006-4ff355a29e10 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:01 devstack sudo[90083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8c460d75-189d-4352-b006-4ff355a29e10
Apr 09 12:52:01 devstack sudo[90083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:01 devstack sudo[90083]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e58ee866-7437-4fa0-bbf8-f8210ff4c8a7 tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8c460d75-189d-4352-b006-4ff355a29e10" returned: 0 in 0.564s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e58ee866-7437-4fa0-bbf8-f8210ff4c8a7 tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8c460d75-189d-4352-b006-4ff355a29e10 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:01 devstack sudo[90088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8c460d75-189d-4352-b006-4ff355a29e10
Apr 09 12:52:01 devstack sudo[90088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:02 devstack sudo[90088]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e58ee866-7437-4fa0-bbf8-f8210ff4c8a7 tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-8c460d75-189d-4352-b006-4ff355a29e10" returned: 0 in 0.619s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:02 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-e58ee866-7437-4fa0-bbf8-f8210ff4c8a7 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "cinder-quobyte-8c460d75-189d-4352-b006-4ff355a29e10" released by "delete_volume" :: held 1.238s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:52:02 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-e58ee866-7437-4fa0-bbf8-f8210ff4c8a7 tempest-VolumesSnapshotTestJSON-1009628386 None] Created reservations ['dc5fe9f4-2b04-4237-9d5d-5fafd79ddf6b', '23cd9811-dbd0-4f4d-ae2c-8d8f3e58baaa', '201ee807-1e5c-4bf7-b1b7-66f742a57095', '7102ce35-22ff-421c-907d-3b0a5ee415d1'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:52:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-e58ee866-7437-4fa0-bbf8-f8210ff4c8a7 tempest-VolumesSnapshotTestJSON-1009628386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-e58ee866-7437-4fa0-bbf8-f8210ff4c8a7 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:52:02 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-e58ee866-7437-4fa0-bbf8-f8210ff4c8a7 tempest-VolumesSnapshotTestJSON-1009628386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:52:02 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-e58ee866-7437-4fa0-bbf8-f8210ff4c8a7 tempest-VolumesSnapshotTestJSON-1009628386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:52:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-e58ee866-7437-4fa0-bbf8-f8210ff4c8a7 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:52:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e58ee866-7437-4fa0-bbf8-f8210ff4c8a7 tempest-VolumesSnapshotTestJSON-1009628386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:02 devstack sudo[90092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:52:02 devstack sudo[90092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:03 devstack sudo[90092]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e58ee866-7437-4fa0-bbf8-f8210ff4c8a7 tempest-VolumesSnapshotTestJSON-1009628386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.563s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:03 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-e58ee866-7437-4fa0-bbf8-f8210ff4c8a7 tempest-VolumesSnapshotTestJSON-1009628386 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:52:03 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-e58ee866-7437-4fa0-bbf8-f8210ff4c8a7 tempest-VolumesSnapshotTestJSON-1009628386 None] Deleted volume successfully.
Apr 09 12:52:03 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-e58ee866-7437-4fa0-bbf8-f8210ff4c8a7 tempest-VolumesSnapshotTestJSON-1009628386 None] Lock "cinder-8c460d75-189d-4352-b006-4ff355a29e10-delete_volume" released by "delete_volume" :: held 2.031s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:52:09 devstack cinder-volume[82760]: DEBUG oslo_service.periodic_task [None req-f8337202-8290-4658-916e-19cfa929172e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82760) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 09 12:52:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f8337202-8290-4658-916e-19cfa929172e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f8337202-8290-4658-916e-19cfa929172e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:52:09 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f8337202-8290-4658-916e-19cfa929172e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:52:09 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f8337202-8290-4658-916e-19cfa929172e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:52:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f8337202-8290-4658-916e-19cfa929172e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:52:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f8337202-8290-4658-916e-19cfa929172e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:09 devstack sudo[90123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:52:09 devstack sudo[90123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:09 devstack sudo[90123]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f8337202-8290-4658-916e-19cfa929172e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.582s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:09 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-f8337202-8290-4658-916e-19cfa929172e None None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:52:12 devstack cinder-volume[82760]: DEBUG dbcounter [-] [82760] Writing DB stats cinder:SELECT=57,cinder:INSERT=20,cinder:UPDATE=60,cinder:DELETE=8 {{(pid=82760) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 12:52:13 devstack cinder-volume[82760]: DEBUG dbcounter [-] [82760] Writing DB stats cinder:UPDATE=61,cinder:SELECT=39,cinder:INSERT=11,cinder:DELETE=2 {{(pid=82760) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 12:52:14 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-e75f9558-a8c5-4524-b2ae-a376ebac601c tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:52:14 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-e75f9558-a8c5-4524-b2ae-a376ebac601c tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Flow 'volume_create_manager' (a38f0074-023c-4ebd-b673-40543418892a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:52:14 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-e75f9558-a8c5-4524-b2ae-a376ebac601c tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69634dcb-1654-4e69-8df0-e1bac5853e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:14 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-e75f9558-a8c5-4524-b2ae-a376ebac601c tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69634dcb-1654-4e69-8df0-e1bac5853e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1413276368',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6327d09b-d0ce-4f6a-9278-bc4d06d6612b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df612b6d131c4d48b768abf0247ac87a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:52:14Z,use_quota=True,user_id='d7fd92b2d9f3439c9017bd9624e1c50a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:14 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-e75f9558-a8c5-4524-b2ae-a376ebac601c tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10f1cc2d-f120-468e-bf34-5264ccf30b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:14 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-e75f9558-a8c5-4524-b2ae-a376ebac601c tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10f1cc2d-f120-468e-bf34-5264ccf30b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:14 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-e75f9558-a8c5-4524-b2ae-a376ebac601c tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbe12b0f-a332-40de-b1c7-33a7d21f1883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:14 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-e75f9558-a8c5-4524-b2ae-a376ebac601c tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbe12b0f-a332-40de-b1c7-33a7d21f1883) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6327d09b-d0ce-4f6a-9278-bc4d06d6612b', 'volume_name': 'volume-6327d09b-d0ce-4f6a-9278-bc4d06d6612b', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:14 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-e75f9558-a8c5-4524-b2ae-a376ebac601c tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecfe6e6f-3585-40e3-9f6f-41e5e5739e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:14 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-e75f9558-a8c5-4524-b2ae-a376ebac601c tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecfe6e6f-3585-40e3-9f6f-41e5e5739e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:14 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-e75f9558-a8c5-4524-b2ae-a376ebac601c tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74c21da1-347c-47f9-a4b7-7fad8cfc8cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:14 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-e75f9558-a8c5-4524-b2ae-a376ebac601c tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Volume 6327d09b-d0ce-4f6a-9278-bc4d06d6612b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6327d09b-d0ce-4f6a-9278-bc4d06d6612b', 'volume_size': 1}
Apr 09 12:52:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-e75f9558-a8c5-4524-b2ae-a376ebac601c tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-e75f9558-a8c5-4524-b2ae-a376ebac601c tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:52:14 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-e75f9558-a8c5-4524-b2ae-a376ebac601c tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1413276368',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6327d09b-d0ce-4f6a-9278-bc4d06d6612b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df612b6d131c4d48b768abf0247ac87a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:52:14Z,use_quota=True,user_id='d7fd92b2d9f3439c9017bd9624e1c50a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:52:14 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-e75f9558-a8c5-4524-b2ae-a376ebac601c tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Creating volume 6327d09b-d0ce-4f6a-9278-bc4d06d6612b {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:52:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-e75f9558-a8c5-4524-b2ae-a376ebac601c tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-e75f9558-a8c5-4524-b2ae-a376ebac601c tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:52:14 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-e75f9558-a8c5-4524-b2ae-a376ebac601c tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:52:14 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-e75f9558-a8c5-4524-b2ae-a376ebac601c tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:52:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-e75f9558-a8c5-4524-b2ae-a376ebac601c tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:52:14 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-e75f9558-a8c5-4524-b2ae-a376ebac601c tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:52:14 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-e75f9558-a8c5-4524-b2ae-a376ebac601c tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:52:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e75f9558-a8c5-4524-b2ae-a376ebac601c tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6327d09b-d0ce-4f6a-9278-bc4d06d6612b 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:14 devstack sudo[90142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6327d09b-d0ce-4f6a-9278-bc4d06d6612b 1073741824
Apr 09 12:52:14 devstack sudo[90142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:15 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d59f997-3bdc-4f5a-bfcb-5a1eb2c25302 tempest-CreateVolumesFromImageTest-576799979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:52:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-3d59f997-3bdc-4f5a-bfcb-5a1eb2c25302 tempest-CreateVolumesFromImageTest-576799979 None] Flow 'volume_create_manager' (5d9f516f-a097-4f45-a53a-7fbe66e4304a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:52:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-3d59f997-3bdc-4f5a-bfcb-5a1eb2c25302 tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc447242-dfb7-4053-9d5e-c16dd84deef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-3d59f997-3bdc-4f5a-bfcb-5a1eb2c25302 tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc447242-dfb7-4053-9d5e-c16dd84deef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:52:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1177064009',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=409664e9-d46c-4467-83a6-8ab291309ca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b5bc8deea79461a8035a2712c7b245c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:52:15Z,use_quota=True,user_id='2e60bdf66bed4f64853301da0990b9db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-3d59f997-3bdc-4f5a-bfcb-5a1eb2c25302 tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61cd56b9-f33c-41cd-8672-9111186919bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-3d59f997-3bdc-4f5a-bfcb-5a1eb2c25302 tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61cd56b9-f33c-41cd-8672-9111186919bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-3d59f997-3bdc-4f5a-bfcb-5a1eb2c25302 tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08a2c2f8-4934-413d-941f-49115af2892d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-3d59f997-3bdc-4f5a-bfcb-5a1eb2c25302 tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08a2c2f8-4934-413d-941f-49115af2892d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '409664e9-d46c-4467-83a6-8ab291309ca8', 'volume_name': 'volume-409664e9-d46c-4467-83a6-8ab291309ca8', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-3d59f997-3bdc-4f5a-bfcb-5a1eb2c25302 tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25e6be64-5c7a-4aec-b3a9-04e4b549496f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-3d59f997-3bdc-4f5a-bfcb-5a1eb2c25302 tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25e6be64-5c7a-4aec-b3a9-04e4b549496f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-3d59f997-3bdc-4f5a-bfcb-5a1eb2c25302 tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e8f5898-b69f-4ec7-a5f3-a01483268f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:15 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-3d59f997-3bdc-4f5a-bfcb-5a1eb2c25302 tempest-CreateVolumesFromImageTest-576799979 None] Volume 409664e9-d46c-4467-83a6-8ab291309ca8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-409664e9-d46c-4467-83a6-8ab291309ca8', 'volume_size': 1}
Apr 09 12:52:15 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-3d59f997-3bdc-4f5a-bfcb-5a1eb2c25302 tempest-CreateVolumesFromImageTest-576799979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:15 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dfdf1e7-ab30-4d70-acd8-68fa16c993c3 tempest-VolumeDependencyTests-1907829774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:52:15 devstack sudo[90142]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4dfdf1e7-ab30-4d70-acd8-68fa16c993c3 tempest-VolumeDependencyTests-1907829774 None] Flow 'volume_create_manager' (7d35bd17-2d60-4751-a10a-94fd9789db63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:52:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4dfdf1e7-ab30-4d70-acd8-68fa16c993c3 tempest-VolumeDependencyTests-1907829774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c0ec87f-9f4d-4489-9e79-56066721a55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:15 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e75f9558-a8c5-4524-b2ae-a376ebac601c tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6327d09b-d0ce-4f6a-9278-bc4d06d6612b 1073741824" returned: 0 in 1.085s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4dfdf1e7-ab30-4d70-acd8-68fa16c993c3 tempest-VolumeDependencyTests-1907829774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c0ec87f-9f4d-4489-9e79-56066721a55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:52:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1789695005',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a060e331-4d69-4f9f-bc23-29b77be0199d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0ac4240c434cf2bbb5c358ac539020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:52:15Z,use_quota=True,user_id='7c5570febc704767b49e00c1d41d2df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4dfdf1e7-ab30-4d70-acd8-68fa16c993c3 tempest-VolumeDependencyTests-1907829774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcec83e8-9411-4251-a74c-000f481ac3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4dfdf1e7-ab30-4d70-acd8-68fa16c993c3 tempest-VolumeDependencyTests-1907829774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcec83e8-9411-4251-a74c-000f481ac3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4dfdf1e7-ab30-4d70-acd8-68fa16c993c3 tempest-VolumeDependencyTests-1907829774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40e91856-5502-45e7-84c2-8819a7af4774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4dfdf1e7-ab30-4d70-acd8-68fa16c993c3 tempest-VolumeDependencyTests-1907829774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40e91856-5502-45e7-84c2-8819a7af4774) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a060e331-4d69-4f9f-bc23-29b77be0199d', 'volume_name': 'volume-a060e331-4d69-4f9f-bc23-29b77be0199d', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4dfdf1e7-ab30-4d70-acd8-68fa16c993c3 tempest-VolumeDependencyTests-1907829774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f1883de-7419-4e9c-9014-a46361d822a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4dfdf1e7-ab30-4d70-acd8-68fa16c993c3 tempest-VolumeDependencyTests-1907829774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f1883de-7419-4e9c-9014-a46361d822a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4dfdf1e7-ab30-4d70-acd8-68fa16c993c3 tempest-VolumeDependencyTests-1907829774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e34c5017-570d-4bed-8c44-4c97bbd10f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:15 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-4dfdf1e7-ab30-4d70-acd8-68fa16c993c3 tempest-VolumeDependencyTests-1907829774 None] Volume a060e331-4d69-4f9f-bc23-29b77be0199d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a060e331-4d69-4f9f-bc23-29b77be0199d', 'volume_size': 1}
Apr 09 12:52:15 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-4dfdf1e7-ab30-4d70-acd8-68fa16c993c3 tempest-VolumeDependencyTests-1907829774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:15 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-2edac39d-2d3a-48b5-8114-bf040e959612 tempest-CreateVolumesFromImageTest-576799979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:52:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-2edac39d-2d3a-48b5-8114-bf040e959612 tempest-CreateVolumesFromImageTest-576799979 None] Flow 'volume_create_manager' (744ed61e-e4f3-433c-a6b4-426cfb673c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:52:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-2edac39d-2d3a-48b5-8114-bf040e959612 tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b7e68b6-7cf9-40d8-a468-283295b8da1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:15 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e75f9558-a8c5-4524-b2ae-a376ebac601c tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6327d09b-d0ce-4f6a-9278-bc4d06d6612b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-2edac39d-2d3a-48b5-8114-bf040e959612 tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b7e68b6-7cf9-40d8-a468-283295b8da1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:52:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-319198934',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04037c42-c68e-4245-8d18-ba13bd444381,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b5bc8deea79461a8035a2712c7b245c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:52:15Z,use_quota=True,user_id='2e60bdf66bed4f64853301da0990b9db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-2edac39d-2d3a-48b5-8114-bf040e959612 tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e48baf42-eaf4-4360-a15e-303cc1603ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-2edac39d-2d3a-48b5-8114-bf040e959612 tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e48baf42-eaf4-4360-a15e-303cc1603ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:15 devstack sudo[90148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6327d09b-d0ce-4f6a-9278-bc4d06d6612b
Apr 09 12:52:15 devstack sudo[90148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-2edac39d-2d3a-48b5-8114-bf040e959612 tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (847be440-52a7-4a10-ba46-9990acf1f7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-2edac39d-2d3a-48b5-8114-bf040e959612 tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (847be440-52a7-4a10-ba46-9990acf1f7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04037c42-c68e-4245-8d18-ba13bd444381', 'volume_name': 'volume-04037c42-c68e-4245-8d18-ba13bd444381', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-2edac39d-2d3a-48b5-8114-bf040e959612 tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (605dbb20-bee1-4ef9-926a-3779feaf166f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-2edac39d-2d3a-48b5-8114-bf040e959612 tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (605dbb20-bee1-4ef9-926a-3779feaf166f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-2edac39d-2d3a-48b5-8114-bf040e959612 tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e0e5bea-a33e-4597-8634-bcb97f8204b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:15 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-2edac39d-2d3a-48b5-8114-bf040e959612 tempest-CreateVolumesFromImageTest-576799979 None] Volume 04037c42-c68e-4245-8d18-ba13bd444381: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04037c42-c68e-4245-8d18-ba13bd444381', 'volume_size': 1}
Apr 09 12:52:15 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-2edac39d-2d3a-48b5-8114-bf040e959612 tempest-CreateVolumesFromImageTest-576799979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:15 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e54f1eb-4a92-4549-bbe2-a49a464e1f03 tempest-CreateVolumesFromImageTest-576799979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:52:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-3e54f1eb-4a92-4549-bbe2-a49a464e1f03 tempest-CreateVolumesFromImageTest-576799979 None] Flow 'volume_create_manager' (a2808081-0e6d-450b-ade8-32780773059a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:52:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-3e54f1eb-4a92-4549-bbe2-a49a464e1f03 tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18bba502-bbab-43a6-b594-d510ca2c6f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-3e54f1eb-4a92-4549-bbe2-a49a464e1f03 tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18bba502-bbab-43a6-b594-d510ca2c6f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:52:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1570233789',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48fbd8f4-d385-4669-8077-200b763cae2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b5bc8deea79461a8035a2712c7b245c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:52:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:52:16Z,use_quota=True,user_id='2e60bdf66bed4f64853301da0990b9db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-3e54f1eb-4a92-4549-bbe2-a49a464e1f03 tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb7143f6-e33e-4f74-a1e2-7f4b238a4947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-3e54f1eb-4a92-4549-bbe2-a49a464e1f03 tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb7143f6-e33e-4f74-a1e2-7f4b238a4947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-3e54f1eb-4a92-4549-bbe2-a49a464e1f03 tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1726771d-1bb7-4856-bd06-26f7f037e267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-3e54f1eb-4a92-4549-bbe2-a49a464e1f03 tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1726771d-1bb7-4856-bd06-26f7f037e267) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48fbd8f4-d385-4669-8077-200b763cae2d', 'volume_name': 'volume-48fbd8f4-d385-4669-8077-200b763cae2d', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-3e54f1eb-4a92-4549-bbe2-a49a464e1f03 tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37f160fd-73ec-489d-8506-c26b41a4a502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-3e54f1eb-4a92-4549-bbe2-a49a464e1f03 tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37f160fd-73ec-489d-8506-c26b41a4a502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:15 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-3e54f1eb-4a92-4549-bbe2-a49a464e1f03 tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47035076-7282-4ae1-a730-a5b13f1f17b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:15 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-3e54f1eb-4a92-4549-bbe2-a49a464e1f03 tempest-CreateVolumesFromImageTest-576799979 None] Volume 48fbd8f4-d385-4669-8077-200b763cae2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48fbd8f4-d385-4669-8077-200b763cae2d', 'volume_size': 1}
Apr 09 12:52:15 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-3e54f1eb-4a92-4549-bbe2-a49a464e1f03 tempest-CreateVolumesFromImageTest-576799979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:16 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-3668acba-12a4-4ab0-b6b9-10b9097a76f8 tempest-CreateVolumesFromImageTest-576799979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:52:16 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-3668acba-12a4-4ab0-b6b9-10b9097a76f8 tempest-CreateVolumesFromImageTest-576799979 None] Flow 'volume_create_manager' (df8adc5d-b8e0-4344-97cc-6a9f96df407c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:52:16 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-3668acba-12a4-4ab0-b6b9-10b9097a76f8 tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9139ec3-38c6-47d0-bcbd-60b4a126c972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:16 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-3668acba-12a4-4ab0-b6b9-10b9097a76f8 tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9139ec3-38c6-47d0-bcbd-60b4a126c972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:52:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1268751985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a621f6a-931a-4bb5-8426-7df78620b69e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b5bc8deea79461a8035a2712c7b245c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:52:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:52:16Z,use_quota=True,user_id='2e60bdf66bed4f64853301da0990b9db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:16 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-3668acba-12a4-4ab0-b6b9-10b9097a76f8 tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f23c6901-5416-4ba6-b170-098339154623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:16 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-3668acba-12a4-4ab0-b6b9-10b9097a76f8 tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f23c6901-5416-4ba6-b170-098339154623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:16 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-3668acba-12a4-4ab0-b6b9-10b9097a76f8 tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b4979f9-0c71-49e8-a180-9bccc0a38b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:16 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-3668acba-12a4-4ab0-b6b9-10b9097a76f8 tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b4979f9-0c71-49e8-a180-9bccc0a38b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a621f6a-931a-4bb5-8426-7df78620b69e', 'volume_name': 'volume-9a621f6a-931a-4bb5-8426-7df78620b69e', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:16 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-3668acba-12a4-4ab0-b6b9-10b9097a76f8 tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08a4c182-fbdf-47cc-b752-d884cb1453d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:16 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-3668acba-12a4-4ab0-b6b9-10b9097a76f8 tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08a4c182-fbdf-47cc-b752-d884cb1453d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:16 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-3668acba-12a4-4ab0-b6b9-10b9097a76f8 tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1d64076-ff0b-434e-9669-f89f47da5805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:16 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-3668acba-12a4-4ab0-b6b9-10b9097a76f8 tempest-CreateVolumesFromImageTest-576799979 None] Volume 9a621f6a-931a-4bb5-8426-7df78620b69e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a621f6a-931a-4bb5-8426-7df78620b69e', 'volume_size': 1}
Apr 09 12:52:16 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-3668acba-12a4-4ab0-b6b9-10b9097a76f8 tempest-CreateVolumesFromImageTest-576799979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:16 devstack sudo[90148]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:16 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e75f9558-a8c5-4524-b2ae-a376ebac601c tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6327d09b-d0ce-4f6a-9278-bc4d06d6612b" returned: 0 in 0.694s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:16 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-e75f9558-a8c5-4524-b2ae-a376ebac601c tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] <== create_volume: return (1977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:52:16 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-e75f9558-a8c5-4524-b2ae-a376ebac601c tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.980s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:52:16 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-3d59f997-3bdc-4f5a-bfcb-5a1eb2c25302 tempest-CreateVolumesFromImageTest-576799979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:52:16 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-3d59f997-3bdc-4f5a-bfcb-5a1eb2c25302 tempest-CreateVolumesFromImageTest-576799979 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:52:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1177064009',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=409664e9-d46c-4467-83a6-8ab291309ca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b5bc8deea79461a8035a2712c7b245c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:52:15Z,use_quota=True,user_id='2e60bdf66bed4f64853301da0990b9db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:52:16 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-3d59f997-3bdc-4f5a-bfcb-5a1eb2c25302 tempest-CreateVolumesFromImageTest-576799979 None] Creating volume 409664e9-d46c-4467-83a6-8ab291309ca8 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:52:16 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-3d59f997-3bdc-4f5a-bfcb-5a1eb2c25302 tempest-CreateVolumesFromImageTest-576799979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:16 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-3d59f997-3bdc-4f5a-bfcb-5a1eb2c25302 tempest-CreateVolumesFromImageTest-576799979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:52:16 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-3d59f997-3bdc-4f5a-bfcb-5a1eb2c25302 tempest-CreateVolumesFromImageTest-576799979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:52:16 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-3d59f997-3bdc-4f5a-bfcb-5a1eb2c25302 tempest-CreateVolumesFromImageTest-576799979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:52:16 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-3d59f997-3bdc-4f5a-bfcb-5a1eb2c25302 tempest-CreateVolumesFromImageTest-576799979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:52:16 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-3d59f997-3bdc-4f5a-bfcb-5a1eb2c25302 tempest-CreateVolumesFromImageTest-576799979 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:52:16 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-3d59f997-3bdc-4f5a-bfcb-5a1eb2c25302 tempest-CreateVolumesFromImageTest-576799979 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:52:16 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-3d59f997-3bdc-4f5a-bfcb-5a1eb2c25302 tempest-CreateVolumesFromImageTest-576799979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-409664e9-d46c-4467-83a6-8ab291309ca8 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:16 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-e75f9558-a8c5-4524-b2ae-a376ebac601c tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74c21da1-347c-47f9-a4b7-7fad8cfc8cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6327d09b-d0ce-4f6a-9278-bc4d06d6612b', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:16 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-e75f9558-a8c5-4524-b2ae-a376ebac601c tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d60460f4-c3a3-45be-a4c7-e25e799fe66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:16 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-e75f9558-a8c5-4524-b2ae-a376ebac601c tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Volume volume-6327d09b-d0ce-4f6a-9278-bc4d06d6612b (6327d09b-d0ce-4f6a-9278-bc4d06d6612b): created successfully
Apr 09 12:52:16 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-e75f9558-a8c5-4524-b2ae-a376ebac601c tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d60460f4-c3a3-45be-a4c7-e25e799fe66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:16 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-e75f9558-a8c5-4524-b2ae-a376ebac601c tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Flow 'volume_create_manager' (a38f0074-023c-4ebd-b673-40543418892a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:52:16 devstack sudo[90151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-409664e9-d46c-4467-83a6-8ab291309ca8 1073741824
Apr 09 12:52:16 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-e75f9558-a8c5-4524-b2ae-a376ebac601c tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Created volume successfully.
Apr 09 12:52:16 devstack sudo[90151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:16 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-eaf99ebb-e93b-471a-983e-94c5fe1923de tempest-CreateVolumesFromImageTest-576799979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:52:16 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-eaf99ebb-e93b-471a-983e-94c5fe1923de tempest-CreateVolumesFromImageTest-576799979 None] Flow 'volume_create_manager' (c2eeba8d-c430-4841-9446-11180a0d6e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:52:16 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-eaf99ebb-e93b-471a-983e-94c5fe1923de tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c4aaa38-c7c0-434e-a83b-800abb1aadf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:16 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-eaf99ebb-e93b-471a-983e-94c5fe1923de tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c4aaa38-c7c0-434e-a83b-800abb1aadf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:52:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1781901835',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=178547e3-6e47-4bc9-a9be-7e6008b02570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b5bc8deea79461a8035a2712c7b245c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:52:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:52:17Z,use_quota=True,user_id='2e60bdf66bed4f64853301da0990b9db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:16 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-eaf99ebb-e93b-471a-983e-94c5fe1923de tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf04c4cb-0ee4-41d7-aa31-db4505532007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:16 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-eaf99ebb-e93b-471a-983e-94c5fe1923de tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf04c4cb-0ee4-41d7-aa31-db4505532007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:16 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-eaf99ebb-e93b-471a-983e-94c5fe1923de tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f2b6d3a-13d3-445d-8211-710035aaa871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:16 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-eaf99ebb-e93b-471a-983e-94c5fe1923de tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f2b6d3a-13d3-445d-8211-710035aaa871) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '178547e3-6e47-4bc9-a9be-7e6008b02570', 'volume_name': 'volume-178547e3-6e47-4bc9-a9be-7e6008b02570', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:16 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-eaf99ebb-e93b-471a-983e-94c5fe1923de tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f91ee649-7fbe-4881-9575-f8c5ec2249e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:16 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-eaf99ebb-e93b-471a-983e-94c5fe1923de tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f91ee649-7fbe-4881-9575-f8c5ec2249e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:16 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-eaf99ebb-e93b-471a-983e-94c5fe1923de tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (837b25c1-1238-4e5e-bb80-b9633be0b04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:16 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-eaf99ebb-e93b-471a-983e-94c5fe1923de tempest-CreateVolumesFromImageTest-576799979 None] Volume 178547e3-6e47-4bc9-a9be-7e6008b02570: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-178547e3-6e47-4bc9-a9be-7e6008b02570', 'volume_size': 1}
Apr 09 12:52:16 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-eaf99ebb-e93b-471a-983e-94c5fe1923de tempest-CreateVolumesFromImageTest-576799979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:17 devstack sudo[90151]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:17 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-3d59f997-3bdc-4f5a-bfcb-5a1eb2c25302 tempest-CreateVolumesFromImageTest-576799979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-409664e9-d46c-4467-83a6-8ab291309ca8 1073741824" returned: 0 in 0.927s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:17 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-3d59f997-3bdc-4f5a-bfcb-5a1eb2c25302 tempest-CreateVolumesFromImageTest-576799979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-409664e9-d46c-4467-83a6-8ab291309ca8 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:17 devstack sudo[90156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-409664e9-d46c-4467-83a6-8ab291309ca8
Apr 09 12:52:17 devstack sudo[90156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:17 devstack sudo[90156]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:17 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-160f90c2-8a94-49ab-a59e-563569aac56f tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:52:18 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-160f90c2-8a94-49ab-a59e-563569aac56f tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Flow 'volume_create_manager' (a4ace7e4-5adb-4b14-aa5f-0bc8cce31fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:52:18 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-160f90c2-8a94-49ab-a59e-563569aac56f tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eac8a5f-fe2e-4a2f-8fe7-de1ec413074e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-3d59f997-3bdc-4f5a-bfcb-5a1eb2c25302 tempest-CreateVolumesFromImageTest-576799979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-409664e9-d46c-4467-83a6-8ab291309ca8" returned: 0 in 0.686s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:18 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-3d59f997-3bdc-4f5a-bfcb-5a1eb2c25302 tempest-CreateVolumesFromImageTest-576799979 None] <== create_volume: return (1672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:52:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-3d59f997-3bdc-4f5a-bfcb-5a1eb2c25302 tempest-CreateVolumesFromImageTest-576799979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.675s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:52:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-4dfdf1e7-ab30-4d70-acd8-68fa16c993c3 tempest-VolumeDependencyTests-1907829774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.513s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:52:18 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-4dfdf1e7-ab30-4d70-acd8-68fa16c993c3 tempest-VolumeDependencyTests-1907829774 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:52:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1789695005',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a060e331-4d69-4f9f-bc23-29b77be0199d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0ac4240c434cf2bbb5c358ac539020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:52:15Z,use_quota=True,user_id='7c5570febc704767b49e00c1d41d2df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:52:18 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-4dfdf1e7-ab30-4d70-acd8-68fa16c993c3 tempest-VolumeDependencyTests-1907829774 None] Creating volume a060e331-4d69-4f9f-bc23-29b77be0199d {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:52:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-4dfdf1e7-ab30-4d70-acd8-68fa16c993c3 tempest-VolumeDependencyTests-1907829774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-4dfdf1e7-ab30-4d70-acd8-68fa16c993c3 tempest-VolumeDependencyTests-1907829774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:52:18 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-4dfdf1e7-ab30-4d70-acd8-68fa16c993c3 tempest-VolumeDependencyTests-1907829774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:52:18 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-4dfdf1e7-ab30-4d70-acd8-68fa16c993c3 tempest-VolumeDependencyTests-1907829774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:52:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-4dfdf1e7-ab30-4d70-acd8-68fa16c993c3 tempest-VolumeDependencyTests-1907829774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:52:18 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-4dfdf1e7-ab30-4d70-acd8-68fa16c993c3 tempest-VolumeDependencyTests-1907829774 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:52:18 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-4dfdf1e7-ab30-4d70-acd8-68fa16c993c3 tempest-VolumeDependencyTests-1907829774 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:52:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-4dfdf1e7-ab30-4d70-acd8-68fa16c993c3 tempest-VolumeDependencyTests-1907829774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:18 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-160f90c2-8a94-49ab-a59e-563569aac56f tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eac8a5f-fe2e-4a2f-8fe7-de1ec413074e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:52:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1840720578',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f60f78b-f51b-47ac-af2f-71f9a32a60da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df612b6d131c4d48b768abf0247ac87a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:52:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:52:18Z,use_quota=True,user_id='d7fd92b2d9f3439c9017bd9624e1c50a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:18 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-160f90c2-8a94-49ab-a59e-563569aac56f tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50ad6f1d-62b4-482b-a5f0-17bc2a1f09d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:18 devstack sudo[90159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d 1073741824
Apr 09 12:52:18 devstack sudo[90159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:18 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-160f90c2-8a94-49ab-a59e-563569aac56f tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50ad6f1d-62b4-482b-a5f0-17bc2a1f09d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:18 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-160f90c2-8a94-49ab-a59e-563569aac56f tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87fb54e8-7833-4efe-9e10-be7ea09fe9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:18 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-160f90c2-8a94-49ab-a59e-563569aac56f tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87fb54e8-7833-4efe-9e10-be7ea09fe9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f60f78b-f51b-47ac-af2f-71f9a32a60da', 'volume_name': 'volume-6f60f78b-f51b-47ac-af2f-71f9a32a60da', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:18 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-160f90c2-8a94-49ab-a59e-563569aac56f tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c8eda8f-545b-46c8-938b-bb31b57a22a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:18 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-160f90c2-8a94-49ab-a59e-563569aac56f tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c8eda8f-545b-46c8-938b-bb31b57a22a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:18 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-160f90c2-8a94-49ab-a59e-563569aac56f tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (130f0e3b-face-411c-8250-508d7da06db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:18 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-160f90c2-8a94-49ab-a59e-563569aac56f tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Volume 6f60f78b-f51b-47ac-af2f-71f9a32a60da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f60f78b-f51b-47ac-af2f-71f9a32a60da', 'volume_size': 1}
Apr 09 12:52:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-160f90c2-8a94-49ab-a59e-563569aac56f tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:18 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-3d59f997-3bdc-4f5a-bfcb-5a1eb2c25302 tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e8f5898-b69f-4ec7-a5f3-a01483268f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-409664e9-d46c-4467-83a6-8ab291309ca8', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:18 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-3d59f997-3bdc-4f5a-bfcb-5a1eb2c25302 tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (958c2807-f85b-4888-a57f-24acbd7de116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:18 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-3d59f997-3bdc-4f5a-bfcb-5a1eb2c25302 tempest-CreateVolumesFromImageTest-576799979 None] Volume volume-409664e9-d46c-4467-83a6-8ab291309ca8 (409664e9-d46c-4467-83a6-8ab291309ca8): created successfully
Apr 09 12:52:18 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-3d59f997-3bdc-4f5a-bfcb-5a1eb2c25302 tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (958c2807-f85b-4888-a57f-24acbd7de116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:18 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-3d59f997-3bdc-4f5a-bfcb-5a1eb2c25302 tempest-CreateVolumesFromImageTest-576799979 None] Flow 'volume_create_manager' (5d9f516f-a097-4f45-a53a-7fbe66e4304a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:52:18 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-3d59f997-3bdc-4f5a-bfcb-5a1eb2c25302 tempest-CreateVolumesFromImageTest-576799979 None] Created volume successfully.
Apr 09 12:52:18 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-c33bec27-8eb5-4045-bc90-39350e8cc240 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:52:18 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c33bec27-8eb5-4045-bc90-39350e8cc240 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Flow 'volume_create_manager' (4beaf83e-9e4b-436b-8018-3a39151cbb55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:52:18 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c33bec27-8eb5-4045-bc90-39350e8cc240 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dca10cbb-50f5-484d-9e83-8eaeca5213e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:18 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c33bec27-8eb5-4045-bc90-39350e8cc240 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dca10cbb-50f5-484d-9e83-8eaeca5213e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:52:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-871505396',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=520fd487-1437-409c-b349-83aec4ed2249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df612b6d131c4d48b768abf0247ac87a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:52:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:52:18Z,use_quota=True,user_id='d7fd92b2d9f3439c9017bd9624e1c50a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:18 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c33bec27-8eb5-4045-bc90-39350e8cc240 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8502301-9678-459f-9783-1e21b7980c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:18 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c33bec27-8eb5-4045-bc90-39350e8cc240 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8502301-9678-459f-9783-1e21b7980c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:18 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c33bec27-8eb5-4045-bc90-39350e8cc240 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a17c635-9ac1-4a16-b06c-891725bcddaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:18 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c33bec27-8eb5-4045-bc90-39350e8cc240 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a17c635-9ac1-4a16-b06c-891725bcddaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '520fd487-1437-409c-b349-83aec4ed2249', 'volume_name': 'volume-520fd487-1437-409c-b349-83aec4ed2249', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:18 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c33bec27-8eb5-4045-bc90-39350e8cc240 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a503529-e29f-435e-9faf-b150793bea67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:18 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c33bec27-8eb5-4045-bc90-39350e8cc240 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a503529-e29f-435e-9faf-b150793bea67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:18 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c33bec27-8eb5-4045-bc90-39350e8cc240 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbb2f4b4-c139-4cb6-9eeb-f3a998653ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:18 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-c33bec27-8eb5-4045-bc90-39350e8cc240 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Volume 520fd487-1437-409c-b349-83aec4ed2249: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-520fd487-1437-409c-b349-83aec4ed2249', 'volume_size': 1}
Apr 09 12:52:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c33bec27-8eb5-4045-bc90-39350e8cc240 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:18 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c5bb54b-3ba6-48fd-b389-c1293c56c027 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:52:18 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-5c5bb54b-3ba6-48fd-b389-c1293c56c027 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Flow 'volume_create_manager' (dd42b66f-76f5-4cac-b6e0-882462b12f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:52:18 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-5c5bb54b-3ba6-48fd-b389-c1293c56c027 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f136865-2dce-49b1-b964-d7c92163071d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:18 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-5c5bb54b-3ba6-48fd-b389-c1293c56c027 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f136865-2dce-49b1-b964-d7c92163071d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:52:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1596723564',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daabc055-d5a5-4c0c-9b16-311d6f0618b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df612b6d131c4d48b768abf0247ac87a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:52:19Z,use_quota=True,user_id='d7fd92b2d9f3439c9017bd9624e1c50a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:18 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-5c5bb54b-3ba6-48fd-b389-c1293c56c027 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4059f53f-e358-4301-a6d9-c93980297686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:18 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-5c5bb54b-3ba6-48fd-b389-c1293c56c027 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4059f53f-e358-4301-a6d9-c93980297686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:18 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-5c5bb54b-3ba6-48fd-b389-c1293c56c027 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73cbf433-0328-480a-92d6-cd2f29a758f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:18 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-5c5bb54b-3ba6-48fd-b389-c1293c56c027 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73cbf433-0328-480a-92d6-cd2f29a758f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daabc055-d5a5-4c0c-9b16-311d6f0618b5', 'volume_name': 'volume-daabc055-d5a5-4c0c-9b16-311d6f0618b5', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:18 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-5c5bb54b-3ba6-48fd-b389-c1293c56c027 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04ec7624-b2ae-481c-a631-402797c09a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:18 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-5c5bb54b-3ba6-48fd-b389-c1293c56c027 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04ec7624-b2ae-481c-a631-402797c09a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:18 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-5c5bb54b-3ba6-48fd-b389-c1293c56c027 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c87c2e88-a3bc-48d3-aeee-89d87ec3dba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:18 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-5c5bb54b-3ba6-48fd-b389-c1293c56c027 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Volume daabc055-d5a5-4c0c-9b16-311d6f0618b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daabc055-d5a5-4c0c-9b16-311d6f0618b5', 'volume_size': 1}
Apr 09 12:52:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-5c5bb54b-3ba6-48fd-b389-c1293c56c027 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:19 devstack sudo[90159]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-4dfdf1e7-ab30-4d70-acd8-68fa16c993c3 tempest-VolumeDependencyTests-1907829774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d 1073741824" returned: 0 in 1.052s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-4dfdf1e7-ab30-4d70-acd8-68fa16c993c3 tempest-VolumeDependencyTests-1907829774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:19 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-c70b5eec-e926-4797-bb1b-bf2a60529b9d tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:52:19 devstack sudo[90164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d
Apr 09 12:52:19 devstack sudo[90164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:19 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c70b5eec-e926-4797-bb1b-bf2a60529b9d tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Flow 'volume_create_manager' (29e88347-96e6-464a-8ceb-5e03c7ca6e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:52:19 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c70b5eec-e926-4797-bb1b-bf2a60529b9d tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b299269-0044-41b0-81df-ad4684c6a415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:19 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c70b5eec-e926-4797-bb1b-bf2a60529b9d tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b299269-0044-41b0-81df-ad4684c6a415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:52:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1387878168',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e9531b7-bcc2-41ea-95a9-61cd0f8fb203,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df612b6d131c4d48b768abf0247ac87a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:52:19Z,use_quota=True,user_id='d7fd92b2d9f3439c9017bd9624e1c50a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:19 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c70b5eec-e926-4797-bb1b-bf2a60529b9d tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d16491c-5390-4ba3-9511-57679522cf4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:19 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c70b5eec-e926-4797-bb1b-bf2a60529b9d tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d16491c-5390-4ba3-9511-57679522cf4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:19 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c70b5eec-e926-4797-bb1b-bf2a60529b9d tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6241236d-6221-4cfb-bd65-7aa8f03ee08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:19 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c70b5eec-e926-4797-bb1b-bf2a60529b9d tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6241236d-6221-4cfb-bd65-7aa8f03ee08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e9531b7-bcc2-41ea-95a9-61cd0f8fb203', 'volume_name': 'volume-6e9531b7-bcc2-41ea-95a9-61cd0f8fb203', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:19 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c70b5eec-e926-4797-bb1b-bf2a60529b9d tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04092125-2aed-4b9e-9e27-e3f4aa5c2ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:19 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c70b5eec-e926-4797-bb1b-bf2a60529b9d tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04092125-2aed-4b9e-9e27-e3f4aa5c2ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:19 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c70b5eec-e926-4797-bb1b-bf2a60529b9d tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdfbf29c-fb69-43b5-9da7-80348bcb1b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:19 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-c70b5eec-e926-4797-bb1b-bf2a60529b9d tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Volume 6e9531b7-bcc2-41ea-95a9-61cd0f8fb203: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e9531b7-bcc2-41ea-95a9-61cd0f8fb203', 'volume_size': 1}
Apr 09 12:52:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c70b5eec-e926-4797-bb1b-bf2a60529b9d tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:19 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-d75af7aa-678e-4684-bc4d-86bd070f9a2a tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:52:19 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d75af7aa-678e-4684-bc4d-86bd070f9a2a tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Flow 'volume_create_manager' (0adb509f-9b17-4d44-936d-f6fe786b0f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:52:19 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d75af7aa-678e-4684-bc4d-86bd070f9a2a tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4144d48-ffce-4ed2-b92d-8283de3273d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:19 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d75af7aa-678e-4684-bc4d-86bd070f9a2a tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4144d48-ffce-4ed2-b92d-8283de3273d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:52:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-35317194',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b063b65-6e81-47c2-bf9c-2a1550d20f3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df612b6d131c4d48b768abf0247ac87a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:52:19Z,use_quota=True,user_id='d7fd92b2d9f3439c9017bd9624e1c50a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:19 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d75af7aa-678e-4684-bc4d-86bd070f9a2a tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74b4af4a-2a39-4351-888c-bcc0ef063b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:19 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d75af7aa-678e-4684-bc4d-86bd070f9a2a tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74b4af4a-2a39-4351-888c-bcc0ef063b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:19 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d75af7aa-678e-4684-bc4d-86bd070f9a2a tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (309d86b4-a10a-4e12-95c9-57b74e3a090b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:19 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d75af7aa-678e-4684-bc4d-86bd070f9a2a tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (309d86b4-a10a-4e12-95c9-57b74e3a090b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b063b65-6e81-47c2-bf9c-2a1550d20f3f', 'volume_name': 'volume-3b063b65-6e81-47c2-bf9c-2a1550d20f3f', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:19 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d75af7aa-678e-4684-bc4d-86bd070f9a2a tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7724a8ab-9cae-4dca-9fec-117183f6ebd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:19 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d75af7aa-678e-4684-bc4d-86bd070f9a2a tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7724a8ab-9cae-4dca-9fec-117183f6ebd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:19 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d75af7aa-678e-4684-bc4d-86bd070f9a2a tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39f4b4d5-00c8-4788-9641-a470f5d81cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:19 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-d75af7aa-678e-4684-bc4d-86bd070f9a2a tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Volume 3b063b65-6e81-47c2-bf9c-2a1550d20f3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b063b65-6e81-47c2-bf9c-2a1550d20f3f', 'volume_size': 1}
Apr 09 12:52:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d75af7aa-678e-4684-bc4d-86bd070f9a2a tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:19 devstack sudo[90164]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-4dfdf1e7-ab30-4d70-acd8-68fa16c993c3 tempest-VolumeDependencyTests-1907829774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d" returned: 0 in 0.617s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:19 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-4dfdf1e7-ab30-4d70-acd8-68fa16c993c3 tempest-VolumeDependencyTests-1907829774 None] <== create_volume: return (1723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:52:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-4dfdf1e7-ab30-4d70-acd8-68fa16c993c3 tempest-VolumeDependencyTests-1907829774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.726s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:52:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-2edac39d-2d3a-48b5-8114-bf040e959612 tempest-CreateVolumesFromImageTest-576799979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.028s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:52:19 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-2edac39d-2d3a-48b5-8114-bf040e959612 tempest-CreateVolumesFromImageTest-576799979 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:52:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-319198934',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04037c42-c68e-4245-8d18-ba13bd444381,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b5bc8deea79461a8035a2712c7b245c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:52:15Z,use_quota=True,user_id='2e60bdf66bed4f64853301da0990b9db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:52:19 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-2edac39d-2d3a-48b5-8114-bf040e959612 tempest-CreateVolumesFromImageTest-576799979 None] Creating volume 04037c42-c68e-4245-8d18-ba13bd444381 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:52:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-2edac39d-2d3a-48b5-8114-bf040e959612 tempest-CreateVolumesFromImageTest-576799979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-2edac39d-2d3a-48b5-8114-bf040e959612 tempest-CreateVolumesFromImageTest-576799979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:52:19 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-2edac39d-2d3a-48b5-8114-bf040e959612 tempest-CreateVolumesFromImageTest-576799979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:52:19 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-2edac39d-2d3a-48b5-8114-bf040e959612 tempest-CreateVolumesFromImageTest-576799979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:52:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-2edac39d-2d3a-48b5-8114-bf040e959612 tempest-CreateVolumesFromImageTest-576799979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:52:19 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-2edac39d-2d3a-48b5-8114-bf040e959612 tempest-CreateVolumesFromImageTest-576799979 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:52:19 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-2edac39d-2d3a-48b5-8114-bf040e959612 tempest-CreateVolumesFromImageTest-576799979 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:52:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2edac39d-2d3a-48b5-8114-bf040e959612 tempest-CreateVolumesFromImageTest-576799979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-04037c42-c68e-4245-8d18-ba13bd444381 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:19 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4dfdf1e7-ab30-4d70-acd8-68fa16c993c3 tempest-VolumeDependencyTests-1907829774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e34c5017-570d-4bed-8c44-4c97bbd10f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a060e331-4d69-4f9f-bc23-29b77be0199d', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:19 devstack sudo[90167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-04037c42-c68e-4245-8d18-ba13bd444381 1073741824
Apr 09 12:52:19 devstack sudo[90167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:19 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4dfdf1e7-ab30-4d70-acd8-68fa16c993c3 tempest-VolumeDependencyTests-1907829774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f9f9d6d-89d3-4b8b-97a7-fea4a7be72c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:19 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-4dfdf1e7-ab30-4d70-acd8-68fa16c993c3 tempest-VolumeDependencyTests-1907829774 None] Volume volume-a060e331-4d69-4f9f-bc23-29b77be0199d (a060e331-4d69-4f9f-bc23-29b77be0199d): created successfully
Apr 09 12:52:19 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4dfdf1e7-ab30-4d70-acd8-68fa16c993c3 tempest-VolumeDependencyTests-1907829774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f9f9d6d-89d3-4b8b-97a7-fea4a7be72c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:19 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-4dfdf1e7-ab30-4d70-acd8-68fa16c993c3 tempest-VolumeDependencyTests-1907829774 None] Flow 'volume_create_manager' (7d35bd17-2d60-4751-a10a-94fd9789db63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:52:19 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-4dfdf1e7-ab30-4d70-acd8-68fa16c993c3 tempest-VolumeDependencyTests-1907829774 None] Created volume successfully.
Apr 09 12:52:20 devstack sudo[90167]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:20 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2edac39d-2d3a-48b5-8114-bf040e959612 tempest-CreateVolumesFromImageTest-576799979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-04037c42-c68e-4245-8d18-ba13bd444381 1073741824" returned: 0 in 0.807s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:20 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2edac39d-2d3a-48b5-8114-bf040e959612 tempest-CreateVolumesFromImageTest-576799979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-04037c42-c68e-4245-8d18-ba13bd444381 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:20 devstack sudo[90172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-04037c42-c68e-4245-8d18-ba13bd444381
Apr 09 12:52:20 devstack sudo[90172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:20 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-586eeb3a-164f-483d-a864-e04764044771 tempest-VolumeDependencyTests-1907829774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:21 devstack sudo[90172]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:21 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2edac39d-2d3a-48b5-8114-bf040e959612 tempest-CreateVolumesFromImageTest-576799979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-04037c42-c68e-4245-8d18-ba13bd444381" returned: 0 in 0.548s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:21 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-2edac39d-2d3a-48b5-8114-bf040e959612 tempest-CreateVolumesFromImageTest-576799979 None] <== create_volume: return (1391ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:52:21 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-2edac39d-2d3a-48b5-8114-bf040e959612 tempest-CreateVolumesFromImageTest-576799979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.396s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:52:21 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-3e54f1eb-4a92-4549-bbe2-a49a464e1f03 tempest-CreateVolumesFromImageTest-576799979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.222s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:52:21 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-3e54f1eb-4a92-4549-bbe2-a49a464e1f03 tempest-CreateVolumesFromImageTest-576799979 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:52:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1570233789',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48fbd8f4-d385-4669-8077-200b763cae2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b5bc8deea79461a8035a2712c7b245c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:52:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:52:16Z,use_quota=True,user_id='2e60bdf66bed4f64853301da0990b9db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:52:21 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-3e54f1eb-4a92-4549-bbe2-a49a464e1f03 tempest-CreateVolumesFromImageTest-576799979 None] Creating volume 48fbd8f4-d385-4669-8077-200b763cae2d {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:52:21 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-3e54f1eb-4a92-4549-bbe2-a49a464e1f03 tempest-CreateVolumesFromImageTest-576799979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:21 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-3e54f1eb-4a92-4549-bbe2-a49a464e1f03 tempest-CreateVolumesFromImageTest-576799979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:52:21 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-3e54f1eb-4a92-4549-bbe2-a49a464e1f03 tempest-CreateVolumesFromImageTest-576799979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:52:21 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-3e54f1eb-4a92-4549-bbe2-a49a464e1f03 tempest-CreateVolumesFromImageTest-576799979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:52:21 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-3e54f1eb-4a92-4549-bbe2-a49a464e1f03 tempest-CreateVolumesFromImageTest-576799979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:52:21 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-3e54f1eb-4a92-4549-bbe2-a49a464e1f03 tempest-CreateVolumesFromImageTest-576799979 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:52:21 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-3e54f1eb-4a92-4549-bbe2-a49a464e1f03 tempest-CreateVolumesFromImageTest-576799979 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:52:21 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-3e54f1eb-4a92-4549-bbe2-a49a464e1f03 tempest-CreateVolumesFromImageTest-576799979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-48fbd8f4-d385-4669-8077-200b763cae2d 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:21 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-2edac39d-2d3a-48b5-8114-bf040e959612 tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e0e5bea-a33e-4597-8634-bcb97f8204b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04037c42-c68e-4245-8d18-ba13bd444381', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:21 devstack sudo[90175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-48fbd8f4-d385-4669-8077-200b763cae2d 1073741824
Apr 09 12:52:21 devstack sudo[90175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:21 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-2edac39d-2d3a-48b5-8114-bf040e959612 tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6af774a-f41f-4050-9ca9-cfe1865ee19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:21 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-2edac39d-2d3a-48b5-8114-bf040e959612 tempest-CreateVolumesFromImageTest-576799979 None] Volume volume-04037c42-c68e-4245-8d18-ba13bd444381 (04037c42-c68e-4245-8d18-ba13bd444381): created successfully
Apr 09 12:52:21 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-2edac39d-2d3a-48b5-8114-bf040e959612 tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6af774a-f41f-4050-9ca9-cfe1865ee19d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:21 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-2edac39d-2d3a-48b5-8114-bf040e959612 tempest-CreateVolumesFromImageTest-576799979 None] Flow 'volume_create_manager' (744ed61e-e4f3-433c-a6b4-426cfb673c36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:52:21 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-2edac39d-2d3a-48b5-8114-bf040e959612 tempest-CreateVolumesFromImageTest-576799979 None] Created volume successfully.
Apr 09 12:52:21 devstack sudo[90175]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:21 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-3e54f1eb-4a92-4549-bbe2-a49a464e1f03 tempest-CreateVolumesFromImageTest-576799979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-48fbd8f4-d385-4669-8077-200b763cae2d 1073741824" returned: 0 in 0.739s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:21 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-3e54f1eb-4a92-4549-bbe2-a49a464e1f03 tempest-CreateVolumesFromImageTest-576799979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-48fbd8f4-d385-4669-8077-200b763cae2d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:21 devstack sudo[90182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-48fbd8f4-d385-4669-8077-200b763cae2d
Apr 09 12:52:21 devstack sudo[90182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:22 devstack sudo[90182]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:22 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-3e54f1eb-4a92-4549-bbe2-a49a464e1f03 tempest-CreateVolumesFromImageTest-576799979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-48fbd8f4-d385-4669-8077-200b763cae2d" returned: 0 in 0.672s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:22 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-3e54f1eb-4a92-4549-bbe2-a49a464e1f03 tempest-CreateVolumesFromImageTest-576799979 None] <== create_volume: return (1453ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:52:22 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-3e54f1eb-4a92-4549-bbe2-a49a464e1f03 tempest-CreateVolumesFromImageTest-576799979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.457s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:52:22 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-3668acba-12a4-4ab0-b6b9-10b9097a76f8 tempest-CreateVolumesFromImageTest-576799979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.327s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:52:22 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-3668acba-12a4-4ab0-b6b9-10b9097a76f8 tempest-CreateVolumesFromImageTest-576799979 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:52:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1268751985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a621f6a-931a-4bb5-8426-7df78620b69e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b5bc8deea79461a8035a2712c7b245c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:52:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:52:16Z,use_quota=True,user_id='2e60bdf66bed4f64853301da0990b9db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:52:22 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-3668acba-12a4-4ab0-b6b9-10b9097a76f8 tempest-CreateVolumesFromImageTest-576799979 None] Creating volume 9a621f6a-931a-4bb5-8426-7df78620b69e {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:52:22 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-3668acba-12a4-4ab0-b6b9-10b9097a76f8 tempest-CreateVolumesFromImageTest-576799979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:22 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-3668acba-12a4-4ab0-b6b9-10b9097a76f8 tempest-CreateVolumesFromImageTest-576799979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:52:22 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-3668acba-12a4-4ab0-b6b9-10b9097a76f8 tempest-CreateVolumesFromImageTest-576799979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:52:22 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-3668acba-12a4-4ab0-b6b9-10b9097a76f8 tempest-CreateVolumesFromImageTest-576799979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:52:22 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-3668acba-12a4-4ab0-b6b9-10b9097a76f8 tempest-CreateVolumesFromImageTest-576799979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:52:22 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-3668acba-12a4-4ab0-b6b9-10b9097a76f8 tempest-CreateVolumesFromImageTest-576799979 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:52:22 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-3668acba-12a4-4ab0-b6b9-10b9097a76f8 tempest-CreateVolumesFromImageTest-576799979 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:52:22 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-3668acba-12a4-4ab0-b6b9-10b9097a76f8 tempest-CreateVolumesFromImageTest-576799979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a621f6a-931a-4bb5-8426-7df78620b69e 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:22 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-3e54f1eb-4a92-4549-bbe2-a49a464e1f03 tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47035076-7282-4ae1-a730-a5b13f1f17b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48fbd8f4-d385-4669-8077-200b763cae2d', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:22 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-3e54f1eb-4a92-4549-bbe2-a49a464e1f03 tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d89955d6-fba9-4c77-bf3b-de916703ca21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:22 devstack sudo[90186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a621f6a-931a-4bb5-8426-7df78620b69e 1073741824
Apr 09 12:52:22 devstack sudo[90186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:22 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-3e54f1eb-4a92-4549-bbe2-a49a464e1f03 tempest-CreateVolumesFromImageTest-576799979 None] Volume volume-48fbd8f4-d385-4669-8077-200b763cae2d (48fbd8f4-d385-4669-8077-200b763cae2d): created successfully
Apr 09 12:52:22 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-3e54f1eb-4a92-4549-bbe2-a49a464e1f03 tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d89955d6-fba9-4c77-bf3b-de916703ca21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:22 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-3e54f1eb-4a92-4549-bbe2-a49a464e1f03 tempest-CreateVolumesFromImageTest-576799979 None] Flow 'volume_create_manager' (a2808081-0e6d-450b-ade8-32780773059a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:52:22 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-3e54f1eb-4a92-4549-bbe2-a49a464e1f03 tempest-CreateVolumesFromImageTest-576799979 None] Created volume successfully.
Apr 09 12:52:23 devstack sudo[90186]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-3668acba-12a4-4ab0-b6b9-10b9097a76f8 tempest-CreateVolumesFromImageTest-576799979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a621f6a-931a-4bb5-8426-7df78620b69e 1073741824" returned: 0 in 0.874s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-3668acba-12a4-4ab0-b6b9-10b9097a76f8 tempest-CreateVolumesFromImageTest-576799979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a621f6a-931a-4bb5-8426-7df78620b69e {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:23 devstack sudo[90197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a621f6a-931a-4bb5-8426-7df78620b69e
Apr 09 12:52:23 devstack sudo[90197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:24 devstack sudo[90197]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-3668acba-12a4-4ab0-b6b9-10b9097a76f8 tempest-CreateVolumesFromImageTest-576799979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a621f6a-931a-4bb5-8426-7df78620b69e" returned: 0 in 0.624s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:24 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-3668acba-12a4-4ab0-b6b9-10b9097a76f8 tempest-CreateVolumesFromImageTest-576799979 None] <== create_volume: return (1539ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:52:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-3668acba-12a4-4ab0-b6b9-10b9097a76f8 tempest-CreateVolumesFromImageTest-576799979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:52:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-eaf99ebb-e93b-471a-983e-94c5fe1923de tempest-CreateVolumesFromImageTest-576799979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.544s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:52:24 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-eaf99ebb-e93b-471a-983e-94c5fe1923de tempest-CreateVolumesFromImageTest-576799979 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:52:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1781901835',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=178547e3-6e47-4bc9-a9be-7e6008b02570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b5bc8deea79461a8035a2712c7b245c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:52:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:52:17Z,use_quota=True,user_id='2e60bdf66bed4f64853301da0990b9db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:52:24 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-eaf99ebb-e93b-471a-983e-94c5fe1923de tempest-CreateVolumesFromImageTest-576799979 None] Creating volume 178547e3-6e47-4bc9-a9be-7e6008b02570 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:52:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-eaf99ebb-e93b-471a-983e-94c5fe1923de tempest-CreateVolumesFromImageTest-576799979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-eaf99ebb-e93b-471a-983e-94c5fe1923de tempest-CreateVolumesFromImageTest-576799979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:52:24 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-eaf99ebb-e93b-471a-983e-94c5fe1923de tempest-CreateVolumesFromImageTest-576799979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:52:24 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-eaf99ebb-e93b-471a-983e-94c5fe1923de tempest-CreateVolumesFromImageTest-576799979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:52:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-eaf99ebb-e93b-471a-983e-94c5fe1923de tempest-CreateVolumesFromImageTest-576799979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:52:24 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-eaf99ebb-e93b-471a-983e-94c5fe1923de tempest-CreateVolumesFromImageTest-576799979 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:52:24 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-eaf99ebb-e93b-471a-983e-94c5fe1923de tempest-CreateVolumesFromImageTest-576799979 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:52:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-eaf99ebb-e93b-471a-983e-94c5fe1923de tempest-CreateVolumesFromImageTest-576799979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-178547e3-6e47-4bc9-a9be-7e6008b02570 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:24 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-3668acba-12a4-4ab0-b6b9-10b9097a76f8 tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1d64076-ff0b-434e-9669-f89f47da5805) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a621f6a-931a-4bb5-8426-7df78620b69e', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:24 devstack sudo[90200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-178547e3-6e47-4bc9-a9be-7e6008b02570 1073741824
Apr 09 12:52:24 devstack sudo[90200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:24 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-3668acba-12a4-4ab0-b6b9-10b9097a76f8 tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bd9d15f-938b-4d0a-8171-34b0bd0bb5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:24 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-3668acba-12a4-4ab0-b6b9-10b9097a76f8 tempest-CreateVolumesFromImageTest-576799979 None] Volume volume-9a621f6a-931a-4bb5-8426-7df78620b69e (9a621f6a-931a-4bb5-8426-7df78620b69e): created successfully
Apr 09 12:52:24 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-3668acba-12a4-4ab0-b6b9-10b9097a76f8 tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bd9d15f-938b-4d0a-8171-34b0bd0bb5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:24 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-3668acba-12a4-4ab0-b6b9-10b9097a76f8 tempest-CreateVolumesFromImageTest-576799979 None] Flow 'volume_create_manager' (df8adc5d-b8e0-4344-97cc-6a9f96df407c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:52:24 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-3668acba-12a4-4ab0-b6b9-10b9097a76f8 tempest-CreateVolumesFromImageTest-576799979 None] Created volume successfully.
Apr 09 12:52:24 devstack sudo[90200]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-eaf99ebb-e93b-471a-983e-94c5fe1923de tempest-CreateVolumesFromImageTest-576799979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-178547e3-6e47-4bc9-a9be-7e6008b02570 1073741824" returned: 0 in 0.620s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-eaf99ebb-e93b-471a-983e-94c5fe1923de tempest-CreateVolumesFromImageTest-576799979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-178547e3-6e47-4bc9-a9be-7e6008b02570 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:24 devstack sudo[90205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-178547e3-6e47-4bc9-a9be-7e6008b02570
Apr 09 12:52:24 devstack sudo[90205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:25 devstack sudo[90205]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-eaf99ebb-e93b-471a-983e-94c5fe1923de tempest-CreateVolumesFromImageTest-576799979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-178547e3-6e47-4bc9-a9be-7e6008b02570" returned: 0 in 0.659s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:25 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-eaf99ebb-e93b-471a-983e-94c5fe1923de tempest-CreateVolumesFromImageTest-576799979 None] <== create_volume: return (1315ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:52:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-eaf99ebb-e93b-471a-983e-94c5fe1923de tempest-CreateVolumesFromImageTest-576799979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.319s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:52:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-160f90c2-8a94-49ab-a59e-563569aac56f tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.392s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:52:25 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-160f90c2-8a94-49ab-a59e-563569aac56f tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:52:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1840720578',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f60f78b-f51b-47ac-af2f-71f9a32a60da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df612b6d131c4d48b768abf0247ac87a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:52:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:52:18Z,use_quota=True,user_id='d7fd92b2d9f3439c9017bd9624e1c50a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:52:25 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-160f90c2-8a94-49ab-a59e-563569aac56f tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Creating volume 6f60f78b-f51b-47ac-af2f-71f9a32a60da {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:52:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-160f90c2-8a94-49ab-a59e-563569aac56f tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-160f90c2-8a94-49ab-a59e-563569aac56f tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:52:25 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-160f90c2-8a94-49ab-a59e-563569aac56f tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:52:25 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-160f90c2-8a94-49ab-a59e-563569aac56f tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:52:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-160f90c2-8a94-49ab-a59e-563569aac56f tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:52:25 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-160f90c2-8a94-49ab-a59e-563569aac56f tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:52:25 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-160f90c2-8a94-49ab-a59e-563569aac56f tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:52:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-160f90c2-8a94-49ab-a59e-563569aac56f tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6f60f78b-f51b-47ac-af2f-71f9a32a60da 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:25 devstack sudo[90208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6f60f78b-f51b-47ac-af2f-71f9a32a60da 1073741824
Apr 09 12:52:25 devstack sudo[90208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:25 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-eaf99ebb-e93b-471a-983e-94c5fe1923de tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (837b25c1-1238-4e5e-bb80-b9633be0b04f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-178547e3-6e47-4bc9-a9be-7e6008b02570', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:25 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-eaf99ebb-e93b-471a-983e-94c5fe1923de tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd8b8236-d18e-4a5c-ae48-f0e1592259f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:25 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-eaf99ebb-e93b-471a-983e-94c5fe1923de tempest-CreateVolumesFromImageTest-576799979 None] Volume volume-178547e3-6e47-4bc9-a9be-7e6008b02570 (178547e3-6e47-4bc9-a9be-7e6008b02570): created successfully
Apr 09 12:52:25 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-eaf99ebb-e93b-471a-983e-94c5fe1923de tempest-CreateVolumesFromImageTest-576799979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd8b8236-d18e-4a5c-ae48-f0e1592259f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:25 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-eaf99ebb-e93b-471a-983e-94c5fe1923de tempest-CreateVolumesFromImageTest-576799979 None] Flow 'volume_create_manager' (c2eeba8d-c430-4841-9446-11180a0d6e44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:52:25 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-eaf99ebb-e93b-471a-983e-94c5fe1923de tempest-CreateVolumesFromImageTest-576799979 None] Created volume successfully.
Apr 09 12:52:26 devstack sudo[90208]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-160f90c2-8a94-49ab-a59e-563569aac56f tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6f60f78b-f51b-47ac-af2f-71f9a32a60da 1073741824" returned: 0 in 0.916s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-160f90c2-8a94-49ab-a59e-563569aac56f tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6f60f78b-f51b-47ac-af2f-71f9a32a60da {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:26 devstack sudo[90213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6f60f78b-f51b-47ac-af2f-71f9a32a60da
Apr 09 12:52:26 devstack sudo[90213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:26 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-412dec25-66be-4797-a826-5c2507993553 tempest-CreateVolumesFromImageTest-576799979 None] Acquiring lock "cinder-178547e3-6e47-4bc9-a9be-7e6008b02570-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:52:26 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-412dec25-66be-4797-a826-5c2507993553 tempest-CreateVolumesFromImageTest-576799979 None] Lock "cinder-178547e3-6e47-4bc9-a9be-7e6008b02570-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:52:26 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-412dec25-66be-4797-a826-5c2507993553 tempest-CreateVolumesFromImageTest-576799979 None] Acquiring lock "cinder-quobyte-178547e3-6e47-4bc9-a9be-7e6008b02570" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:52:26 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-412dec25-66be-4797-a826-5c2507993553 tempest-CreateVolumesFromImageTest-576799979 None] Lock "cinder-quobyte-178547e3-6e47-4bc9-a9be-7e6008b02570" acquired by "delete_volume" :: waited 0.013s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:52:26 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[04dddd6b-9842-4efc-9cdb-e9c279459ad6]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:52:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-412dec25-66be-4797-a826-5c2507993553 tempest-CreateVolumesFromImageTest-576799979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-178547e3-6e47-4bc9-a9be-7e6008b02570 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:26 devstack sudo[90215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-178547e3-6e47-4bc9-a9be-7e6008b02570
Apr 09 12:52:26 devstack sudo[90215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:27 devstack sudo[90213]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-160f90c2-8a94-49ab-a59e-563569aac56f tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6f60f78b-f51b-47ac-af2f-71f9a32a60da" returned: 0 in 0.745s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:27 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-160f90c2-8a94-49ab-a59e-563569aac56f tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] <== create_volume: return (1696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:52:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-160f90c2-8a94-49ab-a59e-563569aac56f tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.700s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:52:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c33bec27-8eb5-4045-bc90-39350e8cc240 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.715s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:52:27 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-c33bec27-8eb5-4045-bc90-39350e8cc240 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:52:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-871505396',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=520fd487-1437-409c-b349-83aec4ed2249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df612b6d131c4d48b768abf0247ac87a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:52:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:52:18Z,use_quota=True,user_id='d7fd92b2d9f3439c9017bd9624e1c50a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:52:27 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-c33bec27-8eb5-4045-bc90-39350e8cc240 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Creating volume 520fd487-1437-409c-b349-83aec4ed2249 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:52:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c33bec27-8eb5-4045-bc90-39350e8cc240 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c33bec27-8eb5-4045-bc90-39350e8cc240 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:52:27 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-c33bec27-8eb5-4045-bc90-39350e8cc240 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:52:27 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-c33bec27-8eb5-4045-bc90-39350e8cc240 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:52:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c33bec27-8eb5-4045-bc90-39350e8cc240 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:52:27 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-c33bec27-8eb5-4045-bc90-39350e8cc240 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:52:27 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-c33bec27-8eb5-4045-bc90-39350e8cc240 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:52:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c33bec27-8eb5-4045-bc90-39350e8cc240 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-520fd487-1437-409c-b349-83aec4ed2249 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:27 devstack sudo[90218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-520fd487-1437-409c-b349-83aec4ed2249 1073741824
Apr 09 12:52:27 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-160f90c2-8a94-49ab-a59e-563569aac56f tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (130f0e3b-face-411c-8250-508d7da06db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f60f78b-f51b-47ac-af2f-71f9a32a60da', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:27 devstack sudo[90218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:27 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-160f90c2-8a94-49ab-a59e-563569aac56f tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71a0de98-d068-4652-88a1-2315f9a1b181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:27 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-160f90c2-8a94-49ab-a59e-563569aac56f tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Volume volume-6f60f78b-f51b-47ac-af2f-71f9a32a60da (6f60f78b-f51b-47ac-af2f-71f9a32a60da): created successfully
Apr 09 12:52:27 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-160f90c2-8a94-49ab-a59e-563569aac56f tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71a0de98-d068-4652-88a1-2315f9a1b181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:27 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-160f90c2-8a94-49ab-a59e-563569aac56f tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Flow 'volume_create_manager' (a4ace7e4-5adb-4b14-aa5f-0bc8cce31fbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:52:27 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-160f90c2-8a94-49ab-a59e-563569aac56f tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Created volume successfully.
Apr 09 12:52:27 devstack sudo[90215]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-412dec25-66be-4797-a826-5c2507993553 tempest-CreateVolumesFromImageTest-576799979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-178547e3-6e47-4bc9-a9be-7e6008b02570" returned: 0 in 0.655s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-412dec25-66be-4797-a826-5c2507993553 tempest-CreateVolumesFromImageTest-576799979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-178547e3-6e47-4bc9-a9be-7e6008b02570 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:27 devstack sudo[90223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-178547e3-6e47-4bc9-a9be-7e6008b02570
Apr 09 12:52:27 devstack sudo[90223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:28 devstack sudo[90223]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:28 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-412dec25-66be-4797-a826-5c2507993553 tempest-CreateVolumesFromImageTest-576799979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-178547e3-6e47-4bc9-a9be-7e6008b02570" returned: 0 in 0.663s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:28 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-412dec25-66be-4797-a826-5c2507993553 tempest-CreateVolumesFromImageTest-576799979 None] Lock "cinder-quobyte-178547e3-6e47-4bc9-a9be-7e6008b02570" released by "delete_volume" :: held 1.379s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:52:28 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-412dec25-66be-4797-a826-5c2507993553 tempest-CreateVolumesFromImageTest-576799979 None] Created reservations ['7dce2e6c-75d1-4538-ac4d-694b3759531c', '433d6cbf-e758-46ba-80b3-3602a2d2325e', '3061e9f9-063c-46e5-8f2d-03ed74cab295', '9435a556-23fe-489f-a84d-131cad214f9d'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:52:28 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-412dec25-66be-4797-a826-5c2507993553 tempest-CreateVolumesFromImageTest-576799979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:28 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-412dec25-66be-4797-a826-5c2507993553 tempest-CreateVolumesFromImageTest-576799979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:52:28 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-412dec25-66be-4797-a826-5c2507993553 tempest-CreateVolumesFromImageTest-576799979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:52:28 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-412dec25-66be-4797-a826-5c2507993553 tempest-CreateVolumesFromImageTest-576799979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:52:28 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-412dec25-66be-4797-a826-5c2507993553 tempest-CreateVolumesFromImageTest-576799979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:52:28 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-412dec25-66be-4797-a826-5c2507993553 tempest-CreateVolumesFromImageTest-576799979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:28 devstack sudo[90218]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:28 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c33bec27-8eb5-4045-bc90-39350e8cc240 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-520fd487-1437-409c-b349-83aec4ed2249 1073741824" returned: 0 in 1.059s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:28 devstack sudo[90229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:52:28 devstack sudo[90229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:28 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c33bec27-8eb5-4045-bc90-39350e8cc240 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-520fd487-1437-409c-b349-83aec4ed2249 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:28 devstack sudo[90231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-520fd487-1437-409c-b349-83aec4ed2249
Apr 09 12:52:28 devstack sudo[90231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:28 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ac9a198b-25e4-4995-8178-7beee5ae19c1 tempest-CreateVolumesFromImageTest-576799979 None] Acquiring lock "cinder-9a621f6a-931a-4bb5-8426-7df78620b69e-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:52:28 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ac9a198b-25e4-4995-8178-7beee5ae19c1 tempest-CreateVolumesFromImageTest-576799979 None] Lock "cinder-9a621f6a-931a-4bb5-8426-7df78620b69e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:52:28 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ac9a198b-25e4-4995-8178-7beee5ae19c1 tempest-CreateVolumesFromImageTest-576799979 None] Acquiring lock "cinder-quobyte-9a621f6a-931a-4bb5-8426-7df78620b69e" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:52:28 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ac9a198b-25e4-4995-8178-7beee5ae19c1 tempest-CreateVolumesFromImageTest-576799979 None] Lock "cinder-quobyte-9a621f6a-931a-4bb5-8426-7df78620b69e" acquired by "delete_volume" :: waited 0.009s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:52:28 devstack sudo[90231]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:29 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c33bec27-8eb5-4045-bc90-39350e8cc240 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-520fd487-1437-409c-b349-83aec4ed2249" returned: 0 in 0.672s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:29 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-c33bec27-8eb5-4045-bc90-39350e8cc240 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] <== create_volume: return (1795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:52:29 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c33bec27-8eb5-4045-bc90-39350e8cc240 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.799s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:52:29 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-5c5bb54b-3ba6-48fd-b389-c1293c56c027 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.076s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:52:29 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-5c5bb54b-3ba6-48fd-b389-c1293c56c027 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:52:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1596723564',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daabc055-d5a5-4c0c-9b16-311d6f0618b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df612b6d131c4d48b768abf0247ac87a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:52:19Z,use_quota=True,user_id='d7fd92b2d9f3439c9017bd9624e1c50a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:52:29 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-5c5bb54b-3ba6-48fd-b389-c1293c56c027 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Creating volume daabc055-d5a5-4c0c-9b16-311d6f0618b5 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:52:29 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-5c5bb54b-3ba6-48fd-b389-c1293c56c027 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:29 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-5c5bb54b-3ba6-48fd-b389-c1293c56c027 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:52:29 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-5c5bb54b-3ba6-48fd-b389-c1293c56c027 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:52:29 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-5c5bb54b-3ba6-48fd-b389-c1293c56c027 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:52:29 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-5c5bb54b-3ba6-48fd-b389-c1293c56c027 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:52:29 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-5c5bb54b-3ba6-48fd-b389-c1293c56c027 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:52:29 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-5c5bb54b-3ba6-48fd-b389-c1293c56c027 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:52:29 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-5c5bb54b-3ba6-48fd-b389-c1293c56c027 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-daabc055-d5a5-4c0c-9b16-311d6f0618b5 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:29 devstack sudo[90229]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:29 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d7e42b-5a1d-40da-a083-8b6dbf9770a4]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:52:29 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ac9a198b-25e4-4995-8178-7beee5ae19c1 tempest-CreateVolumesFromImageTest-576799979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a621f6a-931a-4bb5-8426-7df78620b69e {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:29 devstack sudo[90235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-daabc055-d5a5-4c0c-9b16-311d6f0618b5 1073741824
Apr 09 12:52:29 devstack sudo[90235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:29 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c33bec27-8eb5-4045-bc90-39350e8cc240 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbb2f4b4-c139-4cb6-9eeb-f3a998653ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-520fd487-1437-409c-b349-83aec4ed2249', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:29 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c33bec27-8eb5-4045-bc90-39350e8cc240 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (263e4dae-61b6-4748-8a44-9a6b7a97f418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:29 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-412dec25-66be-4797-a826-5c2507993553 tempest-CreateVolumesFromImageTest-576799979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.875s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:29 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-412dec25-66be-4797-a826-5c2507993553 tempest-CreateVolumesFromImageTest-576799979 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:52:29 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-412dec25-66be-4797-a826-5c2507993553 tempest-CreateVolumesFromImageTest-576799979 None] Deleted volume successfully.
Apr 09 12:52:29 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-c33bec27-8eb5-4045-bc90-39350e8cc240 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Volume volume-520fd487-1437-409c-b349-83aec4ed2249 (520fd487-1437-409c-b349-83aec4ed2249): created successfully
Apr 09 12:52:29 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c33bec27-8eb5-4045-bc90-39350e8cc240 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (263e4dae-61b6-4748-8a44-9a6b7a97f418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:29 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c33bec27-8eb5-4045-bc90-39350e8cc240 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Flow 'volume_create_manager' (4beaf83e-9e4b-436b-8018-3a39151cbb55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:52:29 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-c33bec27-8eb5-4045-bc90-39350e8cc240 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Created volume successfully.
Apr 09 12:52:29 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-412dec25-66be-4797-a826-5c2507993553 tempest-CreateVolumesFromImageTest-576799979 None] Lock "cinder-178547e3-6e47-4bc9-a9be-7e6008b02570-delete_volume" released by "delete_volume" :: held 2.533s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:52:29 devstack sudo[90236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a621f6a-931a-4bb5-8426-7df78620b69e
Apr 09 12:52:29 devstack sudo[90236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:29 devstack sudo[90235]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:29 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-5c5bb54b-3ba6-48fd-b389-c1293c56c027 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-daabc055-d5a5-4c0c-9b16-311d6f0618b5 1073741824" returned: 0 in 0.860s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:29 devstack sudo[90236]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:29 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ac9a198b-25e4-4995-8178-7beee5ae19c1 tempest-CreateVolumesFromImageTest-576799979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a621f6a-931a-4bb5-8426-7df78620b69e" returned: 0 in 0.866s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:29 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ac9a198b-25e4-4995-8178-7beee5ae19c1 tempest-CreateVolumesFromImageTest-576799979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a621f6a-931a-4bb5-8426-7df78620b69e {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:29 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-5c5bb54b-3ba6-48fd-b389-c1293c56c027 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-daabc055-d5a5-4c0c-9b16-311d6f0618b5 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:29 devstack sudo[90245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a621f6a-931a-4bb5-8426-7df78620b69e
Apr 09 12:52:29 devstack sudo[90245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:29 devstack sudo[90246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-daabc055-d5a5-4c0c-9b16-311d6f0618b5
Apr 09 12:52:29 devstack sudo[90246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:30 devstack sudo[90245]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:30 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ac9a198b-25e4-4995-8178-7beee5ae19c1 tempest-CreateVolumesFromImageTest-576799979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-9a621f6a-931a-4bb5-8426-7df78620b69e" returned: 0 in 0.635s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:30 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ac9a198b-25e4-4995-8178-7beee5ae19c1 tempest-CreateVolumesFromImageTest-576799979 None] Lock "cinder-quobyte-9a621f6a-931a-4bb5-8426-7df78620b69e" released by "delete_volume" :: held 1.581s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:52:30 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-ac9a198b-25e4-4995-8178-7beee5ae19c1 tempest-CreateVolumesFromImageTest-576799979 None] Created reservations ['2f542958-f6da-4184-bcc9-551a43ca8dba', 'c49bfda7-ae1d-48b0-a468-bb243d10b8d6', '8feb21e4-b27d-4909-8440-12ec8af08273', 'ab82ebae-7ac6-4fd0-b992-c221a7578c76'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:52:30 devstack sudo[90246]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:30 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-5c5bb54b-3ba6-48fd-b389-c1293c56c027 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-daabc055-d5a5-4c0c-9b16-311d6f0618b5" returned: 0 in 0.712s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:30 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-5c5bb54b-3ba6-48fd-b389-c1293c56c027 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] <== create_volume: return (1625ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:52:30 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-5c5bb54b-3ba6-48fd-b389-c1293c56c027 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.628s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:52:30 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c70b5eec-e926-4797-bb1b-bf2a60529b9d tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.367s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:52:30 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-c70b5eec-e926-4797-bb1b-bf2a60529b9d tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:52:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1387878168',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e9531b7-bcc2-41ea-95a9-61cd0f8fb203,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df612b6d131c4d48b768abf0247ac87a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:52:19Z,use_quota=True,user_id='d7fd92b2d9f3439c9017bd9624e1c50a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:52:30 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-c70b5eec-e926-4797-bb1b-bf2a60529b9d tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Creating volume 6e9531b7-bcc2-41ea-95a9-61cd0f8fb203 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:52:30 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c70b5eec-e926-4797-bb1b-bf2a60529b9d tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:30 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c70b5eec-e926-4797-bb1b-bf2a60529b9d tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:52:30 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-c70b5eec-e926-4797-bb1b-bf2a60529b9d tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:52:30 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-c70b5eec-e926-4797-bb1b-bf2a60529b9d tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:52:30 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c70b5eec-e926-4797-bb1b-bf2a60529b9d tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:52:30 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-c70b5eec-e926-4797-bb1b-bf2a60529b9d tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:52:30 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-c70b5eec-e926-4797-bb1b-bf2a60529b9d tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:52:30 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c70b5eec-e926-4797-bb1b-bf2a60529b9d tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6e9531b7-bcc2-41ea-95a9-61cd0f8fb203 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:30 devstack sudo[90251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6e9531b7-bcc2-41ea-95a9-61cd0f8fb203 1073741824
Apr 09 12:52:30 devstack sudo[90251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:30 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-5c5bb54b-3ba6-48fd-b389-c1293c56c027 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c87c2e88-a3bc-48d3-aeee-89d87ec3dba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daabc055-d5a5-4c0c-9b16-311d6f0618b5', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:30 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-5c5bb54b-3ba6-48fd-b389-c1293c56c027 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd1795d2-ea98-4aaf-9d5e-7e85ae7d47c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:30 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-5c5bb54b-3ba6-48fd-b389-c1293c56c027 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Volume volume-daabc055-d5a5-4c0c-9b16-311d6f0618b5 (daabc055-d5a5-4c0c-9b16-311d6f0618b5): created successfully
Apr 09 12:52:30 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-5c5bb54b-3ba6-48fd-b389-c1293c56c027 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd1795d2-ea98-4aaf-9d5e-7e85ae7d47c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:30 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-5c5bb54b-3ba6-48fd-b389-c1293c56c027 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Flow 'volume_create_manager' (dd42b66f-76f5-4cac-b6e0-882462b12f0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:52:30 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-5c5bb54b-3ba6-48fd-b389-c1293c56c027 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Created volume successfully.
Apr 09 12:52:30 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ac9a198b-25e4-4995-8178-7beee5ae19c1 tempest-CreateVolumesFromImageTest-576799979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:30 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ac9a198b-25e4-4995-8178-7beee5ae19c1 tempest-CreateVolumesFromImageTest-576799979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:52:30 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-ac9a198b-25e4-4995-8178-7beee5ae19c1 tempest-CreateVolumesFromImageTest-576799979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:52:30 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-ac9a198b-25e4-4995-8178-7beee5ae19c1 tempest-CreateVolumesFromImageTest-576799979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:52:30 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ac9a198b-25e4-4995-8178-7beee5ae19c1 tempest-CreateVolumesFromImageTest-576799979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:52:30 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ac9a198b-25e4-4995-8178-7beee5ae19c1 tempest-CreateVolumesFromImageTest-576799979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:30 devstack sudo[90253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:52:30 devstack sudo[90253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:31 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-0e152d97-a994-4967-9263-ad48f75dd925 tempest-CreateVolumesFromImageTest-576799979 None] Acquiring lock "cinder-48fbd8f4-d385-4669-8077-200b763cae2d-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:52:31 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-0e152d97-a994-4967-9263-ad48f75dd925 tempest-CreateVolumesFromImageTest-576799979 None] Lock "cinder-48fbd8f4-d385-4669-8077-200b763cae2d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:52:31 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-0e152d97-a994-4967-9263-ad48f75dd925 tempest-CreateVolumesFromImageTest-576799979 None] Acquiring lock "cinder-quobyte-48fbd8f4-d385-4669-8077-200b763cae2d" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:52:31 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-0e152d97-a994-4967-9263-ad48f75dd925 tempest-CreateVolumesFromImageTest-576799979 None] Lock "cinder-quobyte-48fbd8f4-d385-4669-8077-200b763cae2d" acquired by "delete_volume" :: waited 0.015s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:52:31 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[605a0e68-c408-4bb3-86d2-75a9080c456d]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:52:31 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-0e152d97-a994-4967-9263-ad48f75dd925 tempest-CreateVolumesFromImageTest-576799979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-48fbd8f4-d385-4669-8077-200b763cae2d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:31 devstack sudo[90258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-48fbd8f4-d385-4669-8077-200b763cae2d
Apr 09 12:52:31 devstack sudo[90258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:31 devstack sudo[90253]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:31 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ac9a198b-25e4-4995-8178-7beee5ae19c1 tempest-CreateVolumesFromImageTest-576799979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.796s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:31 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-ac9a198b-25e4-4995-8178-7beee5ae19c1 tempest-CreateVolumesFromImageTest-576799979 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:52:31 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-ac9a198b-25e4-4995-8178-7beee5ae19c1 tempest-CreateVolumesFromImageTest-576799979 None] Deleted volume successfully.
Apr 09 12:52:31 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ac9a198b-25e4-4995-8178-7beee5ae19c1 tempest-CreateVolumesFromImageTest-576799979 None] Lock "cinder-9a621f6a-931a-4bb5-8426-7df78620b69e-delete_volume" released by "delete_volume" :: held 2.685s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:52:31 devstack sudo[90251]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:31 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c70b5eec-e926-4797-bb1b-bf2a60529b9d tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6e9531b7-bcc2-41ea-95a9-61cd0f8fb203 1073741824" returned: 0 in 0.947s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:31 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c70b5eec-e926-4797-bb1b-bf2a60529b9d tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6e9531b7-bcc2-41ea-95a9-61cd0f8fb203 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:31 devstack sudo[90261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6e9531b7-bcc2-41ea-95a9-61cd0f8fb203
Apr 09 12:52:31 devstack sudo[90261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:32 devstack sudo[90258]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-0e152d97-a994-4967-9263-ad48f75dd925 tempest-CreateVolumesFromImageTest-576799979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-48fbd8f4-d385-4669-8077-200b763cae2d" returned: 0 in 0.871s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-0e152d97-a994-4967-9263-ad48f75dd925 tempest-CreateVolumesFromImageTest-576799979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-48fbd8f4-d385-4669-8077-200b763cae2d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:32 devstack sudo[90266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-48fbd8f4-d385-4669-8077-200b763cae2d
Apr 09 12:52:32 devstack sudo[90266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:32 devstack sudo[90261]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c70b5eec-e926-4797-bb1b-bf2a60529b9d tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6e9531b7-bcc2-41ea-95a9-61cd0f8fb203" returned: 0 in 0.813s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:32 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-c70b5eec-e926-4797-bb1b-bf2a60529b9d tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] <== create_volume: return (1804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:52:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-c70b5eec-e926-4797-bb1b-bf2a60529b9d tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.812s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:52:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d75af7aa-678e-4684-bc4d-86bd070f9a2a tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.992s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:52:32 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-d75af7aa-678e-4684-bc4d-86bd070f9a2a tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:52:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-35317194',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b063b65-6e81-47c2-bf9c-2a1550d20f3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df612b6d131c4d48b768abf0247ac87a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:52:19Z,use_quota=True,user_id='d7fd92b2d9f3439c9017bd9624e1c50a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:52:32 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-d75af7aa-678e-4684-bc4d-86bd070f9a2a tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Creating volume 3b063b65-6e81-47c2-bf9c-2a1550d20f3f {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:52:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d75af7aa-678e-4684-bc4d-86bd070f9a2a tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d75af7aa-678e-4684-bc4d-86bd070f9a2a tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:52:32 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-d75af7aa-678e-4684-bc4d-86bd070f9a2a tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:52:32 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-d75af7aa-678e-4684-bc4d-86bd070f9a2a tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:52:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d75af7aa-678e-4684-bc4d-86bd070f9a2a tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:52:32 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-d75af7aa-678e-4684-bc4d-86bd070f9a2a tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:52:32 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-d75af7aa-678e-4684-bc4d-86bd070f9a2a tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:52:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d75af7aa-678e-4684-bc4d-86bd070f9a2a tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3b063b65-6e81-47c2-bf9c-2a1550d20f3f 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:32 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c70b5eec-e926-4797-bb1b-bf2a60529b9d tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdfbf29c-fb69-43b5-9da7-80348bcb1b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e9531b7-bcc2-41ea-95a9-61cd0f8fb203', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:32 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c70b5eec-e926-4797-bb1b-bf2a60529b9d tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a985da85-ee2f-4d1f-a406-6ecf7e8dd9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:32 devstack sudo[90269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3b063b65-6e81-47c2-bf9c-2a1550d20f3f 1073741824
Apr 09 12:52:32 devstack sudo[90269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:32 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-c70b5eec-e926-4797-bb1b-bf2a60529b9d tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Volume volume-6e9531b7-bcc2-41ea-95a9-61cd0f8fb203 (6e9531b7-bcc2-41ea-95a9-61cd0f8fb203): created successfully
Apr 09 12:52:32 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c70b5eec-e926-4797-bb1b-bf2a60529b9d tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a985da85-ee2f-4d1f-a406-6ecf7e8dd9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:32 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-c70b5eec-e926-4797-bb1b-bf2a60529b9d tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Flow 'volume_create_manager' (29e88347-96e6-464a-8ceb-5e03c7ca6e3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:52:32 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-c70b5eec-e926-4797-bb1b-bf2a60529b9d tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Created volume successfully.
Apr 09 12:52:32 devstack sudo[90266]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-0e152d97-a994-4967-9263-ad48f75dd925 tempest-CreateVolumesFromImageTest-576799979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-48fbd8f4-d385-4669-8077-200b763cae2d" returned: 0 in 0.731s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:32 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-0e152d97-a994-4967-9263-ad48f75dd925 tempest-CreateVolumesFromImageTest-576799979 None] Lock "cinder-quobyte-48fbd8f4-d385-4669-8077-200b763cae2d" released by "delete_volume" :: held 1.649s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:52:32 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-0e152d97-a994-4967-9263-ad48f75dd925 tempest-CreateVolumesFromImageTest-576799979 None] Created reservations ['44bb2471-2d93-4606-b8de-f49811f5d9ff', '075403fc-7a82-498a-855c-1087ce3b3f35', '03a6c99b-004f-4a3d-9d07-1bb50507874b', '803937a6-3361-45da-9f54-ae5392458a6c'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:52:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-0e152d97-a994-4967-9263-ad48f75dd925 tempest-CreateVolumesFromImageTest-576799979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-0e152d97-a994-4967-9263-ad48f75dd925 tempest-CreateVolumesFromImageTest-576799979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:52:32 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-0e152d97-a994-4967-9263-ad48f75dd925 tempest-CreateVolumesFromImageTest-576799979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:52:32 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-0e152d97-a994-4967-9263-ad48f75dd925 tempest-CreateVolumesFromImageTest-576799979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:52:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-0e152d97-a994-4967-9263-ad48f75dd925 tempest-CreateVolumesFromImageTest-576799979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:52:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-0e152d97-a994-4967-9263-ad48f75dd925 tempest-CreateVolumesFromImageTest-576799979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:32 devstack sudo[90273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:52:32 devstack sudo[90273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:33 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-f1627f2c-fa6b-4ee4-aad2-d8fa06373a24 tempest-CreateVolumesFromImageTest-576799979 None] Acquiring lock "cinder-04037c42-c68e-4245-8d18-ba13bd444381-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:52:33 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-f1627f2c-fa6b-4ee4-aad2-d8fa06373a24 tempest-CreateVolumesFromImageTest-576799979 None] Lock "cinder-04037c42-c68e-4245-8d18-ba13bd444381-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:52:33 devstack sudo[90269]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:33 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d75af7aa-678e-4684-bc4d-86bd070f9a2a tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3b063b65-6e81-47c2-bf9c-2a1550d20f3f 1073741824" returned: 0 in 1.047s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:33 devstack sudo[90273]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:33 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-f1627f2c-fa6b-4ee4-aad2-d8fa06373a24 tempest-CreateVolumesFromImageTest-576799979 None] Acquiring lock "cinder-quobyte-04037c42-c68e-4245-8d18-ba13bd444381" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:52:33 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-0e152d97-a994-4967-9263-ad48f75dd925 tempest-CreateVolumesFromImageTest-576799979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.652s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:33 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-0e152d97-a994-4967-9263-ad48f75dd925 tempest-CreateVolumesFromImageTest-576799979 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:52:33 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d75af7aa-678e-4684-bc4d-86bd070f9a2a tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3b063b65-6e81-47c2-bf9c-2a1550d20f3f {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:33 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-0e152d97-a994-4967-9263-ad48f75dd925 tempest-CreateVolumesFromImageTest-576799979 None] Deleted volume successfully.
Apr 09 12:52:33 devstack sudo[90279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3b063b65-6e81-47c2-bf9c-2a1550d20f3f
Apr 09 12:52:33 devstack sudo[90279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:33 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-f1627f2c-fa6b-4ee4-aad2-d8fa06373a24 tempest-CreateVolumesFromImageTest-576799979 None] Lock "cinder-quobyte-04037c42-c68e-4245-8d18-ba13bd444381" acquired by "delete_volume" :: waited 0.055s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:52:33 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-0e152d97-a994-4967-9263-ad48f75dd925 tempest-CreateVolumesFromImageTest-576799979 None] Lock "cinder-48fbd8f4-d385-4669-8077-200b763cae2d-delete_volume" released by "delete_volume" :: held 2.557s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:52:33 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8112b2-e37b-4fb3-9f9a-3f025acd72fd]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:52:33 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f1627f2c-fa6b-4ee4-aad2-d8fa06373a24 tempest-CreateVolumesFromImageTest-576799979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-04037c42-c68e-4245-8d18-ba13bd444381 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:33 devstack sudo[90281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-04037c42-c68e-4245-8d18-ba13bd444381
Apr 09 12:52:33 devstack sudo[90281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:34 devstack sudo[90279]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:34 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-d75af7aa-678e-4684-bc4d-86bd070f9a2a tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3b063b65-6e81-47c2-bf9c-2a1550d20f3f" returned: 0 in 0.652s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:34 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-d75af7aa-678e-4684-bc4d-86bd070f9a2a tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] <== create_volume: return (1780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:52:34 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-d75af7aa-678e-4684-bc4d-86bd070f9a2a tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.795s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:52:34 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-586eeb3a-164f-483d-a864-e04764044771 tempest-VolumeDependencyTests-1907829774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 13.449s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:52:34 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-586eeb3a-164f-483d-a864-e04764044771 tempest-VolumeDependencyTests-1907829774 None] Creating offline snapshot 745b2e5e-78d9-4968-9cbf-bc5e85d56136 of volume a060e331-4d69-4f9f-bc23-29b77be0199d {{(pid=82760) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 12:52:34 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d75af7aa-678e-4684-bc4d-86bd070f9a2a tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39f4b4d5-00c8-4788-9641-a470f5d81cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b063b65-6e81-47c2-bf9c-2a1550d20f3f', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:34 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d75af7aa-678e-4684-bc4d-86bd070f9a2a tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6434af5d-2dc0-46e1-8ff4-1ed4ac057ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:34 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a36959-7d35-48c2-b52d-e8ba828de3b0]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:52:34 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-586eeb3a-164f-483d-a864-e04764044771 tempest-VolumeDependencyTests-1907829774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:34 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-d75af7aa-678e-4684-bc4d-86bd070f9a2a tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Volume volume-3b063b65-6e81-47c2-bf9c-2a1550d20f3f (3b063b65-6e81-47c2-bf9c-2a1550d20f3f): created successfully
Apr 09 12:52:34 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d75af7aa-678e-4684-bc4d-86bd070f9a2a tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6434af5d-2dc0-46e1-8ff4-1ed4ac057ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:34 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-d75af7aa-678e-4684-bc4d-86bd070f9a2a tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Flow 'volume_create_manager' (0adb509f-9b17-4d44-936d-f6fe786b0f57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:52:34 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-d75af7aa-678e-4684-bc4d-86bd070f9a2a tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Created volume successfully.
Apr 09 12:52:34 devstack sudo[90287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d
Apr 09 12:52:34 devstack sudo[90287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:34 devstack sudo[90281]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:34 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f1627f2c-fa6b-4ee4-aad2-d8fa06373a24 tempest-CreateVolumesFromImageTest-576799979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-04037c42-c68e-4245-8d18-ba13bd444381" returned: 0 in 0.826s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:34 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f1627f2c-fa6b-4ee4-aad2-d8fa06373a24 tempest-CreateVolumesFromImageTest-576799979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-04037c42-c68e-4245-8d18-ba13bd444381 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:34 devstack sudo[90289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-04037c42-c68e-4245-8d18-ba13bd444381
Apr 09 12:52:34 devstack sudo[90289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:34 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-73b5c6a5-68ea-43b6-b277-899dcbd35bba tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Acquiring lock "cinder-3b063b65-6e81-47c2-bf9c-2a1550d20f3f-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:52:34 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-73b5c6a5-68ea-43b6-b277-899dcbd35bba tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "cinder-3b063b65-6e81-47c2-bf9c-2a1550d20f3f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:52:35 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-73b5c6a5-68ea-43b6-b277-899dcbd35bba tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Acquiring lock "cinder-quobyte-3b063b65-6e81-47c2-bf9c-2a1550d20f3f" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:52:35 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-73b5c6a5-68ea-43b6-b277-899dcbd35bba tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "cinder-quobyte-3b063b65-6e81-47c2-bf9c-2a1550d20f3f" acquired by "delete_volume" :: waited 0.013s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:52:35 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[63281c55-99a8-4331-9c98-c813b4e6b73c]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:52:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-73b5c6a5-68ea-43b6-b277-899dcbd35bba tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3b063b65-6e81-47c2-bf9c-2a1550d20f3f {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:35 devstack sudo[90287]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-586eeb3a-164f-483d-a864-e04764044771 tempest-VolumeDependencyTests-1907829774 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d" returned: 0 in 0.759s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-586eeb3a-164f-483d-a864-e04764044771 tempest-VolumeDependencyTests-1907829774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d.745b2e5e-78d9-4968-9cbf-bc5e85d56136 1G {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:35 devstack sudo[90295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d.745b2e5e-78d9-4968-9cbf-bc5e85d56136 1G
Apr 09 12:52:35 devstack sudo[90295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:35 devstack sudo[90294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3b063b65-6e81-47c2-bf9c-2a1550d20f3f
Apr 09 12:52:35 devstack sudo[90294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:35 devstack sudo[90289]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f1627f2c-fa6b-4ee4-aad2-d8fa06373a24 tempest-CreateVolumesFromImageTest-576799979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-04037c42-c68e-4245-8d18-ba13bd444381" returned: 0 in 0.863s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:35 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-f1627f2c-fa6b-4ee4-aad2-d8fa06373a24 tempest-CreateVolumesFromImageTest-576799979 None] Lock "cinder-quobyte-04037c42-c68e-4245-8d18-ba13bd444381" released by "delete_volume" :: held 1.764s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:52:35 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-f1627f2c-fa6b-4ee4-aad2-d8fa06373a24 tempest-CreateVolumesFromImageTest-576799979 None] Created reservations ['43391b05-3f4b-4ea5-a51d-e3963697b710', '18f5023a-d4f8-46a0-9745-0c4e25f2041d', 'ffb087e5-208a-492f-a7bd-4b895630ba98', 'aaaf248d-e02d-4225-8595-393af6841be4'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:52:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f1627f2c-fa6b-4ee4-aad2-d8fa06373a24 tempest-CreateVolumesFromImageTest-576799979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f1627f2c-fa6b-4ee4-aad2-d8fa06373a24 tempest-CreateVolumesFromImageTest-576799979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:52:35 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f1627f2c-fa6b-4ee4-aad2-d8fa06373a24 tempest-CreateVolumesFromImageTest-576799979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:52:35 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f1627f2c-fa6b-4ee4-aad2-d8fa06373a24 tempest-CreateVolumesFromImageTest-576799979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:52:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f1627f2c-fa6b-4ee4-aad2-d8fa06373a24 tempest-CreateVolumesFromImageTest-576799979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:52:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f1627f2c-fa6b-4ee4-aad2-d8fa06373a24 tempest-CreateVolumesFromImageTest-576799979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:35 devstack sudo[90301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:52:35 devstack sudo[90301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:35 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ffcfd5f4-f7b0-4eaa-a21d-dfbc23486756 tempest-CreateVolumesFromImageTest-576799979 None] Acquiring lock "cinder-409664e9-d46c-4467-83a6-8ab291309ca8-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:52:35 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ffcfd5f4-f7b0-4eaa-a21d-dfbc23486756 tempest-CreateVolumesFromImageTest-576799979 None] Lock "cinder-409664e9-d46c-4467-83a6-8ab291309ca8-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:52:35 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ffcfd5f4-f7b0-4eaa-a21d-dfbc23486756 tempest-CreateVolumesFromImageTest-576799979 None] Acquiring lock "cinder-quobyte-409664e9-d46c-4467-83a6-8ab291309ca8" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:52:35 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ffcfd5f4-f7b0-4eaa-a21d-dfbc23486756 tempest-CreateVolumesFromImageTest-576799979 None] Lock "cinder-quobyte-409664e9-d46c-4467-83a6-8ab291309ca8" acquired by "delete_volume" :: waited 0.011s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:52:35 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcea458e-2a07-4aab-bb15-05cad1cfe6eb]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:52:35 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ffcfd5f4-f7b0-4eaa-a21d-dfbc23486756 tempest-CreateVolumesFromImageTest-576799979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-409664e9-d46c-4467-83a6-8ab291309ca8 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:36 devstack sudo[90295]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:36 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-586eeb3a-164f-483d-a864-e04764044771 tempest-VolumeDependencyTests-1907829774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d.745b2e5e-78d9-4968-9cbf-bc5e85d56136 1G" returned: 0 in 0.952s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:36 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-586eeb3a-164f-483d-a864-e04764044771 tempest-VolumeDependencyTests-1907829774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a060e331-4d69-4f9f-bc23-29b77be0199d -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d.745b2e5e-78d9-4968-9cbf-bc5e85d56136 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:36 devstack sudo[90308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a060e331-4d69-4f9f-bc23-29b77be0199d -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d.745b2e5e-78d9-4968-9cbf-bc5e85d56136
Apr 09 12:52:36 devstack sudo[90308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:36 devstack sudo[90294]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:36 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-73b5c6a5-68ea-43b6-b277-899dcbd35bba tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3b063b65-6e81-47c2-bf9c-2a1550d20f3f" returned: 0 in 1.067s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:36 devstack sudo[90307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-409664e9-d46c-4467-83a6-8ab291309ca8
Apr 09 12:52:36 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-73b5c6a5-68ea-43b6-b277-899dcbd35bba tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3b063b65-6e81-47c2-bf9c-2a1550d20f3f {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:36 devstack sudo[90307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:36 devstack sudo[90311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3b063b65-6e81-47c2-bf9c-2a1550d20f3f
Apr 09 12:52:36 devstack sudo[90311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:36 devstack sudo[90301]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:36 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f1627f2c-fa6b-4ee4-aad2-d8fa06373a24 tempest-CreateVolumesFromImageTest-576799979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 1.088s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:36 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-f1627f2c-fa6b-4ee4-aad2-d8fa06373a24 tempest-CreateVolumesFromImageTest-576799979 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:52:36 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-f1627f2c-fa6b-4ee4-aad2-d8fa06373a24 tempest-CreateVolumesFromImageTest-576799979 None] Deleted volume successfully.
Apr 09 12:52:36 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-f1627f2c-fa6b-4ee4-aad2-d8fa06373a24 tempest-CreateVolumesFromImageTest-576799979 None] Lock "cinder-04037c42-c68e-4245-8d18-ba13bd444381-delete_volume" released by "delete_volume" :: held 3.188s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:52:36 devstack sudo[90307]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:36 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ffcfd5f4-f7b0-4eaa-a21d-dfbc23486756 tempest-CreateVolumesFromImageTest-576799979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-409664e9-d46c-4467-83a6-8ab291309ca8" returned: 0 in 0.977s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:36 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ffcfd5f4-f7b0-4eaa-a21d-dfbc23486756 tempest-CreateVolumesFromImageTest-576799979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-409664e9-d46c-4467-83a6-8ab291309ca8 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:36 devstack sudo[90321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-409664e9-d46c-4467-83a6-8ab291309ca8
Apr 09 12:52:36 devstack sudo[90321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:36 devstack sudo[90308]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:36 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-586eeb3a-164f-483d-a864-e04764044771 tempest-VolumeDependencyTests-1907829774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a060e331-4d69-4f9f-bc23-29b77be0199d -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d.745b2e5e-78d9-4968-9cbf-bc5e85d56136" returned: 0 in 0.910s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:36 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-586eeb3a-164f-483d-a864-e04764044771 tempest-VolumeDependencyTests-1907829774 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d.745b2e5e-78d9-4968-9cbf-bc5e85d56136 is being set with open permissions: ugo+rw
Apr 09 12:52:36 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-586eeb3a-164f-483d-a864-e04764044771 tempest-VolumeDependencyTests-1907829774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d.745b2e5e-78d9-4968-9cbf-bc5e85d56136 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:36 devstack sudo[90311]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:37 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-73b5c6a5-68ea-43b6-b277-899dcbd35bba tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3b063b65-6e81-47c2-bf9c-2a1550d20f3f" returned: 0 in 0.883s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:37 devstack sudo[90323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d.745b2e5e-78d9-4968-9cbf-bc5e85d56136
Apr 09 12:52:37 devstack sudo[90323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:37 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-73b5c6a5-68ea-43b6-b277-899dcbd35bba tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "cinder-quobyte-3b063b65-6e81-47c2-bf9c-2a1550d20f3f" released by "delete_volume" :: held 1.994s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:52:37 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-73b5c6a5-68ea-43b6-b277-899dcbd35bba tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Created reservations ['ab422c11-7695-42dd-92fc-20a49012b122', '53c5e3d6-ab90-428d-8d1c-e4ff5e5f886e', '2bd27859-37fa-43af-99f6-5fff3ef4c7d3', 'f6c928fd-9c29-4891-8064-4bfab4201ed7'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:52:37 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-73b5c6a5-68ea-43b6-b277-899dcbd35bba tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:37 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-73b5c6a5-68ea-43b6-b277-899dcbd35bba tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:52:37 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-73b5c6a5-68ea-43b6-b277-899dcbd35bba tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:52:37 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-73b5c6a5-68ea-43b6-b277-899dcbd35bba tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:52:37 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-73b5c6a5-68ea-43b6-b277-899dcbd35bba tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:52:37 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-73b5c6a5-68ea-43b6-b277-899dcbd35bba tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:37 devstack sudo[90325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:52:37 devstack sudo[90325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:37 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-fb507fec-1561-4a63-b9ed-eb5779e05d3a tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Acquiring lock "cinder-6e9531b7-bcc2-41ea-95a9-61cd0f8fb203-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:52:37 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-fb507fec-1561-4a63-b9ed-eb5779e05d3a tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "cinder-6e9531b7-bcc2-41ea-95a9-61cd0f8fb203-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:52:37 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-fb507fec-1561-4a63-b9ed-eb5779e05d3a tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Acquiring lock "cinder-quobyte-6e9531b7-bcc2-41ea-95a9-61cd0f8fb203" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:52:37 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-fb507fec-1561-4a63-b9ed-eb5779e05d3a tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "cinder-quobyte-6e9531b7-bcc2-41ea-95a9-61cd0f8fb203" acquired by "delete_volume" :: waited 0.010s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:52:37 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c3bc4f-d5b3-4d9c-b8cd-25bce9d2a1df]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:52:37 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-fb507fec-1561-4a63-b9ed-eb5779e05d3a tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6e9531b7-bcc2-41ea-95a9-61cd0f8fb203 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:37 devstack sudo[90327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6e9531b7-bcc2-41ea-95a9-61cd0f8fb203
Apr 09 12:52:37 devstack sudo[90323]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:37 devstack sudo[90327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:37 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-586eeb3a-164f-483d-a864-e04764044771 tempest-VolumeDependencyTests-1907829774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d.745b2e5e-78d9-4968-9cbf-bc5e85d56136" returned: 0 in 0.605s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:37 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-586eeb3a-164f-483d-a864-e04764044771 tempest-VolumeDependencyTests-1907829774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:37 devstack sudo[90331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d.info
Apr 09 12:52:37 devstack sudo[90331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:37 devstack sudo[90321]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:37 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ffcfd5f4-f7b0-4eaa-a21d-dfbc23486756 tempest-CreateVolumesFromImageTest-576799979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-409664e9-d46c-4467-83a6-8ab291309ca8" returned: 0 in 0.868s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:37 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ffcfd5f4-f7b0-4eaa-a21d-dfbc23486756 tempest-CreateVolumesFromImageTest-576799979 None] Lock "cinder-quobyte-409664e9-d46c-4467-83a6-8ab291309ca8" released by "delete_volume" :: held 1.882s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:52:37 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-ffcfd5f4-f7b0-4eaa-a21d-dfbc23486756 tempest-CreateVolumesFromImageTest-576799979 None] Created reservations ['f6e833e4-884c-4bb2-8810-9d906cc7ac46', 'd11301b8-e1ca-4d20-ac5f-c56c5093c48d', 'e6e23c98-fa04-4204-8c77-85dde33b13c7', '8c8105f5-1dd7-46a1-8546-8dceaec230f1'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:52:37 devstack sudo[90325]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:37 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-12112d0c-3981-4eda-bc2f-ff2301ce94cb tempest-SnapshotDependencyTests-1880031669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:52:37 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-12112d0c-3981-4eda-bc2f-ff2301ce94cb tempest-SnapshotDependencyTests-1880031669 None] Flow 'volume_create_manager' (63ef52a5-e2eb-42fb-9568-b4a389267faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:52:37 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-12112d0c-3981-4eda-bc2f-ff2301ce94cb tempest-SnapshotDependencyTests-1880031669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e051242d-9343-4aef-89b1-ecead35d25f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:37 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-73b5c6a5-68ea-43b6-b277-899dcbd35bba tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.755s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:37 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-73b5c6a5-68ea-43b6-b277-899dcbd35bba tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:52:37 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-12112d0c-3981-4eda-bc2f-ff2301ce94cb tempest-SnapshotDependencyTests-1880031669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e051242d-9343-4aef-89b1-ecead35d25f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:52:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1908551133',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dcef0fe-f172-4c8d-b611-bb21edb84c15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ccb496c4f9149b59c4e3daaa24197d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:52:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:52:38Z,use_quota=True,user_id='b748e113f69f489ab1b2b92e338f276b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:37 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-12112d0c-3981-4eda-bc2f-ff2301ce94cb tempest-SnapshotDependencyTests-1880031669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d278470f-35c1-43c7-9065-d24f5cbefda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:37 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-12112d0c-3981-4eda-bc2f-ff2301ce94cb tempest-SnapshotDependencyTests-1880031669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d278470f-35c1-43c7-9065-d24f5cbefda7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:37 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-12112d0c-3981-4eda-bc2f-ff2301ce94cb tempest-SnapshotDependencyTests-1880031669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efbf88dd-33b0-4ce6-b5af-3628e851400a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:37 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-12112d0c-3981-4eda-bc2f-ff2301ce94cb tempest-SnapshotDependencyTests-1880031669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efbf88dd-33b0-4ce6-b5af-3628e851400a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dcef0fe-f172-4c8d-b611-bb21edb84c15', 'volume_name': 'volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:37 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-12112d0c-3981-4eda-bc2f-ff2301ce94cb tempest-SnapshotDependencyTests-1880031669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0cbc19f-f9ee-42b7-b5a9-d1e3ad1cd89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:37 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-12112d0c-3981-4eda-bc2f-ff2301ce94cb tempest-SnapshotDependencyTests-1880031669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0cbc19f-f9ee-42b7-b5a9-d1e3ad1cd89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:37 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-12112d0c-3981-4eda-bc2f-ff2301ce94cb tempest-SnapshotDependencyTests-1880031669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebb30895-74f2-4032-b6e2-31873cb77663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:37 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-12112d0c-3981-4eda-bc2f-ff2301ce94cb tempest-SnapshotDependencyTests-1880031669 None] Volume 5dcef0fe-f172-4c8d-b611-bb21edb84c15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15', 'volume_size': 1}
Apr 09 12:52:37 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-12112d0c-3981-4eda-bc2f-ff2301ce94cb tempest-SnapshotDependencyTests-1880031669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:37 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-73b5c6a5-68ea-43b6-b277-899dcbd35bba tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Deleted volume successfully.
Apr 09 12:52:37 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-73b5c6a5-68ea-43b6-b277-899dcbd35bba tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "cinder-3b063b65-6e81-47c2-bf9c-2a1550d20f3f-delete_volume" released by "delete_volume" :: held 3.027s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:52:37 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ffcfd5f4-f7b0-4eaa-a21d-dfbc23486756 tempest-CreateVolumesFromImageTest-576799979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:37 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ffcfd5f4-f7b0-4eaa-a21d-dfbc23486756 tempest-CreateVolumesFromImageTest-576799979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:52:37 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-ffcfd5f4-f7b0-4eaa-a21d-dfbc23486756 tempest-CreateVolumesFromImageTest-576799979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:52:37 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-ffcfd5f4-f7b0-4eaa-a21d-dfbc23486756 tempest-CreateVolumesFromImageTest-576799979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:52:37 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ffcfd5f4-f7b0-4eaa-a21d-dfbc23486756 tempest-CreateVolumesFromImageTest-576799979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:52:37 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ffcfd5f4-f7b0-4eaa-a21d-dfbc23486756 tempest-CreateVolumesFromImageTest-576799979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:38 devstack sudo[90334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:52:38 devstack sudo[90334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:38 devstack sudo[90327]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-fb507fec-1561-4a63-b9ed-eb5779e05d3a tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6e9531b7-bcc2-41ea-95a9-61cd0f8fb203" returned: 0 in 0.782s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-fb507fec-1561-4a63-b9ed-eb5779e05d3a tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6e9531b7-bcc2-41ea-95a9-61cd0f8fb203 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:38 devstack sudo[90339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6e9531b7-bcc2-41ea-95a9-61cd0f8fb203
Apr 09 12:52:38 devstack sudo[90339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:38 devstack sudo[90331]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-586eeb3a-164f-483d-a864-e04764044771 tempest-VolumeDependencyTests-1907829774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d.info" returned: 0 in 0.793s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:38 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-586eeb3a-164f-483d-a864-e04764044771 tempest-VolumeDependencyTests-1907829774 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d.info is being set with open permissions: ugo+rw
Apr 09 12:52:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-586eeb3a-164f-483d-a864-e04764044771 tempest-VolumeDependencyTests-1907829774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:38 devstack sudo[90342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d.info
Apr 09 12:52:38 devstack sudo[90342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:38 devstack sudo[90334]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ffcfd5f4-f7b0-4eaa-a21d-dfbc23486756 tempest-CreateVolumesFromImageTest-576799979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.686s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:38 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-ffcfd5f4-f7b0-4eaa-a21d-dfbc23486756 tempest-CreateVolumesFromImageTest-576799979 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:52:38 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-ffcfd5f4-f7b0-4eaa-a21d-dfbc23486756 tempest-CreateVolumesFromImageTest-576799979 None] Deleted volume successfully.
Apr 09 12:52:38 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ffcfd5f4-f7b0-4eaa-a21d-dfbc23486756 tempest-CreateVolumesFromImageTest-576799979 None] Lock "cinder-409664e9-d46c-4467-83a6-8ab291309ca8-delete_volume" released by "delete_volume" :: held 2.901s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:52:38 devstack sudo[90339]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-fb507fec-1561-4a63-b9ed-eb5779e05d3a tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6e9531b7-bcc2-41ea-95a9-61cd0f8fb203" returned: 0 in 0.622s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:38 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-fb507fec-1561-4a63-b9ed-eb5779e05d3a tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "cinder-quobyte-6e9531b7-bcc2-41ea-95a9-61cd0f8fb203" released by "delete_volume" :: held 1.439s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:52:38 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-fb507fec-1561-4a63-b9ed-eb5779e05d3a tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Created reservations ['694d0122-4c9f-42cf-b04a-6ba4399da5e0', 'd2be58db-c8a3-404c-82a1-2595b9209d20', '0a0ed1f5-0c6b-4d6b-bddf-e6f97e1f8df9', '422cd91f-7785-4288-af02-9503411b3935'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:52:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-fb507fec-1561-4a63-b9ed-eb5779e05d3a tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-fb507fec-1561-4a63-b9ed-eb5779e05d3a tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:52:38 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-fb507fec-1561-4a63-b9ed-eb5779e05d3a tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:52:38 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-fb507fec-1561-4a63-b9ed-eb5779e05d3a tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:52:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-fb507fec-1561-4a63-b9ed-eb5779e05d3a tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:52:38 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-fb507fec-1561-4a63-b9ed-eb5779e05d3a tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:38 devstack sudo[90347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:52:38 devstack sudo[90347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:39 devstack sudo[90342]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-586eeb3a-164f-483d-a864-e04764044771 tempest-VolumeDependencyTests-1907829774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d.info" returned: 0 in 0.648s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-586eeb3a-164f-483d-a864-e04764044771 tempest-VolumeDependencyTests-1907829774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.790s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:52:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-12112d0c-3981-4eda-bc2f-ff2301ce94cb tempest-SnapshotDependencyTests-1880031669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.121s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:52:39 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-12112d0c-3981-4eda-bc2f-ff2301ce94cb tempest-SnapshotDependencyTests-1880031669 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:52:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1908551133',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dcef0fe-f172-4c8d-b611-bb21edb84c15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ccb496c4f9149b59c4e3daaa24197d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:52:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:52:38Z,use_quota=True,user_id='b748e113f69f489ab1b2b92e338f276b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:52:39 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-12112d0c-3981-4eda-bc2f-ff2301ce94cb tempest-SnapshotDependencyTests-1880031669 None] Creating volume 5dcef0fe-f172-4c8d-b611-bb21edb84c15 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:52:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-12112d0c-3981-4eda-bc2f-ff2301ce94cb tempest-SnapshotDependencyTests-1880031669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-12112d0c-3981-4eda-bc2f-ff2301ce94cb tempest-SnapshotDependencyTests-1880031669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:52:39 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-12112d0c-3981-4eda-bc2f-ff2301ce94cb tempest-SnapshotDependencyTests-1880031669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:52:39 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-12112d0c-3981-4eda-bc2f-ff2301ce94cb tempest-SnapshotDependencyTests-1880031669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:52:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-12112d0c-3981-4eda-bc2f-ff2301ce94cb tempest-SnapshotDependencyTests-1880031669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:52:39 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-12112d0c-3981-4eda-bc2f-ff2301ce94cb tempest-SnapshotDependencyTests-1880031669 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:52:39 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-12112d0c-3981-4eda-bc2f-ff2301ce94cb tempest-SnapshotDependencyTests-1880031669 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:52:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-12112d0c-3981-4eda-bc2f-ff2301ce94cb tempest-SnapshotDependencyTests-1880031669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:39 devstack sudo[90349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15 1073741824
Apr 09 12:52:39 devstack sudo[90349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:39 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-586eeb3a-164f-483d-a864-e04764044771 tempest-VolumeDependencyTests-1907829774 None] Create snapshot completed successfully
Apr 09 12:52:39 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-e03956a6-a0ae-4d43-b40e-f83f07c857cb tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Acquiring lock "cinder-daabc055-d5a5-4c0c-9b16-311d6f0618b5-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:52:39 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-e03956a6-a0ae-4d43-b40e-f83f07c857cb tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "cinder-daabc055-d5a5-4c0c-9b16-311d6f0618b5-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:52:39 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-e03956a6-a0ae-4d43-b40e-f83f07c857cb tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Acquiring lock "cinder-quobyte-daabc055-d5a5-4c0c-9b16-311d6f0618b5" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:52:39 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-e03956a6-a0ae-4d43-b40e-f83f07c857cb tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "cinder-quobyte-daabc055-d5a5-4c0c-9b16-311d6f0618b5" acquired by "delete_volume" :: waited 0.014s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:52:39 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[46888fb0-22e5-4135-8353-41d0fd757d68]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:52:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e03956a6-a0ae-4d43-b40e-f83f07c857cb tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-daabc055-d5a5-4c0c-9b16-311d6f0618b5 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:39 devstack sudo[90347]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-fb507fec-1561-4a63-b9ed-eb5779e05d3a tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.709s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:39 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-fb507fec-1561-4a63-b9ed-eb5779e05d3a tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:52:39 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-fb507fec-1561-4a63-b9ed-eb5779e05d3a tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Deleted volume successfully.
Apr 09 12:52:39 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-fb507fec-1561-4a63-b9ed-eb5779e05d3a tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "cinder-6e9531b7-bcc2-41ea-95a9-61cd0f8fb203-delete_volume" released by "delete_volume" :: held 2.412s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:52:39 devstack sudo[90355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-daabc055-d5a5-4c0c-9b16-311d6f0618b5
Apr 09 12:52:39 devstack sudo[90355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:39 devstack sudo[90349]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-12112d0c-3981-4eda-bc2f-ff2301ce94cb tempest-SnapshotDependencyTests-1880031669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15 1073741824" returned: 0 in 0.698s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:39 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-12112d0c-3981-4eda-bc2f-ff2301ce94cb tempest-SnapshotDependencyTests-1880031669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:39 devstack sudo[90357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15
Apr 09 12:52:39 devstack sudo[90357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:40 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-de2b71b1-2241-4430-aa06-548b03f09338 tempest-VolumeDependencyTests-1907829774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:52:40 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-de2b71b1-2241-4430-aa06-548b03f09338 tempest-VolumeDependencyTests-1907829774 None] Flow 'volume_create_manager' (8a254d0f-dc76-4d42-964e-fdb3e9832982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:52:40 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-de2b71b1-2241-4430-aa06-548b03f09338 tempest-VolumeDependencyTests-1907829774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (626a099c-c72e-4251-a98e-41f72f0a2609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:40 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-de2b71b1-2241-4430-aa06-548b03f09338 tempest-VolumeDependencyTests-1907829774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (626a099c-c72e-4251-a98e-41f72f0a2609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:52:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1135534948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b58cbf29-bc38-4424-ac76-cd8d16ae26a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0ac4240c434cf2bbb5c358ac539020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:52:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=745b2e5e-78d9-4968-9cbf-bc5e85d56136,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:52:40Z,use_quota=True,user_id='7c5570febc704767b49e00c1d41d2df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:40 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-de2b71b1-2241-4430-aa06-548b03f09338 tempest-VolumeDependencyTests-1907829774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11c15188-2945-4d6c-a9a7-8c17eb77f84d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:40 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-de2b71b1-2241-4430-aa06-548b03f09338 tempest-VolumeDependencyTests-1907829774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11c15188-2945-4d6c-a9a7-8c17eb77f84d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:40 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-de2b71b1-2241-4430-aa06-548b03f09338 tempest-VolumeDependencyTests-1907829774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (317ea322-eddb-4811-a063-d56d732d1eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:40 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-de2b71b1-2241-4430-aa06-548b03f09338 tempest-VolumeDependencyTests-1907829774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (317ea322-eddb-4811-a063-d56d732d1eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b58cbf29-bc38-4424-ac76-cd8d16ae26a4', 'volume_name': 'volume-b58cbf29-bc38-4424-ac76-cd8d16ae26a4', 'volume_size': 1, 'snapshot_id': '745b2e5e-78d9-4968-9cbf-bc5e85d56136'}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:40 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-de2b71b1-2241-4430-aa06-548b03f09338 tempest-VolumeDependencyTests-1907829774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b1b1532-2c00-446e-ad49-8ad4c292bcf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:40 devstack sudo[90355]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:40 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-de2b71b1-2241-4430-aa06-548b03f09338 tempest-VolumeDependencyTests-1907829774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b1b1532-2c00-446e-ad49-8ad4c292bcf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:40 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-de2b71b1-2241-4430-aa06-548b03f09338 tempest-VolumeDependencyTests-1907829774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dea8b537-2df0-4838-875e-ba1da3ce44b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:40 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-de2b71b1-2241-4430-aa06-548b03f09338 tempest-VolumeDependencyTests-1907829774 None] Volume b58cbf29-bc38-4424-ac76-cd8d16ae26a4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b58cbf29-bc38-4424-ac76-cd8d16ae26a4', 'volume_size': 1, 'snapshot_id': '745b2e5e-78d9-4968-9cbf-bc5e85d56136'}
Apr 09 12:52:40 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e03956a6-a0ae-4d43-b40e-f83f07c857cb tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-daabc055-d5a5-4c0c-9b16-311d6f0618b5" returned: 0 in 0.758s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:40 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e03956a6-a0ae-4d43-b40e-f83f07c857cb tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-daabc055-d5a5-4c0c-9b16-311d6f0618b5 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:40 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-de2b71b1-2241-4430-aa06-548b03f09338 tempest-VolumeDependencyTests-1907829774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:40 devstack sudo[90363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-daabc055-d5a5-4c0c-9b16-311d6f0618b5
Apr 09 12:52:40 devstack sudo[90363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:40 devstack sudo[90357]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:40 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-12112d0c-3981-4eda-bc2f-ff2301ce94cb tempest-SnapshotDependencyTests-1880031669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15" returned: 0 in 0.680s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:40 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-12112d0c-3981-4eda-bc2f-ff2301ce94cb tempest-SnapshotDependencyTests-1880031669 None] <== create_volume: return (1413ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:52:40 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-12112d0c-3981-4eda-bc2f-ff2301ce94cb tempest-SnapshotDependencyTests-1880031669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.417s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:52:40 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-de2b71b1-2241-4430-aa06-548b03f09338 tempest-VolumeDependencyTests-1907829774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.121s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:52:40 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-de2b71b1-2241-4430-aa06-548b03f09338 tempest-VolumeDependencyTests-1907829774 None] Acquiring lock "cinder-quobyte-745b2e5e-78d9-4968-9cbf-bc5e85d56136-b58cbf29-bc38-4424-ac76-cd8d16ae26a4" by "_create_volume_from_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:52:40 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-12112d0c-3981-4eda-bc2f-ff2301ce94cb tempest-SnapshotDependencyTests-1880031669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebb30895-74f2-4032-b6e2-31873cb77663) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:40 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-12112d0c-3981-4eda-bc2f-ff2301ce94cb tempest-SnapshotDependencyTests-1880031669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24445f9a-3b98-491d-a8f7-7de28d6b3086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:40 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-de2b71b1-2241-4430-aa06-548b03f09338 tempest-VolumeDependencyTests-1907829774 None] Lock "cinder-quobyte-745b2e5e-78d9-4968-9cbf-bc5e85d56136-b58cbf29-bc38-4424-ac76-cd8d16ae26a4" acquired by "_create_volume_from_snapshot" :: waited 0.043s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:52:40 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-de2b71b1-2241-4430-aa06-548b03f09338 tempest-VolumeDependencyTests-1907829774 None] Creating volume b58cbf29-bc38-4424-ac76-cd8d16ae26a4 from snapshot 745b2e5e-78d9-4968-9cbf-bc5e85d56136 {{(pid=82760) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 09 12:52:40 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-de2b71b1-2241-4430-aa06-548b03f09338 tempest-VolumeDependencyTests-1907829774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:40 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-de2b71b1-2241-4430-aa06-548b03f09338 tempest-VolumeDependencyTests-1907829774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:52:40 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-de2b71b1-2241-4430-aa06-548b03f09338 tempest-VolumeDependencyTests-1907829774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:52:40 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-de2b71b1-2241-4430-aa06-548b03f09338 tempest-VolumeDependencyTests-1907829774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:52:40 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-de2b71b1-2241-4430-aa06-548b03f09338 tempest-VolumeDependencyTests-1907829774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:52:40 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-de2b71b1-2241-4430-aa06-548b03f09338 tempest-VolumeDependencyTests-1907829774 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:52:40 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-de2b71b1-2241-4430-aa06-548b03f09338 tempest-VolumeDependencyTests-1907829774 None] Acquiring lock "cinder-quobyte-b58cbf29-bc38-4424-ac76-cd8d16ae26a4" by "_copy_volume_from_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:52:40 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-de2b71b1-2241-4430-aa06-548b03f09338 tempest-VolumeDependencyTests-1907829774 None] Lock "cinder-quobyte-b58cbf29-bc38-4424-ac76-cd8d16ae26a4" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:52:40 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-de2b71b1-2241-4430-aa06-548b03f09338 tempest-VolumeDependencyTests-1907829774 None] snapshot: 745b2e5e-78d9-4968-9cbf-bc5e85d56136, volume: b58cbf29-bc38-4424-ac76-cd8d16ae26a4,  {{(pid=82760) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 09 12:52:40 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-12112d0c-3981-4eda-bc2f-ff2301ce94cb tempest-SnapshotDependencyTests-1880031669 None] Volume volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15 (5dcef0fe-f172-4c8d-b611-bb21edb84c15): created successfully
Apr 09 12:52:40 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-12112d0c-3981-4eda-bc2f-ff2301ce94cb tempest-SnapshotDependencyTests-1880031669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24445f9a-3b98-491d-a8f7-7de28d6b3086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:40 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-12112d0c-3981-4eda-bc2f-ff2301ce94cb tempest-SnapshotDependencyTests-1880031669 None] Flow 'volume_create_manager' (63ef52a5-e2eb-42fb-9568-b4a389267faf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:52:40 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-12112d0c-3981-4eda-bc2f-ff2301ce94cb tempest-SnapshotDependencyTests-1880031669 None] Created volume successfully.
Apr 09 12:52:40 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-de2b71b1-2241-4430-aa06-548b03f09338 tempest-VolumeDependencyTests-1907829774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:40 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-de2b71b1-2241-4430-aa06-548b03f09338 tempest-VolumeDependencyTests-1907829774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:52:40 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-de2b71b1-2241-4430-aa06-548b03f09338 tempest-VolumeDependencyTests-1907829774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:52:40 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-de2b71b1-2241-4430-aa06-548b03f09338 tempest-VolumeDependencyTests-1907829774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:52:40 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-de2b71b1-2241-4430-aa06-548b03f09338 tempest-VolumeDependencyTests-1907829774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:52:40 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[7414279c-feb5-4614-b15a-b4acd1258652]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:52:40 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-de2b71b1-2241-4430-aa06-548b03f09338 tempest-VolumeDependencyTests-1907829774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d.745b2e5e-78d9-4968-9cbf-bc5e85d56136 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:40 devstack sudo[90365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d.745b2e5e-78d9-4968-9cbf-bc5e85d56136
Apr 09 12:52:40 devstack sudo[90365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:41 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe2e18bf-7374-4004-b341-3de45dea6146 tempest-CreateVolumesFromSnapshotTest-828104883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:52:41 devstack sudo[90363]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:41 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-fe2e18bf-7374-4004-b341-3de45dea6146 tempest-CreateVolumesFromSnapshotTest-828104883 None] Flow 'volume_create_manager' (f26a149c-0771-480c-bacb-302ff2514d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:52:41 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-fe2e18bf-7374-4004-b341-3de45dea6146 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f84b5829-b125-4bf9-9662-e2c9564c37e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:41 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-fe2e18bf-7374-4004-b341-3de45dea6146 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f84b5829-b125-4bf9-9662-e2c9564c37e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:52:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1174157898',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37d74158-2b90-4321-ab38-1d4a49da6fe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b444a78f57b4e92819c661a31e3eb24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:52:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:52:41Z,use_quota=True,user_id='82524731e1384a9fa5a94656d03e1874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:41 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-fe2e18bf-7374-4004-b341-3de45dea6146 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a27796d-0bf0-4929-b388-164b8490916b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:41 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-fe2e18bf-7374-4004-b341-3de45dea6146 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a27796d-0bf0-4929-b388-164b8490916b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:41 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-fe2e18bf-7374-4004-b341-3de45dea6146 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3815490a-518c-48fa-a3e5-8a56197e5cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:41 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-fe2e18bf-7374-4004-b341-3de45dea6146 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3815490a-518c-48fa-a3e5-8a56197e5cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37d74158-2b90-4321-ab38-1d4a49da6fe7', 'volume_name': 'volume-37d74158-2b90-4321-ab38-1d4a49da6fe7', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:41 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-fe2e18bf-7374-4004-b341-3de45dea6146 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2265fcf-cdb1-460a-9807-38d4b9b0ca5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:41 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-fe2e18bf-7374-4004-b341-3de45dea6146 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2265fcf-cdb1-460a-9807-38d4b9b0ca5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:41 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-fe2e18bf-7374-4004-b341-3de45dea6146 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fa1cd47-9b0e-4f22-919c-e49a97c1cb36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:41 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-fe2e18bf-7374-4004-b341-3de45dea6146 tempest-CreateVolumesFromSnapshotTest-828104883 None] Volume 37d74158-2b90-4321-ab38-1d4a49da6fe7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37d74158-2b90-4321-ab38-1d4a49da6fe7', 'volume_size': 1}
Apr 09 12:52:41 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-fe2e18bf-7374-4004-b341-3de45dea6146 tempest-CreateVolumesFromSnapshotTest-828104883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:41 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e03956a6-a0ae-4d43-b40e-f83f07c857cb tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-daabc055-d5a5-4c0c-9b16-311d6f0618b5" returned: 0 in 0.958s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:41 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-e03956a6-a0ae-4d43-b40e-f83f07c857cb tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "cinder-quobyte-daabc055-d5a5-4c0c-9b16-311d6f0618b5" released by "delete_volume" :: held 1.777s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:52:41 devstack sudo[90365]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:41 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-de2b71b1-2241-4430-aa06-548b03f09338 tempest-VolumeDependencyTests-1907829774 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d.745b2e5e-78d9-4968-9cbf-bc5e85d56136" returned: 0 in 0.736s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:41 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-de2b71b1-2241-4430-aa06-548b03f09338 tempest-VolumeDependencyTests-1907829774 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a060e331-4d69-4f9f-bc23-29b77be0199d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:52:41 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-de2b71b1-2241-4430-aa06-548b03f09338 tempest-VolumeDependencyTests-1907829774 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d {{(pid=82760) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 09 12:52:41 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-de2b71b1-2241-4430-aa06-548b03f09338 tempest-VolumeDependencyTests-1907829774 None] Creating direct copy from snapshot {{(pid=82760) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 09 12:52:41 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f78b88-6109-4009-943c-0db9b6213b84]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:52:41 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-de2b71b1-2241-4430-aa06-548b03f09338 tempest-VolumeDependencyTests-1907829774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:41 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-e03956a6-a0ae-4d43-b40e-f83f07c857cb tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Created reservations ['36d35e5c-c677-44a9-819c-4ce8118e4af5', '67d030cc-3481-4451-b14a-08964fac2726', '2cf8ef69-d663-471b-8c5b-c5b30f908841', '10c73737-e4b4-4247-ac57-ef733bbdbb8e'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:52:41 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f79f3601-6dfb-439e-8586-acb6a96c35fa tempest-SnapshotDependencyTests-1880031669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:41 devstack sudo[90403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d
Apr 09 12:52:41 devstack sudo[90403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:41 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-e03956a6-a0ae-4d43-b40e-f83f07c857cb tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:41 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-e03956a6-a0ae-4d43-b40e-f83f07c857cb tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:52:41 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-e03956a6-a0ae-4d43-b40e-f83f07c857cb tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:52:41 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-e03956a6-a0ae-4d43-b40e-f83f07c857cb tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:52:41 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-e03956a6-a0ae-4d43-b40e-f83f07c857cb tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:52:41 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e03956a6-a0ae-4d43-b40e-f83f07c857cb tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:41 devstack sudo[90407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:52:41 devstack sudo[90407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:41 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-be9b6ac7-e0ee-4a3e-a8ac-af0da6ec3c69 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Acquiring lock "cinder-520fd487-1437-409c-b349-83aec4ed2249-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:52:41 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-be9b6ac7-e0ee-4a3e-a8ac-af0da6ec3c69 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "cinder-520fd487-1437-409c-b349-83aec4ed2249-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:52:41 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-be9b6ac7-e0ee-4a3e-a8ac-af0da6ec3c69 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Acquiring lock "cinder-quobyte-520fd487-1437-409c-b349-83aec4ed2249" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:52:41 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-be9b6ac7-e0ee-4a3e-a8ac-af0da6ec3c69 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "cinder-quobyte-520fd487-1437-409c-b349-83aec4ed2249" acquired by "delete_volume" :: waited 0.018s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:52:41 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[33029ffc-5103-4ecb-ab93-bcdc0d6deb2c]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:52:41 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-be9b6ac7-e0ee-4a3e-a8ac-af0da6ec3c69 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-520fd487-1437-409c-b349-83aec4ed2249 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:42 devstack sudo[90409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-520fd487-1437-409c-b349-83aec4ed2249
Apr 09 12:52:42 devstack sudo[90409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:42 devstack sudo[90403]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:42 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-de2b71b1-2241-4430-aa06-548b03f09338 tempest-VolumeDependencyTests-1907829774 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d" returned: 0 in 0.808s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:42 devstack cinder-volume[82760]: DEBUG cinder.utils [None req-de2b71b1-2241-4430-aa06-548b03f09338 tempest-VolumeDependencyTests-1907829774 None] Path /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-b58cbf29-bc38-4424-ac76-cd8d16ae26a4 not found in is_blk_device check {{(pid=82760) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 09 12:52:42 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-de2b71b1-2241-4430-aa06-548b03f09338 tempest-VolumeDependencyTests-1907829774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-b58cbf29-bc38-4424-ac76-cd8d16ae26a4 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:42 devstack sudo[90415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-b58cbf29-bc38-4424-ac76-cd8d16ae26a4
Apr 09 12:52:42 devstack sudo[90415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:42 devstack sudo[90407]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:42 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e03956a6-a0ae-4d43-b40e-f83f07c857cb tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.686s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:42 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-e03956a6-a0ae-4d43-b40e-f83f07c857cb tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:52:42 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-e03956a6-a0ae-4d43-b40e-f83f07c857cb tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Deleted volume successfully.
Apr 09 12:52:42 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-e03956a6-a0ae-4d43-b40e-f83f07c857cb tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "cinder-daabc055-d5a5-4c0c-9b16-311d6f0618b5-delete_volume" released by "delete_volume" :: held 2.809s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:52:42 devstack sudo[90409]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:42 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-be9b6ac7-e0ee-4a3e-a8ac-af0da6ec3c69 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-520fd487-1437-409c-b349-83aec4ed2249" returned: 0 in 0.817s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:42 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-be9b6ac7-e0ee-4a3e-a8ac-af0da6ec3c69 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-520fd487-1437-409c-b349-83aec4ed2249 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:42 devstack sudo[90424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-520fd487-1437-409c-b349-83aec4ed2249
Apr 09 12:52:42 devstack sudo[90424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:43 devstack sudo[90424]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:43 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-be9b6ac7-e0ee-4a3e-a8ac-af0da6ec3c69 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-520fd487-1437-409c-b349-83aec4ed2249" returned: 0 in 1.027s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:43 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-be9b6ac7-e0ee-4a3e-a8ac-af0da6ec3c69 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "cinder-quobyte-520fd487-1437-409c-b349-83aec4ed2249" released by "delete_volume" :: held 1.891s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:52:43 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-be9b6ac7-e0ee-4a3e-a8ac-af0da6ec3c69 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Created reservations ['791b56a3-f00e-42bc-8efe-df2b8899c649', 'd31ed740-f1fa-459b-9332-3472906bc86f', '434f0e08-f329-45e6-962e-e26fa8e100a5', '193aa470-9f0a-4069-8db2-76784e2546b8'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:52:44 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-be9b6ac7-e0ee-4a3e-a8ac-af0da6ec3c69 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:44 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-be9b6ac7-e0ee-4a3e-a8ac-af0da6ec3c69 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:52:44 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-be9b6ac7-e0ee-4a3e-a8ac-af0da6ec3c69 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:52:44 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-be9b6ac7-e0ee-4a3e-a8ac-af0da6ec3c69 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:52:44 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-be9b6ac7-e0ee-4a3e-a8ac-af0da6ec3c69 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:52:44 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-be9b6ac7-e0ee-4a3e-a8ac-af0da6ec3c69 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:44 devstack sudo[90434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:52:44 devstack sudo[90434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:44 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ed97a518-6881-4e66-9dd4-f4025c309736 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Acquiring lock "cinder-6f60f78b-f51b-47ac-af2f-71f9a32a60da-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:52:44 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ed97a518-6881-4e66-9dd4-f4025c309736 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "cinder-6f60f78b-f51b-47ac-af2f-71f9a32a60da-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:52:44 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ed97a518-6881-4e66-9dd4-f4025c309736 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Acquiring lock "cinder-quobyte-6f60f78b-f51b-47ac-af2f-71f9a32a60da" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:52:44 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ed97a518-6881-4e66-9dd4-f4025c309736 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "cinder-quobyte-6f60f78b-f51b-47ac-af2f-71f9a32a60da" acquired by "delete_volume" :: waited 0.034s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:52:44 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad0af9f-1695-478d-8bc1-dc75c4753a6f]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:52:44 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ed97a518-6881-4e66-9dd4-f4025c309736 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6f60f78b-f51b-47ac-af2f-71f9a32a60da {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:45 devstack sudo[90437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6f60f78b-f51b-47ac-af2f-71f9a32a60da
Apr 09 12:52:45 devstack sudo[90437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:45 devstack sudo[90415]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:45 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-de2b71b1-2241-4430-aa06-548b03f09338 tempest-VolumeDependencyTests-1907829774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-b58cbf29-bc38-4424-ac76-cd8d16ae26a4" returned: 0 in 3.131s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:45 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64a9ccd-fc83-4e38-b3dc-0bdcd1d7c535]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:52:45 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-de2b71b1-2241-4430-aa06-548b03f09338 tempest-VolumeDependencyTests-1907829774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:45 devstack sudo[90434]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:45 devstack sudo[90440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d
Apr 09 12:52:45 devstack sudo[90440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:45 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-be9b6ac7-e0ee-4a3e-a8ac-af0da6ec3c69 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 1.299s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:45 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-be9b6ac7-e0ee-4a3e-a8ac-af0da6ec3c69 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:52:45 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-be9b6ac7-e0ee-4a3e-a8ac-af0da6ec3c69 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Deleted volume successfully.
Apr 09 12:52:45 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-be9b6ac7-e0ee-4a3e-a8ac-af0da6ec3c69 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "cinder-520fd487-1437-409c-b349-83aec4ed2249-delete_volume" released by "delete_volume" :: held 3.615s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:52:45 devstack sudo[90437]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:45 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ed97a518-6881-4e66-9dd4-f4025c309736 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6f60f78b-f51b-47ac-af2f-71f9a32a60da" returned: 0 in 0.771s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:45 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ed97a518-6881-4e66-9dd4-f4025c309736 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6f60f78b-f51b-47ac-af2f-71f9a32a60da {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:45 devstack sudo[90445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6f60f78b-f51b-47ac-af2f-71f9a32a60da
Apr 09 12:52:45 devstack sudo[90445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:46 devstack sudo[90445]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ed97a518-6881-4e66-9dd4-f4025c309736 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6f60f78b-f51b-47ac-af2f-71f9a32a60da" returned: 0 in 0.466s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:46 devstack sudo[90440]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-de2b71b1-2241-4430-aa06-548b03f09338 tempest-VolumeDependencyTests-1907829774 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d" returned: 0 in 0.722s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:46 devstack cinder-volume[82760]: DEBUG cinder.image.image_utils [None req-de2b71b1-2241-4430-aa06-548b03f09338 tempest-VolumeDependencyTests-1907829774 None] Image conversion details: src /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d, size 1024.00 MB, duration 3.13 sec, destination /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-b58cbf29-bc38-4424-ac76-cd8d16ae26a4 {{(pid=82760) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 12:52:46 devstack cinder-volume[82760]: INFO cinder.image.image_utils [None req-de2b71b1-2241-4430-aa06-548b03f09338 tempest-VolumeDependencyTests-1907829774 None] Converted 1024.00 MB image at 326.90 MB/s
Apr 09 12:52:46 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-de2b71b1-2241-4430-aa06-548b03f09338 tempest-VolumeDependencyTests-1907829774 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-b58cbf29-bc38-4424-ac76-cd8d16ae26a4 is being set with open permissions: ugo+rw
Apr 09 12:52:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-de2b71b1-2241-4430-aa06-548b03f09338 tempest-VolumeDependencyTests-1907829774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-b58cbf29-bc38-4424-ac76-cd8d16ae26a4 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:46 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ed97a518-6881-4e66-9dd4-f4025c309736 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "cinder-quobyte-6f60f78b-f51b-47ac-af2f-71f9a32a60da" released by "delete_volume" :: held 1.327s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:52:46 devstack sudo[90451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-b58cbf29-bc38-4424-ac76-cd8d16ae26a4
Apr 09 12:52:46 devstack sudo[90451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:46 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-ed97a518-6881-4e66-9dd4-f4025c309736 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Created reservations ['0e00e8ed-f808-4488-a7c0-1ea7174a8d45', '589ac42f-370b-4977-8a48-e3ce6777f900', 'a9a5d75f-5f06-4ef8-a88a-92e3a906eb83', '7278d528-d7ce-4254-82e0-4b50d62d655c'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:52:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ed97a518-6881-4e66-9dd4-f4025c309736 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ed97a518-6881-4e66-9dd4-f4025c309736 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:52:46 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-ed97a518-6881-4e66-9dd4-f4025c309736 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:52:46 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-ed97a518-6881-4e66-9dd4-f4025c309736 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:52:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ed97a518-6881-4e66-9dd4-f4025c309736 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:52:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ed97a518-6881-4e66-9dd4-f4025c309736 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:46 devstack sudo[90453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:52:46 devstack sudo[90453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:46 devstack sudo[90451]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-de2b71b1-2241-4430-aa06-548b03f09338 tempest-VolumeDependencyTests-1907829774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-b58cbf29-bc38-4424-ac76-cd8d16ae26a4" returned: 0 in 0.482s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:46 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-de2b71b1-2241-4430-aa06-548b03f09338 tempest-VolumeDependencyTests-1907829774 None] Lock "cinder-quobyte-b58cbf29-bc38-4424-ac76-cd8d16ae26a4" released by "_copy_volume_from_snapshot" :: held 6.006s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:52:46 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-de2b71b1-2241-4430-aa06-548b03f09338 tempest-VolumeDependencyTests-1907829774 None] Lock "cinder-quobyte-745b2e5e-78d9-4968-9cbf-bc5e85d56136-b58cbf29-bc38-4424-ac76-cd8d16ae26a4" released by "_create_volume_from_snapshot" :: held 6.028s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:52:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-de2b71b1-2241-4430-aa06-548b03f09338 tempest-VolumeDependencyTests-1907829774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.073s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:52:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-fe2e18bf-7374-4004-b341-3de45dea6146 tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.264s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:52:46 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-fe2e18bf-7374-4004-b341-3de45dea6146 tempest-CreateVolumesFromSnapshotTest-828104883 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:52:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1174157898',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37d74158-2b90-4321-ab38-1d4a49da6fe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b444a78f57b4e92819c661a31e3eb24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:52:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:52:41Z,use_quota=True,user_id='82524731e1384a9fa5a94656d03e1874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:52:46 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-fe2e18bf-7374-4004-b341-3de45dea6146 tempest-CreateVolumesFromSnapshotTest-828104883 None] Creating volume 37d74158-2b90-4321-ab38-1d4a49da6fe7 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:52:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-fe2e18bf-7374-4004-b341-3de45dea6146 tempest-CreateVolumesFromSnapshotTest-828104883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-fe2e18bf-7374-4004-b341-3de45dea6146 tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:52:46 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-fe2e18bf-7374-4004-b341-3de45dea6146 tempest-CreateVolumesFromSnapshotTest-828104883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:52:46 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-fe2e18bf-7374-4004-b341-3de45dea6146 tempest-CreateVolumesFromSnapshotTest-828104883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:52:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-fe2e18bf-7374-4004-b341-3de45dea6146 tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:52:46 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-fe2e18bf-7374-4004-b341-3de45dea6146 tempest-CreateVolumesFromSnapshotTest-828104883 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:52:46 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-fe2e18bf-7374-4004-b341-3de45dea6146 tempest-CreateVolumesFromSnapshotTest-828104883 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:52:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-fe2e18bf-7374-4004-b341-3de45dea6146 tempest-CreateVolumesFromSnapshotTest-828104883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-37d74158-2b90-4321-ab38-1d4a49da6fe7 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:46 devstack sudo[90453]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ed97a518-6881-4e66-9dd4-f4025c309736 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.435s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:46 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-ed97a518-6881-4e66-9dd4-f4025c309736 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:52:46 devstack sudo[90457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-37d74158-2b90-4321-ab38-1d4a49da6fe7 1073741824
Apr 09 12:52:46 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-de2b71b1-2241-4430-aa06-548b03f09338 tempest-VolumeDependencyTests-1907829774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dea8b537-2df0-4838-875e-ba1da3ce44b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b58cbf29-bc38-4424-ac76-cd8d16ae26a4', 'volume_size': 1, 'snapshot_id': '745b2e5e-78d9-4968-9cbf-bc5e85d56136'}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:46 devstack sudo[90457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:46 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-de2b71b1-2241-4430-aa06-548b03f09338 tempest-VolumeDependencyTests-1907829774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20887b31-1068-4992-8eab-71cf7971d265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:46 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-ed97a518-6881-4e66-9dd4-f4025c309736 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Deleted volume successfully.
Apr 09 12:52:46 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-de2b71b1-2241-4430-aa06-548b03f09338 tempest-VolumeDependencyTests-1907829774 None] Volume volume-b58cbf29-bc38-4424-ac76-cd8d16ae26a4 (b58cbf29-bc38-4424-ac76-cd8d16ae26a4): created successfully
Apr 09 12:52:46 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-de2b71b1-2241-4430-aa06-548b03f09338 tempest-VolumeDependencyTests-1907829774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20887b31-1068-4992-8eab-71cf7971d265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:46 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-de2b71b1-2241-4430-aa06-548b03f09338 tempest-VolumeDependencyTests-1907829774 None] Flow 'volume_create_manager' (8a254d0f-dc76-4d42-964e-fdb3e9832982) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:52:46 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ed97a518-6881-4e66-9dd4-f4025c309736 tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "cinder-6f60f78b-f51b-47ac-af2f-71f9a32a60da-delete_volume" released by "delete_volume" :: held 2.038s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:52:46 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-de2b71b1-2241-4430-aa06-548b03f09338 tempest-VolumeDependencyTests-1907829774 None] Created volume successfully.
Apr 09 12:52:46 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-c6cf76c5-fcc5-4dbb-b2c7-26f3fccbdfd5 tempest-VolumeDependencyTests-1907829774 None] Acquiring lock "cinder-745b2e5e-78d9-4968-9cbf-bc5e85d56136-delete_snapshot" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:52:46 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-c6cf76c5-fcc5-4dbb-b2c7-26f3fccbdfd5 tempest-VolumeDependencyTests-1907829774 None] Lock "cinder-745b2e5e-78d9-4968-9cbf-bc5e85d56136-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:52:46 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-c6cf76c5-fcc5-4dbb-b2c7-26f3fccbdfd5 tempest-VolumeDependencyTests-1907829774 None] Acquiring lock "cinder-quobyte-a060e331-4d69-4f9f-bc23-29b77be0199d" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:52:46 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-c6cf76c5-fcc5-4dbb-b2c7-26f3fccbdfd5 tempest-VolumeDependencyTests-1907829774 None] Lock "cinder-quobyte-a060e331-4d69-4f9f-bc23-29b77be0199d" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:52:46 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-c6cf76c5-fcc5-4dbb-b2c7-26f3fccbdfd5 tempest-VolumeDependencyTests-1907829774 None] Acquiring lock "cinder-quobyte-745b2e5e-78d9-4968-9cbf-bc5e85d56136" by "_delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:52:46 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-c6cf76c5-fcc5-4dbb-b2c7-26f3fccbdfd5 tempest-VolumeDependencyTests-1907829774 None] Lock "cinder-quobyte-745b2e5e-78d9-4968-9cbf-bc5e85d56136" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:52:46 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-c6cf76c5-fcc5-4dbb-b2c7-26f3fccbdfd5 tempest-VolumeDependencyTests-1907829774 None] Deleting offline snapshot 745b2e5e-78d9-4968-9cbf-bc5e85d56136 of volume a060e331-4d69-4f9f-bc23-29b77be0199d {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 12:52:46 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-c6cf76c5-fcc5-4dbb-b2c7-26f3fccbdfd5 tempest-VolumeDependencyTests-1907829774 None] snapshot_file for this snap is: volume-a060e331-4d69-4f9f-bc23-29b77be0199d.745b2e5e-78d9-4968-9cbf-bc5e85d56136 {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 12:52:46 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[85638fd4-3e88-4c54-a53f-155833191e03]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:52:46 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c6cf76c5-fcc5-4dbb-b2c7-26f3fccbdfd5 tempest-VolumeDependencyTests-1907829774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d.745b2e5e-78d9-4968-9cbf-bc5e85d56136 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:46 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-f7e39243-228c-4494-bb85-152f5e5a112f tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Acquiring lock "cinder-6327d09b-d0ce-4f6a-9278-bc4d06d6612b-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:52:46 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-f7e39243-228c-4494-bb85-152f5e5a112f tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "cinder-6327d09b-d0ce-4f6a-9278-bc4d06d6612b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:52:46 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-f7e39243-228c-4494-bb85-152f5e5a112f tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Acquiring lock "cinder-quobyte-6327d09b-d0ce-4f6a-9278-bc4d06d6612b" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:52:46 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-f7e39243-228c-4494-bb85-152f5e5a112f tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "cinder-quobyte-6327d09b-d0ce-4f6a-9278-bc4d06d6612b" acquired by "delete_volume" :: waited 0.009s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:52:47 devstack sudo[90459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d.745b2e5e-78d9-4968-9cbf-bc5e85d56136
Apr 09 12:52:47 devstack sudo[90459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:47 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbf1884-9547-4454-b33c-da07ea41822c]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:52:47 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f7e39243-228c-4494-bb85-152f5e5a112f tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6327d09b-d0ce-4f6a-9278-bc4d06d6612b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:47 devstack sudo[90464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6327d09b-d0ce-4f6a-9278-bc4d06d6612b
Apr 09 12:52:47 devstack sudo[90464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:47 devstack sudo[90457]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:47 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-fe2e18bf-7374-4004-b341-3de45dea6146 tempest-CreateVolumesFromSnapshotTest-828104883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-37d74158-2b90-4321-ab38-1d4a49da6fe7 1073741824" returned: 0 in 0.621s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:47 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-fe2e18bf-7374-4004-b341-3de45dea6146 tempest-CreateVolumesFromSnapshotTest-828104883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-37d74158-2b90-4321-ab38-1d4a49da6fe7 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:47 devstack sudo[90466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-37d74158-2b90-4321-ab38-1d4a49da6fe7
Apr 09 12:52:47 devstack sudo[90466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:47 devstack sudo[90459]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:47 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c6cf76c5-fcc5-4dbb-b2c7-26f3fccbdfd5 tempest-VolumeDependencyTests-1907829774 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d.745b2e5e-78d9-4968-9cbf-bc5e85d56136" returned: 0 in 0.670s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:47 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-c6cf76c5-fcc5-4dbb-b2c7-26f3fccbdfd5 tempest-VolumeDependencyTests-1907829774 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a060e331-4d69-4f9f-bc23-29b77be0199d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:52:47 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[148e4c6d-734d-4f22-a6d2-5827e60b7dae]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:52:47 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c6cf76c5-fcc5-4dbb-b2c7-26f3fccbdfd5 tempest-VolumeDependencyTests-1907829774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:47 devstack sudo[90471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d
Apr 09 12:52:47 devstack sudo[90471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:47 devstack sudo[90466]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:47 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-fe2e18bf-7374-4004-b341-3de45dea6146 tempest-CreateVolumesFromSnapshotTest-828104883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-37d74158-2b90-4321-ab38-1d4a49da6fe7" returned: 0 in 0.510s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:47 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-fe2e18bf-7374-4004-b341-3de45dea6146 tempest-CreateVolumesFromSnapshotTest-828104883 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:52:47 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-fe2e18bf-7374-4004-b341-3de45dea6146 tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:52:47 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f79f3601-6dfb-439e-8586-acb6a96c35fa tempest-SnapshotDependencyTests-1880031669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.214s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:52:47 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-fe2e18bf-7374-4004-b341-3de45dea6146 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fa1cd47-9b0e-4f22-919c-e49a97c1cb36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37d74158-2b90-4321-ab38-1d4a49da6fe7', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:47 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-fe2e18bf-7374-4004-b341-3de45dea6146 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfa2078a-fd44-44a3-af0d-925715112bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:47 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-f79f3601-6dfb-439e-8586-acb6a96c35fa tempest-SnapshotDependencyTests-1880031669 None] Creating offline snapshot 4580d66e-7321-41f1-9007-b8d91afd8494 of volume 5dcef0fe-f172-4c8d-b611-bb21edb84c15 {{(pid=82760) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 12:52:47 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-fe2e18bf-7374-4004-b341-3de45dea6146 tempest-CreateVolumesFromSnapshotTest-828104883 None] Volume volume-37d74158-2b90-4321-ab38-1d4a49da6fe7 (37d74158-2b90-4321-ab38-1d4a49da6fe7): created successfully
Apr 09 12:52:47 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-fe2e18bf-7374-4004-b341-3de45dea6146 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfa2078a-fd44-44a3-af0d-925715112bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:47 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-fe2e18bf-7374-4004-b341-3de45dea6146 tempest-CreateVolumesFromSnapshotTest-828104883 None] Flow 'volume_create_manager' (f26a149c-0771-480c-bacb-302ff2514d5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:52:47 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3b40d1-928a-4d07-9c12-cf23df577886]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:52:47 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f79f3601-6dfb-439e-8586-acb6a96c35fa tempest-SnapshotDependencyTests-1880031669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:47 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-fe2e18bf-7374-4004-b341-3de45dea6146 tempest-CreateVolumesFromSnapshotTest-828104883 None] Created volume successfully.
Apr 09 12:52:47 devstack sudo[90464]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:47 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f7e39243-228c-4494-bb85-152f5e5a112f tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6327d09b-d0ce-4f6a-9278-bc4d06d6612b" returned: 0 in 0.879s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:47 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f7e39243-228c-4494-bb85-152f5e5a112f tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6327d09b-d0ce-4f6a-9278-bc4d06d6612b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:47 devstack sudo[90477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15
Apr 09 12:52:47 devstack sudo[90477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:47 devstack sudo[90478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6327d09b-d0ce-4f6a-9278-bc4d06d6612b
Apr 09 12:52:47 devstack sudo[90478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:48 devstack sudo[90471]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:48 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c6cf76c5-fcc5-4dbb-b2c7-26f3fccbdfd5 tempest-VolumeDependencyTests-1907829774 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d" returned: 0 in 0.609s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:48 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c6cf76c5-fcc5-4dbb-b2c7-26f3fccbdfd5 tempest-VolumeDependencyTests-1907829774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d.745b2e5e-78d9-4968-9cbf-bc5e85d56136 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:48 devstack sudo[90484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d.745b2e5e-78d9-4968-9cbf-bc5e85d56136
Apr 09 12:52:48 devstack sudo[90484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:48 devstack sudo[90478]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:48 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f7e39243-228c-4494-bb85-152f5e5a112f tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-6327d09b-d0ce-4f6a-9278-bc4d06d6612b" returned: 0 in 0.540s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:48 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-f7e39243-228c-4494-bb85-152f5e5a112f tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "cinder-quobyte-6327d09b-d0ce-4f6a-9278-bc4d06d6612b" released by "delete_volume" :: held 1.448s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:52:48 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-f7e39243-228c-4494-bb85-152f5e5a112f tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Created reservations ['945db0b3-4699-4f49-acd3-df83e1e2e3b7', 'bb500b91-3d28-4628-812b-d49d3a7a2efe', 'd2f49c75-19d0-48a7-9f42-e78fa27feda9', '518e1b71-d9c2-421b-bb65-1c26e4183bf3'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:52:48 devstack sudo[90477]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:48 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f79f3601-6dfb-439e-8586-acb6a96c35fa tempest-SnapshotDependencyTests-1880031669 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15" returned: 0 in 0.672s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:48 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f79f3601-6dfb-439e-8586-acb6a96c35fa tempest-SnapshotDependencyTests-1880031669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15.4580d66e-7321-41f1-9007-b8d91afd8494 1G {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:48 devstack sudo[90490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15.4580d66e-7321-41f1-9007-b8d91afd8494 1G
Apr 09 12:52:48 devstack sudo[90490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:48 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f7e39243-228c-4494-bb85-152f5e5a112f tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:48 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f7e39243-228c-4494-bb85-152f5e5a112f tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:52:48 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f7e39243-228c-4494-bb85-152f5e5a112f tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:52:48 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f7e39243-228c-4494-bb85-152f5e5a112f tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:52:48 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f7e39243-228c-4494-bb85-152f5e5a112f tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:52:48 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f7e39243-228c-4494-bb85-152f5e5a112f tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:48 devstack sudo[90492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:52:48 devstack sudo[90492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:48 devstack sudo[90484]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:48 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c6cf76c5-fcc5-4dbb-b2c7-26f3fccbdfd5 tempest-VolumeDependencyTests-1907829774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d.745b2e5e-78d9-4968-9cbf-bc5e85d56136" returned: 0 in 0.614s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:48 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c6cf76c5-fcc5-4dbb-b2c7-26f3fccbdfd5 tempest-VolumeDependencyTests-1907829774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d.745b2e5e-78d9-4968-9cbf-bc5e85d56136 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:48 devstack sudo[90497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d.745b2e5e-78d9-4968-9cbf-bc5e85d56136
Apr 09 12:52:48 devstack sudo[90497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:48 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-e795b3d7-31eb-400c-ada0-77d2e94b0e08 tempest-CreateVolumesFromSnapshotTest-828104883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:49 devstack sudo[90492]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:49 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f7e39243-228c-4494-bb85-152f5e5a112f tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.564s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:49 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-f7e39243-228c-4494-bb85-152f5e5a112f tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:52:49 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-f7e39243-228c-4494-bb85-152f5e5a112f tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Deleted volume successfully.
Apr 09 12:52:49 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-f7e39243-228c-4494-bb85-152f5e5a112f tempest-CreateVolumesFromSourceVolumeTest-1119429582 None] Lock "cinder-6327d09b-d0ce-4f6a-9278-bc4d06d6612b-delete_volume" released by "delete_volume" :: held 2.205s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:52:49 devstack sudo[90490]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:49 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f79f3601-6dfb-439e-8586-acb6a96c35fa tempest-SnapshotDependencyTests-1880031669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15.4580d66e-7321-41f1-9007-b8d91afd8494 1G" returned: 0 in 0.734s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:49 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f79f3601-6dfb-439e-8586-acb6a96c35fa tempest-SnapshotDependencyTests-1880031669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15.4580d66e-7321-41f1-9007-b8d91afd8494 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:49 devstack sudo[90503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15.4580d66e-7321-41f1-9007-b8d91afd8494
Apr 09 12:52:49 devstack sudo[90503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:49 devstack sudo[90497]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:49 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-c6cf76c5-fcc5-4dbb-b2c7-26f3fccbdfd5 tempest-VolumeDependencyTests-1907829774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d.745b2e5e-78d9-4968-9cbf-bc5e85d56136" returned: 0 in 0.545s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:49 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-c6cf76c5-fcc5-4dbb-b2c7-26f3fccbdfd5 tempest-VolumeDependencyTests-1907829774 None] Lock "cinder-quobyte-745b2e5e-78d9-4968-9cbf-bc5e85d56136" released by "_delete_snapshot" :: held 2.524s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:52:49 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-c6cf76c5-fcc5-4dbb-b2c7-26f3fccbdfd5 tempest-VolumeDependencyTests-1907829774 None] Lock "cinder-quobyte-a060e331-4d69-4f9f-bc23-29b77be0199d" released by "delete_snapshot" :: held 2.537s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:52:49 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-c6cf76c5-fcc5-4dbb-b2c7-26f3fccbdfd5 tempest-VolumeDependencyTests-1907829774 None] Created reservations ['66907abe-8915-43cf-99a8-d6d6c38a874d', 'e3f5da67-05c2-4f40-ba8b-6e81d3ac9b38', '5de0b46f-c593-4d14-82b0-bfabbfdc409d', '0e52ab1f-0539-4b45-9920-7b5c974da565'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:52:49 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-c6cf76c5-fcc5-4dbb-b2c7-26f3fccbdfd5 tempest-VolumeDependencyTests-1907829774 None] Delete snapshot completed successfully.
Apr 09 12:52:49 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-c6cf76c5-fcc5-4dbb-b2c7-26f3fccbdfd5 tempest-VolumeDependencyTests-1907829774 None] Lock "cinder-745b2e5e-78d9-4968-9cbf-bc5e85d56136-delete_snapshot" released by "delete_snapshot" :: held 2.627s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:52:49 devstack sudo[90503]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:49 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f79f3601-6dfb-439e-8586-acb6a96c35fa tempest-SnapshotDependencyTests-1880031669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15.4580d66e-7321-41f1-9007-b8d91afd8494" returned: 0 in 0.573s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:49 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-f79f3601-6dfb-439e-8586-acb6a96c35fa tempest-SnapshotDependencyTests-1880031669 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15.4580d66e-7321-41f1-9007-b8d91afd8494 is being set with open permissions: ugo+rw
Apr 09 12:52:49 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f79f3601-6dfb-439e-8586-acb6a96c35fa tempest-SnapshotDependencyTests-1880031669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15.4580d66e-7321-41f1-9007-b8d91afd8494 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:49 devstack sudo[90509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15.4580d66e-7321-41f1-9007-b8d91afd8494
Apr 09 12:52:49 devstack sudo[90509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:50 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-5745bce2-0abf-4151-97e9-19b1135796a7 tempest-VolumeDependencyTests-1907829774 None] Acquiring lock "cinder-a060e331-4d69-4f9f-bc23-29b77be0199d-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:52:50 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-5745bce2-0abf-4151-97e9-19b1135796a7 tempest-VolumeDependencyTests-1907829774 None] Lock "cinder-a060e331-4d69-4f9f-bc23-29b77be0199d-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:52:50 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-5745bce2-0abf-4151-97e9-19b1135796a7 tempest-VolumeDependencyTests-1907829774 None] Acquiring lock "cinder-quobyte-a060e331-4d69-4f9f-bc23-29b77be0199d" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:52:50 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-5745bce2-0abf-4151-97e9-19b1135796a7 tempest-VolumeDependencyTests-1907829774 None] Lock "cinder-quobyte-a060e331-4d69-4f9f-bc23-29b77be0199d" acquired by "delete_volume" :: waited 0.009s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:52:50 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3da8582-9f49-4910-9799-35f6912cf4ca]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:52:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-5745bce2-0abf-4151-97e9-19b1135796a7 tempest-VolumeDependencyTests-1907829774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:50 devstack sudo[90511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d
Apr 09 12:52:50 devstack sudo[90511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:50 devstack sudo[90509]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f79f3601-6dfb-439e-8586-acb6a96c35fa tempest-SnapshotDependencyTests-1880031669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15.4580d66e-7321-41f1-9007-b8d91afd8494" returned: 0 in 0.572s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f79f3601-6dfb-439e-8586-acb6a96c35fa tempest-SnapshotDependencyTests-1880031669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:50 devstack sudo[90514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15.info
Apr 09 12:52:50 devstack sudo[90514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:50 devstack sudo[90511]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-5745bce2-0abf-4151-97e9-19b1135796a7 tempest-VolumeDependencyTests-1907829774 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d" returned: 0 in 0.603s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-5745bce2-0abf-4151-97e9-19b1135796a7 tempest-VolumeDependencyTests-1907829774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:50 devstack sudo[90519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d
Apr 09 12:52:50 devstack sudo[90519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:50 devstack sudo[90514]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f79f3601-6dfb-439e-8586-acb6a96c35fa tempest-SnapshotDependencyTests-1880031669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15.info" returned: 0 in 0.489s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:50 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-f79f3601-6dfb-439e-8586-acb6a96c35fa tempest-SnapshotDependencyTests-1880031669 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15.info is being set with open permissions: ugo+rw
Apr 09 12:52:50 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f79f3601-6dfb-439e-8586-acb6a96c35fa tempest-SnapshotDependencyTests-1880031669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:50 devstack sudo[90522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15.info
Apr 09 12:52:50 devstack sudo[90522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:51 devstack sudo[90519]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-5745bce2-0abf-4151-97e9-19b1135796a7 tempest-VolumeDependencyTests-1907829774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a060e331-4d69-4f9f-bc23-29b77be0199d" returned: 0 in 0.659s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:51 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-5745bce2-0abf-4151-97e9-19b1135796a7 tempest-VolumeDependencyTests-1907829774 None] Lock "cinder-quobyte-a060e331-4d69-4f9f-bc23-29b77be0199d" released by "delete_volume" :: held 1.310s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:52:51 devstack sudo[90522]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f79f3601-6dfb-439e-8586-acb6a96c35fa tempest-SnapshotDependencyTests-1880031669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15.info" returned: 0 in 0.512s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f79f3601-6dfb-439e-8586-acb6a96c35fa tempest-SnapshotDependencyTests-1880031669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.669s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:52:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-e795b3d7-31eb-400c-ada0-77d2e94b0e08 tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.520s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:52:51 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-e795b3d7-31eb-400c-ada0-77d2e94b0e08 tempest-CreateVolumesFromSnapshotTest-828104883 None] Creating offline snapshot 7ac3efa4-f2bb-4b8c-b60a-407d73534697 of volume 37d74158-2b90-4321-ab38-1d4a49da6fe7 {{(pid=82760) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 12:52:51 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[854d546e-d594-476d-a089-fcda21073b86]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:52:51 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-f79f3601-6dfb-439e-8586-acb6a96c35fa tempest-SnapshotDependencyTests-1880031669 None] Create snapshot completed successfully
Apr 09 12:52:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e795b3d7-31eb-400c-ada0-77d2e94b0e08 tempest-CreateVolumesFromSnapshotTest-828104883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-37d74158-2b90-4321-ab38-1d4a49da6fe7 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:51 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-41d2b001-3dda-42dc-8fe4-0848887d2bc2 tempest-CinderUnicodeTest-1468521471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:52:51 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-41d2b001-3dda-42dc-8fe4-0848887d2bc2 tempest-CinderUnicodeTest-1468521471 None] Flow 'volume_create_manager' (59dcdc6a-4d32-4cef-9ad7-cc8e4830910b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:52:51 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-41d2b001-3dda-42dc-8fe4-0848887d2bc2 tempest-CinderUnicodeTest-1468521471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfb4287a-530c-49e5-ad67-f18af0a83534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:51 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-5745bce2-0abf-4151-97e9-19b1135796a7 tempest-VolumeDependencyTests-1907829774 None] Created reservations ['eb304e98-cb1f-44d5-a5fd-21747f101733', '3b91198c-6dfa-4d6f-a7e9-50a6c87a023d', '47bb7519-093d-488f-af70-e9fd3efbfa9b', 'e808722b-88cd-4a60-9ee5-da077ecb42ca'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:52:51 devstack sudo[90526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-37d74158-2b90-4321-ab38-1d4a49da6fe7
Apr 09 12:52:51 devstack sudo[90526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:51 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-41d2b001-3dda-42dc-8fe4-0848887d2bc2 tempest-CinderUnicodeTest-1468521471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfb4287a-530c-49e5-ad67-f18af0a83534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31f49052-5c01-4185-830f-627589cab426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa15b7f776a549d4b5f763ee7bcba2d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:52:51Z,use_quota=True,user_id='e9009c5a86974ff6af9314b0696e26c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:51 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-41d2b001-3dda-42dc-8fe4-0848887d2bc2 tempest-CinderUnicodeTest-1468521471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (982a18f1-99e0-4189-956d-8fc0886e3067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:51 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-41d2b001-3dda-42dc-8fe4-0848887d2bc2 tempest-CinderUnicodeTest-1468521471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (982a18f1-99e0-4189-956d-8fc0886e3067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:51 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-41d2b001-3dda-42dc-8fe4-0848887d2bc2 tempest-CinderUnicodeTest-1468521471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a992ff93-264f-4103-81ae-00dd605835e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:51 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-41d2b001-3dda-42dc-8fe4-0848887d2bc2 tempest-CinderUnicodeTest-1468521471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a992ff93-264f-4103-81ae-00dd605835e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31f49052-5c01-4185-830f-627589cab426', 'volume_name': 'volume-31f49052-5c01-4185-830f-627589cab426', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:51 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-41d2b001-3dda-42dc-8fe4-0848887d2bc2 tempest-CinderUnicodeTest-1468521471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aa5cd24-f486-4c99-9666-d611009f1e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:51 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-41d2b001-3dda-42dc-8fe4-0848887d2bc2 tempest-CinderUnicodeTest-1468521471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aa5cd24-f486-4c99-9666-d611009f1e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:51 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-41d2b001-3dda-42dc-8fe4-0848887d2bc2 tempest-CinderUnicodeTest-1468521471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aecceaa9-0e7c-4f91-a4c5-7b088b74d189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:51 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-41d2b001-3dda-42dc-8fe4-0848887d2bc2 tempest-CinderUnicodeTest-1468521471 None] Volume 31f49052-5c01-4185-830f-627589cab426: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31f49052-5c01-4185-830f-627589cab426', 'volume_size': 1}
Apr 09 12:52:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-41d2b001-3dda-42dc-8fe4-0848887d2bc2 tempest-CinderUnicodeTest-1468521471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-5745bce2-0abf-4151-97e9-19b1135796a7 tempest-VolumeDependencyTests-1907829774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-5745bce2-0abf-4151-97e9-19b1135796a7 tempest-VolumeDependencyTests-1907829774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:52:51 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-5745bce2-0abf-4151-97e9-19b1135796a7 tempest-VolumeDependencyTests-1907829774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:52:51 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-5745bce2-0abf-4151-97e9-19b1135796a7 tempest-VolumeDependencyTests-1907829774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:52:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-5745bce2-0abf-4151-97e9-19b1135796a7 tempest-VolumeDependencyTests-1907829774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:52:51 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-5745bce2-0abf-4151-97e9-19b1135796a7 tempest-VolumeDependencyTests-1907829774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:51 devstack sudo[90528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:52:51 devstack sudo[90528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:52 devstack sudo[90528]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-5745bce2-0abf-4151-97e9-19b1135796a7 tempest-VolumeDependencyTests-1907829774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.492s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:52 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-5745bce2-0abf-4151-97e9-19b1135796a7 tempest-VolumeDependencyTests-1907829774 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:52:52 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-5745bce2-0abf-4151-97e9-19b1135796a7 tempest-VolumeDependencyTests-1907829774 None] Deleted volume successfully.
Apr 09 12:52:52 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-5745bce2-0abf-4151-97e9-19b1135796a7 tempest-VolumeDependencyTests-1907829774 None] Lock "cinder-a060e331-4d69-4f9f-bc23-29b77be0199d-delete_volume" released by "delete_volume" :: held 2.079s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:52:52 devstack sudo[90526]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e795b3d7-31eb-400c-ada0-77d2e94b0e08 tempest-CreateVolumesFromSnapshotTest-828104883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-37d74158-2b90-4321-ab38-1d4a49da6fe7" returned: 0 in 0.667s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e795b3d7-31eb-400c-ada0-77d2e94b0e08 tempest-CreateVolumesFromSnapshotTest-828104883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-37d74158-2b90-4321-ab38-1d4a49da6fe7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-37d74158-2b90-4321-ab38-1d4a49da6fe7.7ac3efa4-f2bb-4b8c-b60a-407d73534697 1G {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:52 devstack sudo[90534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-37d74158-2b90-4321-ab38-1d4a49da6fe7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-37d74158-2b90-4321-ab38-1d4a49da6fe7.7ac3efa4-f2bb-4b8c-b60a-407d73534697 1G
Apr 09 12:52:52 devstack sudo[90534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:52 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-950c6349-4288-4080-9e07-47a5305b66aa tempest-SnapshotDependencyTests-1880031669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:52:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-950c6349-4288-4080-9e07-47a5305b66aa tempest-SnapshotDependencyTests-1880031669 None] Flow 'volume_create_manager' (02fcc624-9f72-46ab-81be-64dc715597a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:52:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-950c6349-4288-4080-9e07-47a5305b66aa tempest-SnapshotDependencyTests-1880031669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0006490f-d253-464d-94fc-aa030240664a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-950c6349-4288-4080-9e07-47a5305b66aa tempest-SnapshotDependencyTests-1880031669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0006490f-d253-464d-94fc-aa030240664a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:52:52Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d496d9df-1b85-49e3-9ce1-ab5b3100f504,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ccb496c4f9149b59c4e3daaa24197d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4580d66e-7321-41f1-9007-b8d91afd8494,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:52:52Z,use_quota=True,user_id='b748e113f69f489ab1b2b92e338f276b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-950c6349-4288-4080-9e07-47a5305b66aa tempest-SnapshotDependencyTests-1880031669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (279e8e60-345d-4037-9512-9ecd997dec26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-950c6349-4288-4080-9e07-47a5305b66aa tempest-SnapshotDependencyTests-1880031669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (279e8e60-345d-4037-9512-9ecd997dec26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-950c6349-4288-4080-9e07-47a5305b66aa tempest-SnapshotDependencyTests-1880031669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a0b7370-abd1-4cc4-a442-fc34ea88f0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-950c6349-4288-4080-9e07-47a5305b66aa tempest-SnapshotDependencyTests-1880031669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a0b7370-abd1-4cc4-a442-fc34ea88f0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd496d9df-1b85-49e3-9ce1-ab5b3100f504', 'volume_name': 'volume-d496d9df-1b85-49e3-9ce1-ab5b3100f504', 'volume_size': 1, 'snapshot_id': '4580d66e-7321-41f1-9007-b8d91afd8494'}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-950c6349-4288-4080-9e07-47a5305b66aa tempest-SnapshotDependencyTests-1880031669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f43651e-5f2d-48e9-a418-9fcc58492865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-950c6349-4288-4080-9e07-47a5305b66aa tempest-SnapshotDependencyTests-1880031669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f43651e-5f2d-48e9-a418-9fcc58492865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-950c6349-4288-4080-9e07-47a5305b66aa tempest-SnapshotDependencyTests-1880031669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad35c694-24f6-49bc-aaa7-c641ca208318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:52 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-950c6349-4288-4080-9e07-47a5305b66aa tempest-SnapshotDependencyTests-1880031669 None] Volume d496d9df-1b85-49e3-9ce1-ab5b3100f504: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d496d9df-1b85-49e3-9ce1-ab5b3100f504', 'volume_size': 1, 'snapshot_id': '4580d66e-7321-41f1-9007-b8d91afd8494'}
Apr 09 12:52:52 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-756a364c-5fa2-43c3-8a24-a3f618131b20 tempest-VolumeDependencyTests-1907829774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:52:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-756a364c-5fa2-43c3-8a24-a3f618131b20 tempest-VolumeDependencyTests-1907829774 None] Flow 'volume_create_manager' (6b666371-129e-4661-b645-75a783b36cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:52:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-756a364c-5fa2-43c3-8a24-a3f618131b20 tempest-VolumeDependencyTests-1907829774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bbe042b-d96b-41eb-8f2d-a21083f7e711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-950c6349-4288-4080-9e07-47a5305b66aa tempest-SnapshotDependencyTests-1880031669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-756a364c-5fa2-43c3-8a24-a3f618131b20 tempest-VolumeDependencyTests-1907829774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bbe042b-d96b-41eb-8f2d-a21083f7e711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:52:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1898912445',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3729eba7-0002-43e3-9a8d-d8672d4a44c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0ac4240c434cf2bbb5c358ac539020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:52:53Z,use_quota=True,user_id='7c5570febc704767b49e00c1d41d2df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-756a364c-5fa2-43c3-8a24-a3f618131b20 tempest-VolumeDependencyTests-1907829774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53290411-6568-4746-85fb-a1e1e97b82ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-756a364c-5fa2-43c3-8a24-a3f618131b20 tempest-VolumeDependencyTests-1907829774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53290411-6568-4746-85fb-a1e1e97b82ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-756a364c-5fa2-43c3-8a24-a3f618131b20 tempest-VolumeDependencyTests-1907829774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c17e256-b4ec-4931-86d2-e3130e49fa04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-756a364c-5fa2-43c3-8a24-a3f618131b20 tempest-VolumeDependencyTests-1907829774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c17e256-b4ec-4931-86d2-e3130e49fa04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3729eba7-0002-43e3-9a8d-d8672d4a44c5', 'volume_name': 'volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-756a364c-5fa2-43c3-8a24-a3f618131b20 tempest-VolumeDependencyTests-1907829774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aafcdb7-9125-4a5f-9973-5a125bccf2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-756a364c-5fa2-43c3-8a24-a3f618131b20 tempest-VolumeDependencyTests-1907829774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aafcdb7-9125-4a5f-9973-5a125bccf2a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:52 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-756a364c-5fa2-43c3-8a24-a3f618131b20 tempest-VolumeDependencyTests-1907829774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de7b9e04-234c-4743-af7e-f3b30c13baaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:52 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-756a364c-5fa2-43c3-8a24-a3f618131b20 tempest-VolumeDependencyTests-1907829774 None] Volume 3729eba7-0002-43e3-9a8d-d8672d4a44c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5', 'volume_size': 1}
Apr 09 12:52:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-756a364c-5fa2-43c3-8a24-a3f618131b20 tempest-VolumeDependencyTests-1907829774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:52 devstack sudo[90534]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e795b3d7-31eb-400c-ada0-77d2e94b0e08 tempest-CreateVolumesFromSnapshotTest-828104883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-37d74158-2b90-4321-ab38-1d4a49da6fe7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-37d74158-2b90-4321-ab38-1d4a49da6fe7.7ac3efa4-f2bb-4b8c-b60a-407d73534697 1G" returned: 0 in 0.676s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:52 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e795b3d7-31eb-400c-ada0-77d2e94b0e08 tempest-CreateVolumesFromSnapshotTest-828104883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37d74158-2b90-4321-ab38-1d4a49da6fe7 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-37d74158-2b90-4321-ab38-1d4a49da6fe7.7ac3efa4-f2bb-4b8c-b60a-407d73534697 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:52 devstack sudo[90541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37d74158-2b90-4321-ab38-1d4a49da6fe7 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-37d74158-2b90-4321-ab38-1d4a49da6fe7.7ac3efa4-f2bb-4b8c-b60a-407d73534697
Apr 09 12:52:52 devstack sudo[90541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:53 devstack sudo[90541]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e795b3d7-31eb-400c-ada0-77d2e94b0e08 tempest-CreateVolumesFromSnapshotTest-828104883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37d74158-2b90-4321-ab38-1d4a49da6fe7 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-37d74158-2b90-4321-ab38-1d4a49da6fe7.7ac3efa4-f2bb-4b8c-b60a-407d73534697" returned: 0 in 0.463s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:53 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-e795b3d7-31eb-400c-ada0-77d2e94b0e08 tempest-CreateVolumesFromSnapshotTest-828104883 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-37d74158-2b90-4321-ab38-1d4a49da6fe7.7ac3efa4-f2bb-4b8c-b60a-407d73534697 is being set with open permissions: ugo+rw
Apr 09 12:52:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e795b3d7-31eb-400c-ada0-77d2e94b0e08 tempest-CreateVolumesFromSnapshotTest-828104883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-37d74158-2b90-4321-ab38-1d4a49da6fe7.7ac3efa4-f2bb-4b8c-b60a-407d73534697 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:53 devstack sudo[90546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-37d74158-2b90-4321-ab38-1d4a49da6fe7.7ac3efa4-f2bb-4b8c-b60a-407d73534697
Apr 09 12:52:53 devstack sudo[90546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:53 devstack sudo[90546]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e795b3d7-31eb-400c-ada0-77d2e94b0e08 tempest-CreateVolumesFromSnapshotTest-828104883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-37d74158-2b90-4321-ab38-1d4a49da6fe7.7ac3efa4-f2bb-4b8c-b60a-407d73534697" returned: 0 in 0.471s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:53 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e795b3d7-31eb-400c-ada0-77d2e94b0e08 tempest-CreateVolumesFromSnapshotTest-828104883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-37d74158-2b90-4321-ab38-1d4a49da6fe7.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:53 devstack sudo[90549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-37d74158-2b90-4321-ab38-1d4a49da6fe7.info
Apr 09 12:52:53 devstack sudo[90549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:54 devstack sudo[90549]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e795b3d7-31eb-400c-ada0-77d2e94b0e08 tempest-CreateVolumesFromSnapshotTest-828104883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-37d74158-2b90-4321-ab38-1d4a49da6fe7.info" returned: 0 in 0.444s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:54 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-e795b3d7-31eb-400c-ada0-77d2e94b0e08 tempest-CreateVolumesFromSnapshotTest-828104883 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-37d74158-2b90-4321-ab38-1d4a49da6fe7.info is being set with open permissions: ugo+rw
Apr 09 12:52:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e795b3d7-31eb-400c-ada0-77d2e94b0e08 tempest-CreateVolumesFromSnapshotTest-828104883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-37d74158-2b90-4321-ab38-1d4a49da6fe7.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:54 devstack sudo[90552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-37d74158-2b90-4321-ab38-1d4a49da6fe7.info
Apr 09 12:52:54 devstack sudo[90552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:54 devstack sudo[90552]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e795b3d7-31eb-400c-ada0-77d2e94b0e08 tempest-CreateVolumesFromSnapshotTest-828104883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-37d74158-2b90-4321-ab38-1d4a49da6fe7.info" returned: 0 in 0.471s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-e795b3d7-31eb-400c-ada0-77d2e94b0e08 tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.285s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:52:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-41d2b001-3dda-42dc-8fe4-0848887d2bc2 tempest-CinderUnicodeTest-1468521471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.144s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:52:54 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-41d2b001-3dda-42dc-8fe4-0848887d2bc2 tempest-CinderUnicodeTest-1468521471 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31f49052-5c01-4185-830f-627589cab426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa15b7f776a549d4b5f763ee7bcba2d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:52:51Z,use_quota=True,user_id='e9009c5a86974ff6af9314b0696e26c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:52:54 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-41d2b001-3dda-42dc-8fe4-0848887d2bc2 tempest-CinderUnicodeTest-1468521471 None] Creating volume 31f49052-5c01-4185-830f-627589cab426 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:52:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-41d2b001-3dda-42dc-8fe4-0848887d2bc2 tempest-CinderUnicodeTest-1468521471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-41d2b001-3dda-42dc-8fe4-0848887d2bc2 tempest-CinderUnicodeTest-1468521471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:52:54 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-41d2b001-3dda-42dc-8fe4-0848887d2bc2 tempest-CinderUnicodeTest-1468521471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:52:54 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-41d2b001-3dda-42dc-8fe4-0848887d2bc2 tempest-CinderUnicodeTest-1468521471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:52:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-41d2b001-3dda-42dc-8fe4-0848887d2bc2 tempest-CinderUnicodeTest-1468521471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:52:54 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-41d2b001-3dda-42dc-8fe4-0848887d2bc2 tempest-CinderUnicodeTest-1468521471 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:52:54 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-41d2b001-3dda-42dc-8fe4-0848887d2bc2 tempest-CinderUnicodeTest-1468521471 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:52:54 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-41d2b001-3dda-42dc-8fe4-0848887d2bc2 tempest-CinderUnicodeTest-1468521471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-31f49052-5c01-4185-830f-627589cab426 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:54 devstack sudo[90555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-31f49052-5c01-4185-830f-627589cab426 1073741824
Apr 09 12:52:54 devstack sudo[90555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:54 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-e795b3d7-31eb-400c-ada0-77d2e94b0e08 tempest-CreateVolumesFromSnapshotTest-828104883 None] Create snapshot completed successfully
Apr 09 12:52:55 devstack sudo[90555]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-41d2b001-3dda-42dc-8fe4-0848887d2bc2 tempest-CinderUnicodeTest-1468521471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-31f49052-5c01-4185-830f-627589cab426 1073741824" returned: 0 in 0.576s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-41d2b001-3dda-42dc-8fe4-0848887d2bc2 tempest-CinderUnicodeTest-1468521471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-31f49052-5c01-4185-830f-627589cab426 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:55 devstack sudo[90560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-31f49052-5c01-4185-830f-627589cab426
Apr 09 12:52:55 devstack sudo[90560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:55 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbf9b5b8-51fd-4058-9d5c-78c756c32193 tempest-CreateVolumesFromSnapshotTest-828104883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:52:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-cbf9b5b8-51fd-4058-9d5c-78c756c32193 tempest-CreateVolumesFromSnapshotTest-828104883 None] Flow 'volume_create_manager' (0236d837-9e9c-4d35-8c71-320c70fa2937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:52:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-cbf9b5b8-51fd-4058-9d5c-78c756c32193 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe8963c7-b853-4a36-91d7-dc077bba3ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-cbf9b5b8-51fd-4058-9d5c-78c756c32193 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe8963c7-b853-4a36-91d7-dc077bba3ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:52:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1762711607',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e3ad4ec-f9db-475c-9d76-3d165da225df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b444a78f57b4e92819c661a31e3eb24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:52:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:52:55Z,use_quota=True,user_id='82524731e1384a9fa5a94656d03e1874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-cbf9b5b8-51fd-4058-9d5c-78c756c32193 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (237d1020-3f3c-402b-bc8a-0c611dc8625f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-cbf9b5b8-51fd-4058-9d5c-78c756c32193 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (237d1020-3f3c-402b-bc8a-0c611dc8625f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-cbf9b5b8-51fd-4058-9d5c-78c756c32193 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c461271-2125-4bef-a9db-c2798cfdb4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-cbf9b5b8-51fd-4058-9d5c-78c756c32193 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c461271-2125-4bef-a9db-c2798cfdb4ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e3ad4ec-f9db-475c-9d76-3d165da225df', 'volume_name': 'volume-1e3ad4ec-f9db-475c-9d76-3d165da225df', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-cbf9b5b8-51fd-4058-9d5c-78c756c32193 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fcd3b3e-b2f3-484b-9978-7e8913d30a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-cbf9b5b8-51fd-4058-9d5c-78c756c32193 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fcd3b3e-b2f3-484b-9978-7e8913d30a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-cbf9b5b8-51fd-4058-9d5c-78c756c32193 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32adb774-22f0-4194-9e0e-ca845de48da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:55 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-cbf9b5b8-51fd-4058-9d5c-78c756c32193 tempest-CreateVolumesFromSnapshotTest-828104883 None] Volume 1e3ad4ec-f9db-475c-9d76-3d165da225df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e3ad4ec-f9db-475c-9d76-3d165da225df', 'volume_size': 1}
Apr 09 12:52:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-cbf9b5b8-51fd-4058-9d5c-78c756c32193 tempest-CreateVolumesFromSnapshotTest-828104883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:55 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-869dcc08-84df-40f3-801a-b982489ddcdb tempest-CreateVolumesFromSnapshotTest-828104883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:52:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-869dcc08-84df-40f3-801a-b982489ddcdb tempest-CreateVolumesFromSnapshotTest-828104883 None] Flow 'volume_create_manager' (c5ff017b-f5e4-458f-ac39-84472ef63800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:52:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-869dcc08-84df-40f3-801a-b982489ddcdb tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (951281d0-08c6-4dfa-b4c3-2065f0be3938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-869dcc08-84df-40f3-801a-b982489ddcdb tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (951281d0-08c6-4dfa-b4c3-2065f0be3938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:52:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2092334092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=023c12c4-c80f-4c23-9f62-9791d8838a50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b444a78f57b4e92819c661a31e3eb24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:52:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:52:56Z,use_quota=True,user_id='82524731e1384a9fa5a94656d03e1874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-869dcc08-84df-40f3-801a-b982489ddcdb tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51d2a66a-8b24-43d8-991b-49e4699f06ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-869dcc08-84df-40f3-801a-b982489ddcdb tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51d2a66a-8b24-43d8-991b-49e4699f06ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-869dcc08-84df-40f3-801a-b982489ddcdb tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6adee5b1-8671-4554-a381-335354e0296c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-869dcc08-84df-40f3-801a-b982489ddcdb tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6adee5b1-8671-4554-a381-335354e0296c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '023c12c4-c80f-4c23-9f62-9791d8838a50', 'volume_name': 'volume-023c12c4-c80f-4c23-9f62-9791d8838a50', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-869dcc08-84df-40f3-801a-b982489ddcdb tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1df431f2-45f2-4e01-8889-e0e2df8fa700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-869dcc08-84df-40f3-801a-b982489ddcdb tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1df431f2-45f2-4e01-8889-e0e2df8fa700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-869dcc08-84df-40f3-801a-b982489ddcdb tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e113618d-2d89-4497-b73c-b2d96ef47ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:55 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-869dcc08-84df-40f3-801a-b982489ddcdb tempest-CreateVolumesFromSnapshotTest-828104883 None] Volume 023c12c4-c80f-4c23-9f62-9791d8838a50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-023c12c4-c80f-4c23-9f62-9791d8838a50', 'volume_size': 1}
Apr 09 12:52:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-869dcc08-84df-40f3-801a-b982489ddcdb tempest-CreateVolumesFromSnapshotTest-828104883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:55 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f053763-d72b-414c-9638-ea26f5db09e7 tempest-CreateVolumesFromSnapshotTest-828104883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:52:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8f053763-d72b-414c-9638-ea26f5db09e7 tempest-CreateVolumesFromSnapshotTest-828104883 None] Flow 'volume_create_manager' (6d7d4f89-ab3e-40ae-9a55-0e50feb32bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:52:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8f053763-d72b-414c-9638-ea26f5db09e7 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a05bed9e-5799-438d-860d-99a4747158f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:55 devstack sudo[90560]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-41d2b001-3dda-42dc-8fe4-0848887d2bc2 tempest-CinderUnicodeTest-1468521471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-31f49052-5c01-4185-830f-627589cab426" returned: 0 in 0.586s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:55 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-41d2b001-3dda-42dc-8fe4-0848887d2bc2 tempest-CinderUnicodeTest-1468521471 None] <== create_volume: return (1191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:52:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-41d2b001-3dda-42dc-8fe4-0848887d2bc2 tempest-CinderUnicodeTest-1468521471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:52:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-950c6349-4288-4080-9e07-47a5305b66aa tempest-SnapshotDependencyTests-1880031669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.242s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:52:55 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-950c6349-4288-4080-9e07-47a5305b66aa tempest-SnapshotDependencyTests-1880031669 None] Acquiring lock "cinder-quobyte-4580d66e-7321-41f1-9007-b8d91afd8494-d496d9df-1b85-49e3-9ce1-ab5b3100f504" by "_create_volume_from_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:52:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8f053763-d72b-414c-9638-ea26f5db09e7 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a05bed9e-5799-438d-860d-99a4747158f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:52:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-303144242',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07a05b49-8f10-4db3-8fa2-9393f6754174,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b444a78f57b4e92819c661a31e3eb24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:52:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:52:56Z,use_quota=True,user_id='82524731e1384a9fa5a94656d03e1874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8f053763-d72b-414c-9638-ea26f5db09e7 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d13e440d-3289-41bf-a601-f7bfdfcb35a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8f053763-d72b-414c-9638-ea26f5db09e7 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d13e440d-3289-41bf-a601-f7bfdfcb35a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8f053763-d72b-414c-9638-ea26f5db09e7 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b278abc-afe3-4a1e-853d-2f826543a8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8f053763-d72b-414c-9638-ea26f5db09e7 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b278abc-afe3-4a1e-853d-2f826543a8fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07a05b49-8f10-4db3-8fa2-9393f6754174', 'volume_name': 'volume-07a05b49-8f10-4db3-8fa2-9393f6754174', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8f053763-d72b-414c-9638-ea26f5db09e7 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fca948e5-32c5-4943-9cb8-9eebccae3dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8f053763-d72b-414c-9638-ea26f5db09e7 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fca948e5-32c5-4943-9cb8-9eebccae3dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8f053763-d72b-414c-9638-ea26f5db09e7 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a83ece97-f876-4336-8f69-a9c54b7a9d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:55 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-8f053763-d72b-414c-9638-ea26f5db09e7 tempest-CreateVolumesFromSnapshotTest-828104883 None] Volume 07a05b49-8f10-4db3-8fa2-9393f6754174: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07a05b49-8f10-4db3-8fa2-9393f6754174', 'volume_size': 1}
Apr 09 12:52:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-8f053763-d72b-414c-9638-ea26f5db09e7 tempest-CreateVolumesFromSnapshotTest-828104883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-41d2b001-3dda-42dc-8fe4-0848887d2bc2 tempest-CinderUnicodeTest-1468521471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aecceaa9-0e7c-4f91-a4c5-7b088b74d189) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31f49052-5c01-4185-830f-627589cab426', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-41d2b001-3dda-42dc-8fe4-0848887d2bc2 tempest-CinderUnicodeTest-1468521471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (916718da-7242-4748-9e64-a1a16ad130df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:55 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-950c6349-4288-4080-9e07-47a5305b66aa tempest-SnapshotDependencyTests-1880031669 None] Lock "cinder-quobyte-4580d66e-7321-41f1-9007-b8d91afd8494-d496d9df-1b85-49e3-9ce1-ab5b3100f504" acquired by "_create_volume_from_snapshot" :: waited 0.058s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:52:55 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-950c6349-4288-4080-9e07-47a5305b66aa tempest-SnapshotDependencyTests-1880031669 None] Creating volume d496d9df-1b85-49e3-9ce1-ab5b3100f504 from snapshot 4580d66e-7321-41f1-9007-b8d91afd8494 {{(pid=82760) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 09 12:52:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-950c6349-4288-4080-9e07-47a5305b66aa tempest-SnapshotDependencyTests-1880031669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-950c6349-4288-4080-9e07-47a5305b66aa tempest-SnapshotDependencyTests-1880031669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:52:55 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-950c6349-4288-4080-9e07-47a5305b66aa tempest-SnapshotDependencyTests-1880031669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:52:55 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-950c6349-4288-4080-9e07-47a5305b66aa tempest-SnapshotDependencyTests-1880031669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:52:55 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-950c6349-4288-4080-9e07-47a5305b66aa tempest-SnapshotDependencyTests-1880031669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:52:55 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-950c6349-4288-4080-9e07-47a5305b66aa tempest-SnapshotDependencyTests-1880031669 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:52:55 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-950c6349-4288-4080-9e07-47a5305b66aa tempest-SnapshotDependencyTests-1880031669 None] Acquiring lock "cinder-quobyte-d496d9df-1b85-49e3-9ce1-ab5b3100f504" by "_copy_volume_from_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:52:55 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-41d2b001-3dda-42dc-8fe4-0848887d2bc2 tempest-CinderUnicodeTest-1468521471 None] Volume volume-31f49052-5c01-4185-830f-627589cab426 (31f49052-5c01-4185-830f-627589cab426): created successfully
Apr 09 12:52:55 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-41d2b001-3dda-42dc-8fe4-0848887d2bc2 tempest-CinderUnicodeTest-1468521471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (916718da-7242-4748-9e64-a1a16ad130df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:56 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-41d2b001-3dda-42dc-8fe4-0848887d2bc2 tempest-CinderUnicodeTest-1468521471 None] Flow 'volume_create_manager' (59dcdc6a-4d32-4cef-9ad7-cc8e4830910b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:52:56 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-950c6349-4288-4080-9e07-47a5305b66aa tempest-SnapshotDependencyTests-1880031669 None] Lock "cinder-quobyte-d496d9df-1b85-49e3-9ce1-ab5b3100f504" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:52:56 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-950c6349-4288-4080-9e07-47a5305b66aa tempest-SnapshotDependencyTests-1880031669 None] snapshot: 4580d66e-7321-41f1-9007-b8d91afd8494, volume: d496d9df-1b85-49e3-9ce1-ab5b3100f504,  {{(pid=82760) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 09 12:52:56 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-41d2b001-3dda-42dc-8fe4-0848887d2bc2 tempest-CinderUnicodeTest-1468521471 None] Created volume successfully.
Apr 09 12:52:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-950c6349-4288-4080-9e07-47a5305b66aa tempest-SnapshotDependencyTests-1880031669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-950c6349-4288-4080-9e07-47a5305b66aa tempest-SnapshotDependencyTests-1880031669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:52:56 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-950c6349-4288-4080-9e07-47a5305b66aa tempest-SnapshotDependencyTests-1880031669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:52:56 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-950c6349-4288-4080-9e07-47a5305b66aa tempest-SnapshotDependencyTests-1880031669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:52:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-950c6349-4288-4080-9e07-47a5305b66aa tempest-SnapshotDependencyTests-1880031669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:52:56 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[930b34da-c108-4f85-ace4-4499059c9499]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:52:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-950c6349-4288-4080-9e07-47a5305b66aa tempest-SnapshotDependencyTests-1880031669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15.4580d66e-7321-41f1-9007-b8d91afd8494 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:56 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-de2d8841-e215-4a04-acc1-870c56465799 tempest-CreateVolumesFromSnapshotTest-828104883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:52:56 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-de2d8841-e215-4a04-acc1-870c56465799 tempest-CreateVolumesFromSnapshotTest-828104883 None] Flow 'volume_create_manager' (cf15af6d-92d1-4d08-8429-285031428919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:52:56 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-de2d8841-e215-4a04-acc1-870c56465799 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eef3fa51-c3b9-444d-91c7-f4dd61c37b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:56 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-de2d8841-e215-4a04-acc1-870c56465799 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eef3fa51-c3b9-444d-91c7-f4dd61c37b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:52:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-454653739',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bd73a10-3482-474f-afdd-a557b84948ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b444a78f57b4e92819c661a31e3eb24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:52:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:52:56Z,use_quota=True,user_id='82524731e1384a9fa5a94656d03e1874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:56 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-de2d8841-e215-4a04-acc1-870c56465799 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37a8e3df-84d9-48ea-ba35-a60b44709227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:56 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-de2d8841-e215-4a04-acc1-870c56465799 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37a8e3df-84d9-48ea-ba35-a60b44709227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:56 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-de2d8841-e215-4a04-acc1-870c56465799 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a68349ae-7cbe-4989-aa53-208aee0abdd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:56 devstack sudo[90563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15.4580d66e-7321-41f1-9007-b8d91afd8494
Apr 09 12:52:56 devstack sudo[90563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:56 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-de2d8841-e215-4a04-acc1-870c56465799 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a68349ae-7cbe-4989-aa53-208aee0abdd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bd73a10-3482-474f-afdd-a557b84948ef', 'volume_name': 'volume-4bd73a10-3482-474f-afdd-a557b84948ef', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:56 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-de2d8841-e215-4a04-acc1-870c56465799 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb75bda9-540e-4bd3-b7f3-7c427ba6fe43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:56 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-de2d8841-e215-4a04-acc1-870c56465799 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb75bda9-540e-4bd3-b7f3-7c427ba6fe43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:56 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-de2d8841-e215-4a04-acc1-870c56465799 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3d12b1d-fc96-4c11-844b-928b37353b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:56 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-de2d8841-e215-4a04-acc1-870c56465799 tempest-CreateVolumesFromSnapshotTest-828104883 None] Volume 4bd73a10-3482-474f-afdd-a557b84948ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bd73a10-3482-474f-afdd-a557b84948ef', 'volume_size': 1}
Apr 09 12:52:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-de2d8841-e215-4a04-acc1-870c56465799 tempest-CreateVolumesFromSnapshotTest-828104883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:56 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc73d936-e09e-4598-ac22-398885469896 tempest-CreateVolumesFromSnapshotTest-828104883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:52:56 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-cc73d936-e09e-4598-ac22-398885469896 tempest-CreateVolumesFromSnapshotTest-828104883 None] Flow 'volume_create_manager' (029f6237-7aad-4537-8a98-429c80079c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:52:56 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-cc73d936-e09e-4598-ac22-398885469896 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaf5f46e-8a92-48be-a16b-1246950f02da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:56 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-cc73d936-e09e-4598-ac22-398885469896 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaf5f46e-8a92-48be-a16b-1246950f02da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:52:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1383840476',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d530f96d-9752-4c86-952e-89ff32692ec9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b444a78f57b4e92819c661a31e3eb24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:52:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:52:56Z,use_quota=True,user_id='82524731e1384a9fa5a94656d03e1874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:56 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-cc73d936-e09e-4598-ac22-398885469896 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9a51822-aaad-4ba4-af61-113c8b9e1c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:56 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-cc73d936-e09e-4598-ac22-398885469896 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9a51822-aaad-4ba4-af61-113c8b9e1c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:56 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-cc73d936-e09e-4598-ac22-398885469896 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (926dfcc1-7cb6-4138-b69f-7522cddf08b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:56 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-cc73d936-e09e-4598-ac22-398885469896 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (926dfcc1-7cb6-4138-b69f-7522cddf08b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd530f96d-9752-4c86-952e-89ff32692ec9', 'volume_name': 'volume-d530f96d-9752-4c86-952e-89ff32692ec9', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:56 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-cc73d936-e09e-4598-ac22-398885469896 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d41cf68-dc79-4d77-b92f-5fd98dcafc48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:56 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-cc73d936-e09e-4598-ac22-398885469896 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d41cf68-dc79-4d77-b92f-5fd98dcafc48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:56 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-cc73d936-e09e-4598-ac22-398885469896 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b8eae31-2bc0-410a-a553-7bea5db3807f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:56 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-cc73d936-e09e-4598-ac22-398885469896 tempest-CreateVolumesFromSnapshotTest-828104883 None] Volume d530f96d-9752-4c86-952e-89ff32692ec9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d530f96d-9752-4c86-952e-89ff32692ec9', 'volume_size': 1}
Apr 09 12:52:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-cc73d936-e09e-4598-ac22-398885469896 tempest-CreateVolumesFromSnapshotTest-828104883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:56 devstack sudo[90563]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-950c6349-4288-4080-9e07-47a5305b66aa tempest-SnapshotDependencyTests-1880031669 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15.4580d66e-7321-41f1-9007-b8d91afd8494" returned: 0 in 0.618s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:56 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-950c6349-4288-4080-9e07-47a5305b66aa tempest-SnapshotDependencyTests-1880031669 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:52:56 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-950c6349-4288-4080-9e07-47a5305b66aa tempest-SnapshotDependencyTests-1880031669 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15 {{(pid=82760) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 09 12:52:56 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-950c6349-4288-4080-9e07-47a5305b66aa tempest-SnapshotDependencyTests-1880031669 None] Creating direct copy from snapshot {{(pid=82760) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 09 12:52:56 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[740d9b04-3c15-4ac7-992a-561dc8952407]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:52:56 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-950c6349-4288-4080-9e07-47a5305b66aa tempest-SnapshotDependencyTests-1880031669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:56 devstack sudo[90568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15
Apr 09 12:52:56 devstack sudo[90568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:52:57 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ef606c9-5814-4ca2-ab01-a6e675631536 tempest-CinderUnicodeTest-1468521471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:52:57 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-7ef606c9-5814-4ca2-ab01-a6e675631536 tempest-CinderUnicodeTest-1468521471 None] Flow 'volume_create_manager' (058a36ca-9d46-437a-b696-450c3588fdd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:52:57 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-7ef606c9-5814-4ca2-ab01-a6e675631536 tempest-CinderUnicodeTest-1468521471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9173786c-278e-47d1-a1a9-640c95a319ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:57 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-7ef606c9-5814-4ca2-ab01-a6e675631536 tempest-CinderUnicodeTest-1468521471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9173786c-278e-47d1-a1a9-640c95a319ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:52:57Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-699555144',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77cee92a-e8a4-4c97-98ac-ae40d42d131c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa15b7f776a549d4b5f763ee7bcba2d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:52:57Z,use_quota=True,user_id='e9009c5a86974ff6af9314b0696e26c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:57 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-7ef606c9-5814-4ca2-ab01-a6e675631536 tempest-CinderUnicodeTest-1468521471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec6d3746-a28a-4297-8d00-062f4954203d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:57 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-7ef606c9-5814-4ca2-ab01-a6e675631536 tempest-CinderUnicodeTest-1468521471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec6d3746-a28a-4297-8d00-062f4954203d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:57 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-7ef606c9-5814-4ca2-ab01-a6e675631536 tempest-CinderUnicodeTest-1468521471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d0ad05f-88c2-4ed3-b494-733eda1690fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:57 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-7ef606c9-5814-4ca2-ab01-a6e675631536 tempest-CinderUnicodeTest-1468521471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d0ad05f-88c2-4ed3-b494-733eda1690fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77cee92a-e8a4-4c97-98ac-ae40d42d131c', 'volume_name': 'volume-77cee92a-e8a4-4c97-98ac-ae40d42d131c', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:57 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-7ef606c9-5814-4ca2-ab01-a6e675631536 tempest-CinderUnicodeTest-1468521471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05c4f53e-c458-4f0a-ad1b-9c5a400ab15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:57 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-7ef606c9-5814-4ca2-ab01-a6e675631536 tempest-CinderUnicodeTest-1468521471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05c4f53e-c458-4f0a-ad1b-9c5a400ab15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:52:57 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-7ef606c9-5814-4ca2-ab01-a6e675631536 tempest-CinderUnicodeTest-1468521471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1d2447c-4b79-42bf-b633-60b65e2bc6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:52:57 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-7ef606c9-5814-4ca2-ab01-a6e675631536 tempest-CinderUnicodeTest-1468521471 None] Volume 77cee92a-e8a4-4c97-98ac-ae40d42d131c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77cee92a-e8a4-4c97-98ac-ae40d42d131c', 'volume_size': 1}
Apr 09 12:52:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-7ef606c9-5814-4ca2-ab01-a6e675631536 tempest-CinderUnicodeTest-1468521471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:52:57 devstack sudo[90568]: pam_unix(sudo:session): session closed for user root
Apr 09 12:52:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-950c6349-4288-4080-9e07-47a5305b66aa tempest-SnapshotDependencyTests-1880031669 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15" returned: 0 in 0.683s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:52:57 devstack cinder-volume[82760]: DEBUG cinder.utils [None req-950c6349-4288-4080-9e07-47a5305b66aa tempest-SnapshotDependencyTests-1880031669 None] Path /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d496d9df-1b85-49e3-9ce1-ab5b3100f504 not found in is_blk_device check {{(pid=82760) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 09 12:52:57 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-950c6349-4288-4080-9e07-47a5305b66aa tempest-SnapshotDependencyTests-1880031669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d496d9df-1b85-49e3-9ce1-ab5b3100f504 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:52:57 devstack sudo[90574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d496d9df-1b85-49e3-9ce1-ab5b3100f504
Apr 09 12:52:57 devstack sudo[90574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:00 devstack sudo[90574]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-950c6349-4288-4080-9e07-47a5305b66aa tempest-SnapshotDependencyTests-1880031669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d496d9df-1b85-49e3-9ce1-ab5b3100f504" returned: 0 in 2.966s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:00 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e71eac-3182-4c96-ba9d-3ab2e69832bb]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:53:00 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-950c6349-4288-4080-9e07-47a5305b66aa tempest-SnapshotDependencyTests-1880031669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:00 devstack sudo[90586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15
Apr 09 12:53:00 devstack sudo[90586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:01 devstack sudo[90586]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-950c6349-4288-4080-9e07-47a5305b66aa tempest-SnapshotDependencyTests-1880031669 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15" returned: 0 in 0.760s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:01 devstack cinder-volume[82760]: DEBUG cinder.image.image_utils [None req-950c6349-4288-4080-9e07-47a5305b66aa tempest-SnapshotDependencyTests-1880031669 None] Image conversion details: src /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15, size 1024.00 MB, duration 2.97 sec, destination /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d496d9df-1b85-49e3-9ce1-ab5b3100f504 {{(pid=82760) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 12:53:01 devstack cinder-volume[82760]: INFO cinder.image.image_utils [None req-950c6349-4288-4080-9e07-47a5305b66aa tempest-SnapshotDependencyTests-1880031669 None] Converted 1024.00 MB image at 345.11 MB/s
Apr 09 12:53:01 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-950c6349-4288-4080-9e07-47a5305b66aa tempest-SnapshotDependencyTests-1880031669 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d496d9df-1b85-49e3-9ce1-ab5b3100f504 is being set with open permissions: ugo+rw
Apr 09 12:53:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-950c6349-4288-4080-9e07-47a5305b66aa tempest-SnapshotDependencyTests-1880031669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d496d9df-1b85-49e3-9ce1-ab5b3100f504 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:01 devstack sudo[90591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d496d9df-1b85-49e3-9ce1-ab5b3100f504
Apr 09 12:53:01 devstack sudo[90591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:01 devstack sudo[90591]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-950c6349-4288-4080-9e07-47a5305b66aa tempest-SnapshotDependencyTests-1880031669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d496d9df-1b85-49e3-9ce1-ab5b3100f504" returned: 0 in 0.500s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:01 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-950c6349-4288-4080-9e07-47a5305b66aa tempest-SnapshotDependencyTests-1880031669 None] Lock "cinder-quobyte-d496d9df-1b85-49e3-9ce1-ab5b3100f504" released by "_copy_volume_from_snapshot" :: held 5.622s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:53:01 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-950c6349-4288-4080-9e07-47a5305b66aa tempest-SnapshotDependencyTests-1880031669 None] Lock "cinder-quobyte-4580d66e-7321-41f1-9007-b8d91afd8494-d496d9df-1b85-49e3-9ce1-ab5b3100f504" released by "_create_volume_from_snapshot" :: held 5.667s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:53:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-950c6349-4288-4080-9e07-47a5305b66aa tempest-SnapshotDependencyTests-1880031669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.726s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:53:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-756a364c-5fa2-43c3-8a24-a3f618131b20 tempest-VolumeDependencyTests-1907829774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.933s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:53:01 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-756a364c-5fa2-43c3-8a24-a3f618131b20 tempest-VolumeDependencyTests-1907829774 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:52:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1898912445',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3729eba7-0002-43e3-9a8d-d8672d4a44c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0ac4240c434cf2bbb5c358ac539020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:52:53Z,use_quota=True,user_id='7c5570febc704767b49e00c1d41d2df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:53:01 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-756a364c-5fa2-43c3-8a24-a3f618131b20 tempest-VolumeDependencyTests-1907829774 None] Creating volume 3729eba7-0002-43e3-9a8d-d8672d4a44c5 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:53:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-756a364c-5fa2-43c3-8a24-a3f618131b20 tempest-VolumeDependencyTests-1907829774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:53:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-756a364c-5fa2-43c3-8a24-a3f618131b20 tempest-VolumeDependencyTests-1907829774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:53:01 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-756a364c-5fa2-43c3-8a24-a3f618131b20 tempest-VolumeDependencyTests-1907829774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:53:01 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-756a364c-5fa2-43c3-8a24-a3f618131b20 tempest-VolumeDependencyTests-1907829774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:53:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-756a364c-5fa2-43c3-8a24-a3f618131b20 tempest-VolumeDependencyTests-1907829774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:53:01 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-756a364c-5fa2-43c3-8a24-a3f618131b20 tempest-VolumeDependencyTests-1907829774 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:53:01 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-756a364c-5fa2-43c3-8a24-a3f618131b20 tempest-VolumeDependencyTests-1907829774 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:53:01 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-756a364c-5fa2-43c3-8a24-a3f618131b20 tempest-VolumeDependencyTests-1907829774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:01 devstack sudo[90594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5 1073741824
Apr 09 12:53:01 devstack sudo[90594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:01 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-950c6349-4288-4080-9e07-47a5305b66aa tempest-SnapshotDependencyTests-1880031669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad35c694-24f6-49bc-aaa7-c641ca208318) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d496d9df-1b85-49e3-9ce1-ab5b3100f504', 'volume_size': 1, 'snapshot_id': '4580d66e-7321-41f1-9007-b8d91afd8494'}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:53:01 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-950c6349-4288-4080-9e07-47a5305b66aa tempest-SnapshotDependencyTests-1880031669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (341fab58-ddb3-4929-87d9-e8f15e6f4470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:53:01 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-950c6349-4288-4080-9e07-47a5305b66aa tempest-SnapshotDependencyTests-1880031669 None] Volume volume-d496d9df-1b85-49e3-9ce1-ab5b3100f504 (d496d9df-1b85-49e3-9ce1-ab5b3100f504): created successfully
Apr 09 12:53:01 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-950c6349-4288-4080-9e07-47a5305b66aa tempest-SnapshotDependencyTests-1880031669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (341fab58-ddb3-4929-87d9-e8f15e6f4470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:53:01 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-950c6349-4288-4080-9e07-47a5305b66aa tempest-SnapshotDependencyTests-1880031669 None] Flow 'volume_create_manager' (02fcc624-9f72-46ab-81be-64dc715597a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:53:01 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-950c6349-4288-4080-9e07-47a5305b66aa tempest-SnapshotDependencyTests-1880031669 None] Created volume successfully.
Apr 09 12:53:02 devstack sudo[90594]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-756a364c-5fa2-43c3-8a24-a3f618131b20 tempest-VolumeDependencyTests-1907829774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5 1073741824" returned: 0 in 0.771s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:02 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-afe472a3-dbab-404c-a72c-42e00789e662 tempest-SnapshotDependencyTests-1880031669 None] Acquiring lock "cinder-4580d66e-7321-41f1-9007-b8d91afd8494-delete_snapshot" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:53:02 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-afe472a3-dbab-404c-a72c-42e00789e662 tempest-SnapshotDependencyTests-1880031669 None] Lock "cinder-4580d66e-7321-41f1-9007-b8d91afd8494-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:53:02 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-afe472a3-dbab-404c-a72c-42e00789e662 tempest-SnapshotDependencyTests-1880031669 None] Acquiring lock "cinder-quobyte-5dcef0fe-f172-4c8d-b611-bb21edb84c15" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:53:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-756a364c-5fa2-43c3-8a24-a3f618131b20 tempest-VolumeDependencyTests-1907829774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:02 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-afe472a3-dbab-404c-a72c-42e00789e662 tempest-SnapshotDependencyTests-1880031669 None] Lock "cinder-quobyte-5dcef0fe-f172-4c8d-b611-bb21edb84c15" acquired by "delete_snapshot" :: waited 0.034s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:53:02 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-afe472a3-dbab-404c-a72c-42e00789e662 tempest-SnapshotDependencyTests-1880031669 None] Acquiring lock "cinder-quobyte-4580d66e-7321-41f1-9007-b8d91afd8494" by "_delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:53:02 devstack sudo[90599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5
Apr 09 12:53:02 devstack sudo[90599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:02 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-afe472a3-dbab-404c-a72c-42e00789e662 tempest-SnapshotDependencyTests-1880031669 None] Lock "cinder-quobyte-4580d66e-7321-41f1-9007-b8d91afd8494" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:53:02 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-afe472a3-dbab-404c-a72c-42e00789e662 tempest-SnapshotDependencyTests-1880031669 None] Deleting offline snapshot 4580d66e-7321-41f1-9007-b8d91afd8494 of volume 5dcef0fe-f172-4c8d-b611-bb21edb84c15 {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 12:53:02 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-afe472a3-dbab-404c-a72c-42e00789e662 tempest-SnapshotDependencyTests-1880031669 None] snapshot_file for this snap is: volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15.4580d66e-7321-41f1-9007-b8d91afd8494 {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 12:53:02 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[45307af5-110c-4dbe-a262-6155baa968a0]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:53:02 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-afe472a3-dbab-404c-a72c-42e00789e662 tempest-SnapshotDependencyTests-1880031669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15.4580d66e-7321-41f1-9007-b8d91afd8494 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:02 devstack sudo[90602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15.4580d66e-7321-41f1-9007-b8d91afd8494
Apr 09 12:53:02 devstack sudo[90602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:03 devstack sudo[90599]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-756a364c-5fa2-43c3-8a24-a3f618131b20 tempest-VolumeDependencyTests-1907829774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5" returned: 0 in 0.525s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:03 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-756a364c-5fa2-43c3-8a24-a3f618131b20 tempest-VolumeDependencyTests-1907829774 None] <== create_volume: return (1362ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:53:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-756a364c-5fa2-43c3-8a24-a3f618131b20 tempest-VolumeDependencyTests-1907829774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.366s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:53:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-cbf9b5b8-51fd-4058-9d5c-78c756c32193 tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.532s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:53:03 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-cbf9b5b8-51fd-4058-9d5c-78c756c32193 tempest-CreateVolumesFromSnapshotTest-828104883 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:52:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1762711607',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e3ad4ec-f9db-475c-9d76-3d165da225df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b444a78f57b4e92819c661a31e3eb24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:52:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:52:55Z,use_quota=True,user_id='82524731e1384a9fa5a94656d03e1874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:53:03 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-cbf9b5b8-51fd-4058-9d5c-78c756c32193 tempest-CreateVolumesFromSnapshotTest-828104883 None] Creating volume 1e3ad4ec-f9db-475c-9d76-3d165da225df {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:53:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-cbf9b5b8-51fd-4058-9d5c-78c756c32193 tempest-CreateVolumesFromSnapshotTest-828104883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:53:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-cbf9b5b8-51fd-4058-9d5c-78c756c32193 tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:53:03 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-cbf9b5b8-51fd-4058-9d5c-78c756c32193 tempest-CreateVolumesFromSnapshotTest-828104883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:53:03 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-cbf9b5b8-51fd-4058-9d5c-78c756c32193 tempest-CreateVolumesFromSnapshotTest-828104883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:53:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-cbf9b5b8-51fd-4058-9d5c-78c756c32193 tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:53:03 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-cbf9b5b8-51fd-4058-9d5c-78c756c32193 tempest-CreateVolumesFromSnapshotTest-828104883 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:53:03 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-cbf9b5b8-51fd-4058-9d5c-78c756c32193 tempest-CreateVolumesFromSnapshotTest-828104883 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:53:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-cbf9b5b8-51fd-4058-9d5c-78c756c32193 tempest-CreateVolumesFromSnapshotTest-828104883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1e3ad4ec-f9db-475c-9d76-3d165da225df 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:03 devstack sudo[90605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1e3ad4ec-f9db-475c-9d76-3d165da225df 1073741824
Apr 09 12:53:03 devstack sudo[90605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:03 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-756a364c-5fa2-43c3-8a24-a3f618131b20 tempest-VolumeDependencyTests-1907829774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de7b9e04-234c-4743-af7e-f3b30c13baaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:53:03 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-756a364c-5fa2-43c3-8a24-a3f618131b20 tempest-VolumeDependencyTests-1907829774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (151d73ab-8fae-4d06-8876-6828e6c3346e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:53:03 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-756a364c-5fa2-43c3-8a24-a3f618131b20 tempest-VolumeDependencyTests-1907829774 None] Volume volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5 (3729eba7-0002-43e3-9a8d-d8672d4a44c5): created successfully
Apr 09 12:53:03 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-756a364c-5fa2-43c3-8a24-a3f618131b20 tempest-VolumeDependencyTests-1907829774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (151d73ab-8fae-4d06-8876-6828e6c3346e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:53:03 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-756a364c-5fa2-43c3-8a24-a3f618131b20 tempest-VolumeDependencyTests-1907829774 None] Flow 'volume_create_manager' (6b666371-129e-4661-b645-75a783b36cd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:53:03 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-756a364c-5fa2-43c3-8a24-a3f618131b20 tempest-VolumeDependencyTests-1907829774 None] Created volume successfully.
Apr 09 12:53:03 devstack sudo[90602]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-afe472a3-dbab-404c-a72c-42e00789e662 tempest-SnapshotDependencyTests-1880031669 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15.4580d66e-7321-41f1-9007-b8d91afd8494" returned: 0 in 0.652s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:03 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-afe472a3-dbab-404c-a72c-42e00789e662 tempest-SnapshotDependencyTests-1880031669 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:53:03 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe4517f-f987-40f8-b4ba-2329792a9e69]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:53:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-afe472a3-dbab-404c-a72c-42e00789e662 tempest-SnapshotDependencyTests-1880031669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:03 devstack sudo[90610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15
Apr 09 12:53:03 devstack sudo[90610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:03 devstack sudo[90605]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-cbf9b5b8-51fd-4058-9d5c-78c756c32193 tempest-CreateVolumesFromSnapshotTest-828104883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1e3ad4ec-f9db-475c-9d76-3d165da225df 1073741824" returned: 0 in 0.595s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-cbf9b5b8-51fd-4058-9d5c-78c756c32193 tempest-CreateVolumesFromSnapshotTest-828104883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1e3ad4ec-f9db-475c-9d76-3d165da225df {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:03 devstack sudo[90617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1e3ad4ec-f9db-475c-9d76-3d165da225df
Apr 09 12:53:03 devstack sudo[90617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:03 devstack sudo[90610]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-afe472a3-dbab-404c-a72c-42e00789e662 tempest-SnapshotDependencyTests-1880031669 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15" returned: 0 in 0.641s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:03 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-afe472a3-dbab-404c-a72c-42e00789e662 tempest-SnapshotDependencyTests-1880031669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15.4580d66e-7321-41f1-9007-b8d91afd8494 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:03 devstack cinder-volume[82760]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82760) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 09 12:53:03 devstack sudo[90620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15.4580d66e-7321-41f1-9007-b8d91afd8494
Apr 09 12:53:03 devstack sudo[90620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:03 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] Flow 'volume_create_manager' (894299dc-fe20-4f5b-9d76-915d6c7c4a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:53:03 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ac8747e-1895-4d9e-9f96-2e3f04840c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:53:03 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ac8747e-1895-4d9e-9f96-2e3f04840c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1795835490',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3db62cd-7895-4d0b-9e77-858c9b187848,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0ac4240c434cf2bbb5c358ac539020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=3729eba7-0002-43e3-9a8d-d8672d4a44c5,status='creating',terminated_at=None,updated_at=2026-04-09T10:53:04Z,use_quota=True,user_id='7c5570febc704767b49e00c1d41d2df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:53:03 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b376e852-ad22-4116-8835-34db9db3e424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:53:03 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b376e852-ad22-4116-8835-34db9db3e424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:53:03 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7211ea97-1e9b-4333-bf55-2034545a3e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:53:03 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7211ea97-1e9b-4333-bf55-2034545a3e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'a3db62cd-7895-4d0b-9e77-858c9b187848', 'volume_name': 'volume-a3db62cd-7895-4d0b-9e77-858c9b187848', 'volume_size': 1, 'source_volid': '3729eba7-0002-43e3-9a8d-d8672d4a44c5', 'source_volstatus': 'available'}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:53:03 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bcbf539-83bd-462d-b3fc-e35e709afc9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:53:03 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bcbf539-83bd-462d-b3fc-e35e709afc9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:53:03 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e7b4910-e91f-4d36-90a2-5c3e7689c745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:53:03 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] Volume a3db62cd-7895-4d0b-9e77-858c9b187848: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-a3db62cd-7895-4d0b-9e77-858c9b187848', 'volume_size': 1, 'source_volid': '3729eba7-0002-43e3-9a8d-d8672d4a44c5', 'source_volstatus': 'available'}
Apr 09 12:53:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:53:04 devstack sudo[90617]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-cbf9b5b8-51fd-4058-9d5c-78c756c32193 tempest-CreateVolumesFromSnapshotTest-828104883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1e3ad4ec-f9db-475c-9d76-3d165da225df" returned: 0 in 0.505s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:04 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-cbf9b5b8-51fd-4058-9d5c-78c756c32193 tempest-CreateVolumesFromSnapshotTest-828104883 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:53:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-cbf9b5b8-51fd-4058-9d5c-78c756c32193 tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:53:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-869dcc08-84df-40f3-801a-b982489ddcdb tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.520s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:53:04 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-869dcc08-84df-40f3-801a-b982489ddcdb tempest-CreateVolumesFromSnapshotTest-828104883 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:52:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2092334092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=023c12c4-c80f-4c23-9f62-9791d8838a50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b444a78f57b4e92819c661a31e3eb24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:52:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:52:56Z,use_quota=True,user_id='82524731e1384a9fa5a94656d03e1874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:53:04 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-869dcc08-84df-40f3-801a-b982489ddcdb tempest-CreateVolumesFromSnapshotTest-828104883 None] Creating volume 023c12c4-c80f-4c23-9f62-9791d8838a50 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:53:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-869dcc08-84df-40f3-801a-b982489ddcdb tempest-CreateVolumesFromSnapshotTest-828104883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:53:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-869dcc08-84df-40f3-801a-b982489ddcdb tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:53:04 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-869dcc08-84df-40f3-801a-b982489ddcdb tempest-CreateVolumesFromSnapshotTest-828104883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:53:04 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-869dcc08-84df-40f3-801a-b982489ddcdb tempest-CreateVolumesFromSnapshotTest-828104883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:53:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-869dcc08-84df-40f3-801a-b982489ddcdb tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:53:04 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-869dcc08-84df-40f3-801a-b982489ddcdb tempest-CreateVolumesFromSnapshotTest-828104883 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:53:04 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-869dcc08-84df-40f3-801a-b982489ddcdb tempest-CreateVolumesFromSnapshotTest-828104883 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:53:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-869dcc08-84df-40f3-801a-b982489ddcdb tempest-CreateVolumesFromSnapshotTest-828104883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-023c12c4-c80f-4c23-9f62-9791d8838a50 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:04 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-cbf9b5b8-51fd-4058-9d5c-78c756c32193 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32adb774-22f0-4194-9e0e-ca845de48da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e3ad4ec-f9db-475c-9d76-3d165da225df', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:53:04 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-cbf9b5b8-51fd-4058-9d5c-78c756c32193 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47718901-c21b-4e3c-9c54-6394392ab1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:53:04 devstack sudo[90623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-023c12c4-c80f-4c23-9f62-9791d8838a50 1073741824
Apr 09 12:53:04 devstack sudo[90623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:04 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-cbf9b5b8-51fd-4058-9d5c-78c756c32193 tempest-CreateVolumesFromSnapshotTest-828104883 None] Volume volume-1e3ad4ec-f9db-475c-9d76-3d165da225df (1e3ad4ec-f9db-475c-9d76-3d165da225df): created successfully
Apr 09 12:53:04 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-cbf9b5b8-51fd-4058-9d5c-78c756c32193 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47718901-c21b-4e3c-9c54-6394392ab1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:53:04 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-cbf9b5b8-51fd-4058-9d5c-78c756c32193 tempest-CreateVolumesFromSnapshotTest-828104883 None] Flow 'volume_create_manager' (0236d837-9e9c-4d35-8c71-320c70fa2937) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:53:04 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-cbf9b5b8-51fd-4058-9d5c-78c756c32193 tempest-CreateVolumesFromSnapshotTest-828104883 None] Created volume successfully.
Apr 09 12:53:04 devstack sudo[90620]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-afe472a3-dbab-404c-a72c-42e00789e662 tempest-SnapshotDependencyTests-1880031669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15.4580d66e-7321-41f1-9007-b8d91afd8494" returned: 0 in 0.511s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-afe472a3-dbab-404c-a72c-42e00789e662 tempest-SnapshotDependencyTests-1880031669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15.4580d66e-7321-41f1-9007-b8d91afd8494 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:04 devstack sudo[90628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15.4580d66e-7321-41f1-9007-b8d91afd8494
Apr 09 12:53:04 devstack sudo[90628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:04 devstack sudo[90623]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-869dcc08-84df-40f3-801a-b982489ddcdb tempest-CreateVolumesFromSnapshotTest-828104883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-023c12c4-c80f-4c23-9f62-9791d8838a50 1073741824" returned: 0 in 0.516s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-869dcc08-84df-40f3-801a-b982489ddcdb tempest-CreateVolumesFromSnapshotTest-828104883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-023c12c4-c80f-4c23-9f62-9791d8838a50 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:04 devstack sudo[90634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-023c12c4-c80f-4c23-9f62-9791d8838a50
Apr 09 12:53:04 devstack sudo[90634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:04 devstack sudo[90628]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:04 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-afe472a3-dbab-404c-a72c-42e00789e662 tempest-SnapshotDependencyTests-1880031669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15.4580d66e-7321-41f1-9007-b8d91afd8494" returned: 0 in 0.468s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:04 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-afe472a3-dbab-404c-a72c-42e00789e662 tempest-SnapshotDependencyTests-1880031669 None] Lock "cinder-quobyte-4580d66e-7321-41f1-9007-b8d91afd8494" released by "_delete_snapshot" :: held 2.340s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:53:04 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-afe472a3-dbab-404c-a72c-42e00789e662 tempest-SnapshotDependencyTests-1880031669 None] Lock "cinder-quobyte-5dcef0fe-f172-4c8d-b611-bb21edb84c15" released by "delete_snapshot" :: held 2.360s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:53:04 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-afe472a3-dbab-404c-a72c-42e00789e662 tempest-SnapshotDependencyTests-1880031669 None] Created reservations ['4ed85596-62c7-4585-848d-d42d65276fce', 'c277901c-7da0-4bff-bf04-612edd5f18e0', 'bad0a7dd-9c7c-4e28-8994-094877cb4ff8', '089cf6c3-dd2e-461c-beda-37acfcf4cd58'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:53:04 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-afe472a3-dbab-404c-a72c-42e00789e662 tempest-SnapshotDependencyTests-1880031669 None] Delete snapshot completed successfully.
Apr 09 12:53:04 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-afe472a3-dbab-404c-a72c-42e00789e662 tempest-SnapshotDependencyTests-1880031669 None] Lock "cinder-4580d66e-7321-41f1-9007-b8d91afd8494-delete_snapshot" released by "delete_snapshot" :: held 2.468s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:53:05 devstack sudo[90634]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-869dcc08-84df-40f3-801a-b982489ddcdb tempest-CreateVolumesFromSnapshotTest-828104883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-023c12c4-c80f-4c23-9f62-9791d8838a50" returned: 0 in 0.466s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:05 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-869dcc08-84df-40f3-801a-b982489ddcdb tempest-CreateVolumesFromSnapshotTest-828104883 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:53:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-869dcc08-84df-40f3-801a-b982489ddcdb tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:53:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-8f053763-d72b-414c-9638-ea26f5db09e7 tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.265s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:53:05 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-8f053763-d72b-414c-9638-ea26f5db09e7 tempest-CreateVolumesFromSnapshotTest-828104883 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:52:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-303144242',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07a05b49-8f10-4db3-8fa2-9393f6754174,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b444a78f57b4e92819c661a31e3eb24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:52:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:52:56Z,use_quota=True,user_id='82524731e1384a9fa5a94656d03e1874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:53:05 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-8f053763-d72b-414c-9638-ea26f5db09e7 tempest-CreateVolumesFromSnapshotTest-828104883 None] Creating volume 07a05b49-8f10-4db3-8fa2-9393f6754174 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:53:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-8f053763-d72b-414c-9638-ea26f5db09e7 tempest-CreateVolumesFromSnapshotTest-828104883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:53:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-8f053763-d72b-414c-9638-ea26f5db09e7 tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:53:05 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-8f053763-d72b-414c-9638-ea26f5db09e7 tempest-CreateVolumesFromSnapshotTest-828104883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:53:05 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-8f053763-d72b-414c-9638-ea26f5db09e7 tempest-CreateVolumesFromSnapshotTest-828104883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:53:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-8f053763-d72b-414c-9638-ea26f5db09e7 tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:53:05 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-8f053763-d72b-414c-9638-ea26f5db09e7 tempest-CreateVolumesFromSnapshotTest-828104883 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:53:05 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-8f053763-d72b-414c-9638-ea26f5db09e7 tempest-CreateVolumesFromSnapshotTest-828104883 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:53:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-8f053763-d72b-414c-9638-ea26f5db09e7 tempest-CreateVolumesFromSnapshotTest-828104883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-07a05b49-8f10-4db3-8fa2-9393f6754174 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:05 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-869dcc08-84df-40f3-801a-b982489ddcdb tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e113618d-2d89-4497-b73c-b2d96ef47ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-023c12c4-c80f-4c23-9f62-9791d8838a50', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:53:05 devstack sudo[90637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-07a05b49-8f10-4db3-8fa2-9393f6754174 1073741824
Apr 09 12:53:05 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-869dcc08-84df-40f3-801a-b982489ddcdb tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26e78903-a375-4f7b-b892-95327df74555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:53:05 devstack sudo[90637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:05 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-869dcc08-84df-40f3-801a-b982489ddcdb tempest-CreateVolumesFromSnapshotTest-828104883 None] Volume volume-023c12c4-c80f-4c23-9f62-9791d8838a50 (023c12c4-c80f-4c23-9f62-9791d8838a50): created successfully
Apr 09 12:53:05 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-869dcc08-84df-40f3-801a-b982489ddcdb tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26e78903-a375-4f7b-b892-95327df74555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:53:05 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-869dcc08-84df-40f3-801a-b982489ddcdb tempest-CreateVolumesFromSnapshotTest-828104883 None] Flow 'volume_create_manager' (c5ff017b-f5e4-458f-ac39-84472ef63800) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:53:05 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-869dcc08-84df-40f3-801a-b982489ddcdb tempest-CreateVolumesFromSnapshotTest-828104883 None] Created volume successfully.
Apr 09 12:53:05 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-55ca8c3c-167f-4249-aaf2-da350b2ad260 tempest-SnapshotDependencyTests-1880031669 None] Acquiring lock "cinder-5dcef0fe-f172-4c8d-b611-bb21edb84c15-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:53:05 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-55ca8c3c-167f-4249-aaf2-da350b2ad260 tempest-SnapshotDependencyTests-1880031669 None] Lock "cinder-5dcef0fe-f172-4c8d-b611-bb21edb84c15-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:53:05 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-55ca8c3c-167f-4249-aaf2-da350b2ad260 tempest-SnapshotDependencyTests-1880031669 None] Acquiring lock "cinder-quobyte-5dcef0fe-f172-4c8d-b611-bb21edb84c15" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:53:05 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-55ca8c3c-167f-4249-aaf2-da350b2ad260 tempest-SnapshotDependencyTests-1880031669 None] Lock "cinder-quobyte-5dcef0fe-f172-4c8d-b611-bb21edb84c15" acquired by "delete_volume" :: waited 0.011s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:53:05 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a01fd2-fe48-4963-b12b-43914b346485]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:53:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-55ca8c3c-167f-4249-aaf2-da350b2ad260 tempest-SnapshotDependencyTests-1880031669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:05 devstack sudo[90642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15
Apr 09 12:53:05 devstack sudo[90642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:05 devstack sudo[90637]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-8f053763-d72b-414c-9638-ea26f5db09e7 tempest-CreateVolumesFromSnapshotTest-828104883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-07a05b49-8f10-4db3-8fa2-9393f6754174 1073741824" returned: 0 in 0.569s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:05 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-8f053763-d72b-414c-9638-ea26f5db09e7 tempest-CreateVolumesFromSnapshotTest-828104883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-07a05b49-8f10-4db3-8fa2-9393f6754174 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:05 devstack sudo[90644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-07a05b49-8f10-4db3-8fa2-9393f6754174
Apr 09 12:53:05 devstack sudo[90644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:06 devstack sudo[90642]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:06 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-55ca8c3c-167f-4249-aaf2-da350b2ad260 tempest-SnapshotDependencyTests-1880031669 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15" returned: 0 in 0.538s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:06 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-55ca8c3c-167f-4249-aaf2-da350b2ad260 tempest-SnapshotDependencyTests-1880031669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:06 devstack sudo[90649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15
Apr 09 12:53:06 devstack sudo[90649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:06 devstack sudo[90644]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:06 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-8f053763-d72b-414c-9638-ea26f5db09e7 tempest-CreateVolumesFromSnapshotTest-828104883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-07a05b49-8f10-4db3-8fa2-9393f6754174" returned: 0 in 0.573s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:06 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-8f053763-d72b-414c-9638-ea26f5db09e7 tempest-CreateVolumesFromSnapshotTest-828104883 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:53:06 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-8f053763-d72b-414c-9638-ea26f5db09e7 tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:53:06 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-de2d8841-e215-4a04-acc1-870c56465799 tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.193s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:53:06 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-de2d8841-e215-4a04-acc1-870c56465799 tempest-CreateVolumesFromSnapshotTest-828104883 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:52:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-454653739',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bd73a10-3482-474f-afdd-a557b84948ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b444a78f57b4e92819c661a31e3eb24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:52:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:52:56Z,use_quota=True,user_id='82524731e1384a9fa5a94656d03e1874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:53:06 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-de2d8841-e215-4a04-acc1-870c56465799 tempest-CreateVolumesFromSnapshotTest-828104883 None] Creating volume 4bd73a10-3482-474f-afdd-a557b84948ef {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:53:06 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-de2d8841-e215-4a04-acc1-870c56465799 tempest-CreateVolumesFromSnapshotTest-828104883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:53:06 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-de2d8841-e215-4a04-acc1-870c56465799 tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:53:06 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-de2d8841-e215-4a04-acc1-870c56465799 tempest-CreateVolumesFromSnapshotTest-828104883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:53:06 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-de2d8841-e215-4a04-acc1-870c56465799 tempest-CreateVolumesFromSnapshotTest-828104883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:53:06 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-de2d8841-e215-4a04-acc1-870c56465799 tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:53:06 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-de2d8841-e215-4a04-acc1-870c56465799 tempest-CreateVolumesFromSnapshotTest-828104883 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:53:06 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-de2d8841-e215-4a04-acc1-870c56465799 tempest-CreateVolumesFromSnapshotTest-828104883 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:53:06 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-de2d8841-e215-4a04-acc1-870c56465799 tempest-CreateVolumesFromSnapshotTest-828104883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-4bd73a10-3482-474f-afdd-a557b84948ef 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:06 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8f053763-d72b-414c-9638-ea26f5db09e7 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a83ece97-f876-4336-8f69-a9c54b7a9d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07a05b49-8f10-4db3-8fa2-9393f6754174', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:53:06 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8f053763-d72b-414c-9638-ea26f5db09e7 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5305686f-6b4b-428d-b83e-46ec455b2cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:53:06 devstack sudo[90652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-4bd73a10-3482-474f-afdd-a557b84948ef 1073741824
Apr 09 12:53:06 devstack sudo[90652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:06 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-8f053763-d72b-414c-9638-ea26f5db09e7 tempest-CreateVolumesFromSnapshotTest-828104883 None] Volume volume-07a05b49-8f10-4db3-8fa2-9393f6754174 (07a05b49-8f10-4db3-8fa2-9393f6754174): created successfully
Apr 09 12:53:06 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8f053763-d72b-414c-9638-ea26f5db09e7 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5305686f-6b4b-428d-b83e-46ec455b2cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:53:06 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-8f053763-d72b-414c-9638-ea26f5db09e7 tempest-CreateVolumesFromSnapshotTest-828104883 None] Flow 'volume_create_manager' (6d7d4f89-ab3e-40ae-9a55-0e50feb32bd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:53:06 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-8f053763-d72b-414c-9638-ea26f5db09e7 tempest-CreateVolumesFromSnapshotTest-828104883 None] Created volume successfully.
Apr 09 12:53:06 devstack sudo[90649]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:06 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-55ca8c3c-167f-4249-aaf2-da350b2ad260 tempest-SnapshotDependencyTests-1880031669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-5dcef0fe-f172-4c8d-b611-bb21edb84c15" returned: 0 in 0.470s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:06 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-55ca8c3c-167f-4249-aaf2-da350b2ad260 tempest-SnapshotDependencyTests-1880031669 None] Lock "cinder-quobyte-5dcef0fe-f172-4c8d-b611-bb21edb84c15" released by "delete_volume" :: held 1.045s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:53:06 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-55ca8c3c-167f-4249-aaf2-da350b2ad260 tempest-SnapshotDependencyTests-1880031669 None] Created reservations ['c6a89912-f8c0-4762-bbe8-3c3311e3e969', 'cd7a8164-50af-4c7c-96d3-dab6d6d56be1', '96140d7e-ae67-4370-946d-356da6ea279e', '5af99445-b493-433f-b4b7-f8c628c17454'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:53:06 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-55ca8c3c-167f-4249-aaf2-da350b2ad260 tempest-SnapshotDependencyTests-1880031669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:53:06 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-55ca8c3c-167f-4249-aaf2-da350b2ad260 tempest-SnapshotDependencyTests-1880031669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:53:06 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-55ca8c3c-167f-4249-aaf2-da350b2ad260 tempest-SnapshotDependencyTests-1880031669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:53:06 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-55ca8c3c-167f-4249-aaf2-da350b2ad260 tempest-SnapshotDependencyTests-1880031669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:53:06 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-55ca8c3c-167f-4249-aaf2-da350b2ad260 tempest-SnapshotDependencyTests-1880031669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:53:06 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-55ca8c3c-167f-4249-aaf2-da350b2ad260 tempest-SnapshotDependencyTests-1880031669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:06 devstack sudo[90657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:53:06 devstack sudo[90657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:07 devstack sudo[90652]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:07 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-de2d8841-e215-4a04-acc1-870c56465799 tempest-CreateVolumesFromSnapshotTest-828104883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-4bd73a10-3482-474f-afdd-a557b84948ef 1073741824" returned: 0 in 0.600s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:07 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-de2d8841-e215-4a04-acc1-870c56465799 tempest-CreateVolumesFromSnapshotTest-828104883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-4bd73a10-3482-474f-afdd-a557b84948ef {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:07 devstack sudo[90660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-4bd73a10-3482-474f-afdd-a557b84948ef
Apr 09 12:53:07 devstack sudo[90660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:07 devstack sudo[90657]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:07 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-55ca8c3c-167f-4249-aaf2-da350b2ad260 tempest-SnapshotDependencyTests-1880031669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.510s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:07 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-55ca8c3c-167f-4249-aaf2-da350b2ad260 tempest-SnapshotDependencyTests-1880031669 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:53:07 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-55ca8c3c-167f-4249-aaf2-da350b2ad260 tempest-SnapshotDependencyTests-1880031669 None] Deleted volume successfully.
Apr 09 12:53:07 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-55ca8c3c-167f-4249-aaf2-da350b2ad260 tempest-SnapshotDependencyTests-1880031669 None] Lock "cinder-5dcef0fe-f172-4c8d-b611-bb21edb84c15-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:53:07 devstack sudo[90660]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:07 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-de2d8841-e215-4a04-acc1-870c56465799 tempest-CreateVolumesFromSnapshotTest-828104883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-4bd73a10-3482-474f-afdd-a557b84948ef" returned: 0 in 0.458s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:07 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-de2d8841-e215-4a04-acc1-870c56465799 tempest-CreateVolumesFromSnapshotTest-828104883 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:53:07 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-de2d8841-e215-4a04-acc1-870c56465799 tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:53:07 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-cc73d936-e09e-4598-ac22-398885469896 tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.043s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:53:07 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-cc73d936-e09e-4598-ac22-398885469896 tempest-CreateVolumesFromSnapshotTest-828104883 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:52:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1383840476',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d530f96d-9752-4c86-952e-89ff32692ec9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b444a78f57b4e92819c661a31e3eb24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:52:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:52:56Z,use_quota=True,user_id='82524731e1384a9fa5a94656d03e1874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:53:07 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-cc73d936-e09e-4598-ac22-398885469896 tempest-CreateVolumesFromSnapshotTest-828104883 None] Creating volume d530f96d-9752-4c86-952e-89ff32692ec9 {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:53:07 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-cc73d936-e09e-4598-ac22-398885469896 tempest-CreateVolumesFromSnapshotTest-828104883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:53:07 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-cc73d936-e09e-4598-ac22-398885469896 tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:53:07 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-cc73d936-e09e-4598-ac22-398885469896 tempest-CreateVolumesFromSnapshotTest-828104883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:53:07 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-cc73d936-e09e-4598-ac22-398885469896 tempest-CreateVolumesFromSnapshotTest-828104883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:53:07 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-cc73d936-e09e-4598-ac22-398885469896 tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:53:07 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-cc73d936-e09e-4598-ac22-398885469896 tempest-CreateVolumesFromSnapshotTest-828104883 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:53:07 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-cc73d936-e09e-4598-ac22-398885469896 tempest-CreateVolumesFromSnapshotTest-828104883 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:53:07 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-cc73d936-e09e-4598-ac22-398885469896 tempest-CreateVolumesFromSnapshotTest-828104883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d530f96d-9752-4c86-952e-89ff32692ec9 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:07 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-de2d8841-e215-4a04-acc1-870c56465799 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3d12b1d-fc96-4c11-844b-928b37353b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bd73a10-3482-474f-afdd-a557b84948ef', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:53:07 devstack sudo[90664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d530f96d-9752-4c86-952e-89ff32692ec9 1073741824
Apr 09 12:53:07 devstack sudo[90664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:07 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-de2d8841-e215-4a04-acc1-870c56465799 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b40e550-431f-49a1-8cf5-871b1840a600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:53:07 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-de2d8841-e215-4a04-acc1-870c56465799 tempest-CreateVolumesFromSnapshotTest-828104883 None] Volume volume-4bd73a10-3482-474f-afdd-a557b84948ef (4bd73a10-3482-474f-afdd-a557b84948ef): created successfully
Apr 09 12:53:07 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-de2d8841-e215-4a04-acc1-870c56465799 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b40e550-431f-49a1-8cf5-871b1840a600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:53:07 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-de2d8841-e215-4a04-acc1-870c56465799 tempest-CreateVolumesFromSnapshotTest-828104883 None] Flow 'volume_create_manager' (cf15af6d-92d1-4d08-8429-285031428919) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:53:07 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-de2d8841-e215-4a04-acc1-870c56465799 tempest-CreateVolumesFromSnapshotTest-828104883 None] Created volume successfully.
Apr 09 12:53:07 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-1e064a59-8520-4f28-a18e-3e64f56545d4 tempest-SnapshotDependencyTests-1880031669 None] Acquiring lock "cinder-d496d9df-1b85-49e3-9ce1-ab5b3100f504-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:53:07 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-1e064a59-8520-4f28-a18e-3e64f56545d4 tempest-SnapshotDependencyTests-1880031669 None] Lock "cinder-d496d9df-1b85-49e3-9ce1-ab5b3100f504-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:53:07 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-1e064a59-8520-4f28-a18e-3e64f56545d4 tempest-SnapshotDependencyTests-1880031669 None] Acquiring lock "cinder-quobyte-d496d9df-1b85-49e3-9ce1-ab5b3100f504" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:53:07 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-1e064a59-8520-4f28-a18e-3e64f56545d4 tempest-SnapshotDependencyTests-1880031669 None] Lock "cinder-quobyte-d496d9df-1b85-49e3-9ce1-ab5b3100f504" acquired by "delete_volume" :: waited 0.010s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:53:07 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c33d4b3-d84d-494f-b43a-eaa3eaf06d54]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:53:07 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-1e064a59-8520-4f28-a18e-3e64f56545d4 tempest-SnapshotDependencyTests-1880031669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d496d9df-1b85-49e3-9ce1-ab5b3100f504 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:08 devstack sudo[90669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d496d9df-1b85-49e3-9ce1-ab5b3100f504
Apr 09 12:53:08 devstack sudo[90669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:08 devstack sudo[90664]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-cc73d936-e09e-4598-ac22-398885469896 tempest-CreateVolumesFromSnapshotTest-828104883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d530f96d-9752-4c86-952e-89ff32692ec9 1073741824" returned: 0 in 0.581s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-cc73d936-e09e-4598-ac22-398885469896 tempest-CreateVolumesFromSnapshotTest-828104883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d530f96d-9752-4c86-952e-89ff32692ec9 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:08 devstack sudo[90671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d530f96d-9752-4c86-952e-89ff32692ec9
Apr 09 12:53:08 devstack sudo[90671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:08 devstack sudo[90669]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-1e064a59-8520-4f28-a18e-3e64f56545d4 tempest-SnapshotDependencyTests-1880031669 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d496d9df-1b85-49e3-9ce1-ab5b3100f504" returned: 0 in 0.578s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-1e064a59-8520-4f28-a18e-3e64f56545d4 tempest-SnapshotDependencyTests-1880031669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d496d9df-1b85-49e3-9ce1-ab5b3100f504 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:08 devstack sudo[90677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d496d9df-1b85-49e3-9ce1-ab5b3100f504
Apr 09 12:53:08 devstack sudo[90677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:08 devstack sudo[90671]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-cc73d936-e09e-4598-ac22-398885469896 tempest-CreateVolumesFromSnapshotTest-828104883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d530f96d-9752-4c86-952e-89ff32692ec9" returned: 0 in 0.450s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:08 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-cc73d936-e09e-4598-ac22-398885469896 tempest-CreateVolumesFromSnapshotTest-828104883 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:53:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-cc73d936-e09e-4598-ac22-398885469896 tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:53:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-7ef606c9-5814-4ca2-ab01-a6e675631536 tempest-CinderUnicodeTest-1468521471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.304s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:53:08 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-7ef606c9-5814-4ca2-ab01-a6e675631536 tempest-CinderUnicodeTest-1468521471 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f378e688bb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-09T10:52:57Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-699555144',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77cee92a-e8a4-4c97-98ac-ae40d42d131c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa15b7f776a549d4b5f763ee7bcba2d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T10:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T10:52:57Z,use_quota=True,user_id='e9009c5a86974ff6af9314b0696e26c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd),volume_type_id=7d9fbcac-ea6e-40ef-8d25-44cc6f7388dd)}" {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 09 12:53:08 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-7ef606c9-5814-4ca2-ab01-a6e675631536 tempest-CinderUnicodeTest-1468521471 None] Creating volume 77cee92a-e8a4-4c97-98ac-ae40d42d131c {{(pid=82760) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 09 12:53:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-7ef606c9-5814-4ca2-ab01-a6e675631536 tempest-CinderUnicodeTest-1468521471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:53:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-7ef606c9-5814-4ca2-ab01-a6e675631536 tempest-CinderUnicodeTest-1468521471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:53:08 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-7ef606c9-5814-4ca2-ab01-a6e675631536 tempest-CinderUnicodeTest-1468521471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:53:08 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-7ef606c9-5814-4ca2-ab01-a6e675631536 tempest-CinderUnicodeTest-1468521471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:53:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-7ef606c9-5814-4ca2-ab01-a6e675631536 tempest-CinderUnicodeTest-1468521471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:53:08 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-7ef606c9-5814-4ca2-ab01-a6e675631536 tempest-CinderUnicodeTest-1468521471 None] Selected osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5 as target Quobyte volume. {{(pid=82760) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 09 12:53:08 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-7ef606c9-5814-4ca2-ab01-a6e675631536 tempest-CinderUnicodeTest-1468521471 None] casted to osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5
Apr 09 12:53:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-7ef606c9-5814-4ca2-ab01-a6e675631536 tempest-CinderUnicodeTest-1468521471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-77cee92a-e8a4-4c97-98ac-ae40d42d131c 1073741824 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:08 devstack sudo[90679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-77cee92a-e8a4-4c97-98ac-ae40d42d131c 1073741824
Apr 09 12:53:08 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-cc73d936-e09e-4598-ac22-398885469896 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b8eae31-2bc0-410a-a553-7bea5db3807f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d530f96d-9752-4c86-952e-89ff32692ec9', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:53:08 devstack sudo[90679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:08 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-cc73d936-e09e-4598-ac22-398885469896 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49bc3b37-121f-4dce-bcb5-601f32dad67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:53:08 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-cc73d936-e09e-4598-ac22-398885469896 tempest-CreateVolumesFromSnapshotTest-828104883 None] Volume volume-d530f96d-9752-4c86-952e-89ff32692ec9 (d530f96d-9752-4c86-952e-89ff32692ec9): created successfully
Apr 09 12:53:08 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-cc73d936-e09e-4598-ac22-398885469896 tempest-CreateVolumesFromSnapshotTest-828104883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49bc3b37-121f-4dce-bcb5-601f32dad67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:53:08 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-cc73d936-e09e-4598-ac22-398885469896 tempest-CreateVolumesFromSnapshotTest-828104883 None] Flow 'volume_create_manager' (029f6237-7aad-4537-8a98-429c80079c0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:53:08 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-cc73d936-e09e-4598-ac22-398885469896 tempest-CreateVolumesFromSnapshotTest-828104883 None] Created volume successfully.
Apr 09 12:53:08 devstack sudo[90677]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:08 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-1e064a59-8520-4f28-a18e-3e64f56545d4 tempest-SnapshotDependencyTests-1880031669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d496d9df-1b85-49e3-9ce1-ab5b3100f504" returned: 0 in 0.463s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:08 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-1e064a59-8520-4f28-a18e-3e64f56545d4 tempest-SnapshotDependencyTests-1880031669 None] Lock "cinder-quobyte-d496d9df-1b85-49e3-9ce1-ab5b3100f504" released by "delete_volume" :: held 1.071s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:53:09 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-1e064a59-8520-4f28-a18e-3e64f56545d4 tempest-SnapshotDependencyTests-1880031669 None] Created reservations ['ebf36255-8fa7-42ce-a874-53bd7bdc857d', '6a125a2e-aa13-4815-978b-2059f126191c', '41d57f5f-8f95-476a-a194-b2a21908d560', '8f197ef0-00c7-4c83-a72d-85094d980ee6'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:53:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-1e064a59-8520-4f28-a18e-3e64f56545d4 tempest-SnapshotDependencyTests-1880031669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:53:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-1e064a59-8520-4f28-a18e-3e64f56545d4 tempest-SnapshotDependencyTests-1880031669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:53:09 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-1e064a59-8520-4f28-a18e-3e64f56545d4 tempest-SnapshotDependencyTests-1880031669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:53:09 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-1e064a59-8520-4f28-a18e-3e64f56545d4 tempest-SnapshotDependencyTests-1880031669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:53:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-1e064a59-8520-4f28-a18e-3e64f56545d4 tempest-SnapshotDependencyTests-1880031669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:53:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-1e064a59-8520-4f28-a18e-3e64f56545d4 tempest-SnapshotDependencyTests-1880031669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:09 devstack sudo[90685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:53:09 devstack sudo[90685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:09 devstack sudo[90679]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-7ef606c9-5814-4ca2-ab01-a6e675631536 tempest-CinderUnicodeTest-1468521471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-77cee92a-e8a4-4c97-98ac-ae40d42d131c 1073741824" returned: 0 in 0.629s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-7ef606c9-5814-4ca2-ab01-a6e675631536 tempest-CinderUnicodeTest-1468521471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-77cee92a-e8a4-4c97-98ac-ae40d42d131c {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:09 devstack sudo[90687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-77cee92a-e8a4-4c97-98ac-ae40d42d131c
Apr 09 12:53:09 devstack sudo[90687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:09 devstack cinder-volume[82760]: DEBUG oslo_service.periodic_task [None req-f8337202-8290-4658-916e-19cfa929172e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82760) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 09 12:53:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f8337202-8290-4658-916e-19cfa929172e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:53:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f8337202-8290-4658-916e-19cfa929172e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:53:09 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f8337202-8290-4658-916e-19cfa929172e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:53:09 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-f8337202-8290-4658-916e-19cfa929172e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:53:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-f8337202-8290-4658-916e-19cfa929172e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:53:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f8337202-8290-4658-916e-19cfa929172e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:09 devstack sudo[90689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:53:09 devstack sudo[90689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:09 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-990816d2-1eeb-45ea-bc12-ecf8a9ee7125 tempest-CreateVolumesFromSnapshotTest-828104883 None] Acquiring lock "cinder-d530f96d-9752-4c86-952e-89ff32692ec9-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:53:09 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-990816d2-1eeb-45ea-bc12-ecf8a9ee7125 tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "cinder-d530f96d-9752-4c86-952e-89ff32692ec9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:53:09 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-990816d2-1eeb-45ea-bc12-ecf8a9ee7125 tempest-CreateVolumesFromSnapshotTest-828104883 None] Acquiring lock "cinder-quobyte-d530f96d-9752-4c86-952e-89ff32692ec9" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:53:09 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-990816d2-1eeb-45ea-bc12-ecf8a9ee7125 tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "cinder-quobyte-d530f96d-9752-4c86-952e-89ff32692ec9" acquired by "delete_volume" :: waited 0.011s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:53:09 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[56fe5e70-74f8-4f88-8721-750ec97a6a9a]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:53:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-990816d2-1eeb-45ea-bc12-ecf8a9ee7125 tempest-CreateVolumesFromSnapshotTest-828104883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d530f96d-9752-4c86-952e-89ff32692ec9 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:09 devstack sudo[90685]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-1e064a59-8520-4f28-a18e-3e64f56545d4 tempest-SnapshotDependencyTests-1880031669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.544s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:09 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-1e064a59-8520-4f28-a18e-3e64f56545d4 tempest-SnapshotDependencyTests-1880031669 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:53:09 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-1e064a59-8520-4f28-a18e-3e64f56545d4 tempest-SnapshotDependencyTests-1880031669 None] Deleted volume successfully.
Apr 09 12:53:09 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-1e064a59-8520-4f28-a18e-3e64f56545d4 tempest-SnapshotDependencyTests-1880031669 None] Lock "cinder-d496d9df-1b85-49e3-9ce1-ab5b3100f504-delete_volume" released by "delete_volume" :: held 1.772s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:53:09 devstack sudo[90692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d530f96d-9752-4c86-952e-89ff32692ec9
Apr 09 12:53:09 devstack sudo[90692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:09 devstack sudo[90687]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-7ef606c9-5814-4ca2-ab01-a6e675631536 tempest-CinderUnicodeTest-1468521471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-77cee92a-e8a4-4c97-98ac-ae40d42d131c" returned: 0 in 0.518s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:09 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-7ef606c9-5814-4ca2-ab01-a6e675631536 tempest-CinderUnicodeTest-1468521471 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'} {{(pid=82760) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 09 12:53:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-7ef606c9-5814-4ca2-ab01-a6e675631536 tempest-CinderUnicodeTest-1468521471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:53:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 5.757s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:53:09 devstack cinder-volume[82760]: INFO cinder.volume.drivers.remotefs [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] Cloning volume 3729eba7-0002-43e3-9a8d-d8672d4a44c5 to volume a3db62cd-7895-4d0b-9e77-858c9b187848
Apr 09 12:53:09 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-7ef606c9-5814-4ca2-ab01-a6e675631536 tempest-CinderUnicodeTest-1468521471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1d2447c-4b79-42bf-b633-60b65e2bc6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77cee92a-e8a4-4c97-98ac-ae40d42d131c', 'volume_size': 1}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:53:09 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-7ef606c9-5814-4ca2-ab01-a6e675631536 tempest-CinderUnicodeTest-1468521471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99c8e2d8-064a-44f5-b40a-66f01111dfed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:53:09 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-7ef606c9-5814-4ca2-ab01-a6e675631536 tempest-CinderUnicodeTest-1468521471 None] Volume volume-77cee92a-e8a4-4c97-98ac-ae40d42d131c (77cee92a-e8a4-4c97-98ac-ae40d42d131c): created successfully
Apr 09 12:53:09 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-7ef606c9-5814-4ca2-ab01-a6e675631536 tempest-CinderUnicodeTest-1468521471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99c8e2d8-064a-44f5-b40a-66f01111dfed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:53:09 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-7ef606c9-5814-4ca2-ab01-a6e675631536 tempest-CinderUnicodeTest-1468521471 None] Flow 'volume_create_manager' (058a36ca-9d46-437a-b696-450c3588fdd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:53:09 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] Creating offline snapshot 1c703f93-93d5-4527-b41c-3bc0afe70900 of volume 3729eba7-0002-43e3-9a8d-d8672d4a44c5 {{(pid=82760) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 12:53:09 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[4070bf47-4b81-4e49-bf90-b2975615c843]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:53:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:09 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-7ef606c9-5814-4ca2-ab01-a6e675631536 tempest-CinderUnicodeTest-1468521471 None] Created volume successfully.
Apr 09 12:53:09 devstack sudo[90689]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:09 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-f8337202-8290-4658-916e-19cfa929172e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.487s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:09 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-f8337202-8290-4658-916e-19cfa929172e None None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:53:09 devstack sudo[90696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5
Apr 09 12:53:09 devstack sudo[90696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:10 devstack sudo[90692]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-990816d2-1eeb-45ea-bc12-ecf8a9ee7125 tempest-CreateVolumesFromSnapshotTest-828104883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d530f96d-9752-4c86-952e-89ff32692ec9" returned: 0 in 0.637s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-990816d2-1eeb-45ea-bc12-ecf8a9ee7125 tempest-CreateVolumesFromSnapshotTest-828104883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d530f96d-9752-4c86-952e-89ff32692ec9 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:10 devstack sudo[90701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d530f96d-9752-4c86-952e-89ff32692ec9
Apr 09 12:53:10 devstack sudo[90701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ca87c037-3bef-4825-a00b-b5f014b2bfe7 tempest-CinderUnicodeTest-1468521471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:53:10 devstack sudo[90696]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5" returned: 0 in 0.697s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5.1c703f93-93d5-4527-b41c-3bc0afe70900 1G {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:10 devstack sudo[90706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5.1c703f93-93d5-4527-b41c-3bc0afe70900 1G
Apr 09 12:53:10 devstack sudo[90706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:10 devstack sudo[90701]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-990816d2-1eeb-45ea-bc12-ecf8a9ee7125 tempest-CreateVolumesFromSnapshotTest-828104883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-d530f96d-9752-4c86-952e-89ff32692ec9" returned: 0 in 0.603s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:10 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-990816d2-1eeb-45ea-bc12-ecf8a9ee7125 tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "cinder-quobyte-d530f96d-9752-4c86-952e-89ff32692ec9" released by "delete_volume" :: held 1.268s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:53:10 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-990816d2-1eeb-45ea-bc12-ecf8a9ee7125 tempest-CreateVolumesFromSnapshotTest-828104883 None] Created reservations ['f0951219-8b02-4343-9619-bb575e9ad053', '067882f8-87c9-4429-831b-8c862d22c5e6', 'b2bdab33-a895-4b0d-9aa7-c219f5bc5f28', '13cc92ce-bf0b-415d-b6cb-80d6817af93d'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:53:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-990816d2-1eeb-45ea-bc12-ecf8a9ee7125 tempest-CreateVolumesFromSnapshotTest-828104883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:53:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-990816d2-1eeb-45ea-bc12-ecf8a9ee7125 tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:53:10 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-990816d2-1eeb-45ea-bc12-ecf8a9ee7125 tempest-CreateVolumesFromSnapshotTest-828104883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:53:10 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-990816d2-1eeb-45ea-bc12-ecf8a9ee7125 tempest-CreateVolumesFromSnapshotTest-828104883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:53:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-990816d2-1eeb-45ea-bc12-ecf8a9ee7125 tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:53:10 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-990816d2-1eeb-45ea-bc12-ecf8a9ee7125 tempest-CreateVolumesFromSnapshotTest-828104883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:10 devstack sudo[90710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:53:10 devstack sudo[90710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:11 devstack sudo[90706]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:11 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5.1c703f93-93d5-4527-b41c-3bc0afe70900 1G" returned: 0 in 0.664s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:11 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5.1c703f93-93d5-4527-b41c-3bc0afe70900 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:11 devstack sudo[90715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5.1c703f93-93d5-4527-b41c-3bc0afe70900
Apr 09 12:53:11 devstack sudo[90715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:11 devstack sudo[90710]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:11 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-990816d2-1eeb-45ea-bc12-ecf8a9ee7125 tempest-CreateVolumesFromSnapshotTest-828104883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.500s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:11 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-990816d2-1eeb-45ea-bc12-ecf8a9ee7125 tempest-CreateVolumesFromSnapshotTest-828104883 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:53:11 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-990816d2-1eeb-45ea-bc12-ecf8a9ee7125 tempest-CreateVolumesFromSnapshotTest-828104883 None] Deleted volume successfully.
Apr 09 12:53:11 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-990816d2-1eeb-45ea-bc12-ecf8a9ee7125 tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "cinder-d530f96d-9752-4c86-952e-89ff32692ec9-delete_volume" released by "delete_volume" :: held 1.995s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:53:11 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-b8a1573a-1210-448b-82cd-69f58eaf2562 tempest-CreateVolumesFromSnapshotTest-828104883 None] Acquiring lock "cinder-4bd73a10-3482-474f-afdd-a557b84948ef-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:53:11 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-b8a1573a-1210-448b-82cd-69f58eaf2562 tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "cinder-4bd73a10-3482-474f-afdd-a557b84948ef-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:53:11 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-b8a1573a-1210-448b-82cd-69f58eaf2562 tempest-CreateVolumesFromSnapshotTest-828104883 None] Acquiring lock "cinder-quobyte-4bd73a10-3482-474f-afdd-a557b84948ef" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:53:11 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-b8a1573a-1210-448b-82cd-69f58eaf2562 tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "cinder-quobyte-4bd73a10-3482-474f-afdd-a557b84948ef" acquired by "delete_volume" :: waited 0.013s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:53:11 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd6032b-a505-4b3d-b611-3bbc6a85423d]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:53:11 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b8a1573a-1210-448b-82cd-69f58eaf2562 tempest-CreateVolumesFromSnapshotTest-828104883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-4bd73a10-3482-474f-afdd-a557b84948ef {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:11 devstack sudo[90715]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:11 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5 -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5.1c703f93-93d5-4527-b41c-3bc0afe70900" returned: 0 in 0.584s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:11 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5.1c703f93-93d5-4527-b41c-3bc0afe70900 is being set with open permissions: ugo+rw
Apr 09 12:53:11 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5.1c703f93-93d5-4527-b41c-3bc0afe70900 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:11 devstack sudo[90724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5.1c703f93-93d5-4527-b41c-3bc0afe70900
Apr 09 12:53:11 devstack sudo[90724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:11 devstack sudo[90723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-4bd73a10-3482-474f-afdd-a557b84948ef
Apr 09 12:53:11 devstack sudo[90723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:12 devstack sudo[90724]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:12 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5.1c703f93-93d5-4527-b41c-3bc0afe70900" returned: 0 in 0.495s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:12 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:12 devstack sudo[90731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5.info
Apr 09 12:53:12 devstack sudo[90731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:12 devstack sudo[90723]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:12 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b8a1573a-1210-448b-82cd-69f58eaf2562 tempest-CreateVolumesFromSnapshotTest-828104883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-4bd73a10-3482-474f-afdd-a557b84948ef" returned: 0 in 0.574s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:12 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b8a1573a-1210-448b-82cd-69f58eaf2562 tempest-CreateVolumesFromSnapshotTest-828104883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-4bd73a10-3482-474f-afdd-a557b84948ef {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:12 devstack sudo[90733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-4bd73a10-3482-474f-afdd-a557b84948ef
Apr 09 12:53:12 devstack sudo[90733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:12 devstack sudo[90733]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:12 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b8a1573a-1210-448b-82cd-69f58eaf2562 tempest-CreateVolumesFromSnapshotTest-828104883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-4bd73a10-3482-474f-afdd-a557b84948ef" returned: 0 in 0.497s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:12 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-b8a1573a-1210-448b-82cd-69f58eaf2562 tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "cinder-quobyte-4bd73a10-3482-474f-afdd-a557b84948ef" released by "delete_volume" :: held 1.110s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:53:12 devstack cinder-volume[82760]: DEBUG dbcounter [-] [82760] Writing DB stats cinder:SELECT=154,cinder:UPDATE=189,cinder:DELETE=22,cinder:INSERT=43 {{(pid=82760) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 12:53:12 devstack sudo[90731]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:12 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5.info" returned: 0 in 0.584s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:12 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5.info is being set with open permissions: ugo+rw
Apr 09 12:53:12 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:12 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-b8a1573a-1210-448b-82cd-69f58eaf2562 tempest-CreateVolumesFromSnapshotTest-828104883 None] Created reservations ['a9bbca93-833e-4e44-8e7e-04baca2a57e2', '61590c7d-0c92-4963-89d1-acc80b180e5b', '5db519e5-84ff-470a-868c-2aa9c7bb6510', '586ae921-92a0-49f4-b274-8f18f1e85661'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:53:12 devstack sudo[90738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5.info
Apr 09 12:53:12 devstack sudo[90738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:12 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b8a1573a-1210-448b-82cd-69f58eaf2562 tempest-CreateVolumesFromSnapshotTest-828104883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:53:12 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b8a1573a-1210-448b-82cd-69f58eaf2562 tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:53:12 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-b8a1573a-1210-448b-82cd-69f58eaf2562 tempest-CreateVolumesFromSnapshotTest-828104883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:53:12 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-b8a1573a-1210-448b-82cd-69f58eaf2562 tempest-CreateVolumesFromSnapshotTest-828104883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:53:12 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-b8a1573a-1210-448b-82cd-69f58eaf2562 tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:53:12 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b8a1573a-1210-448b-82cd-69f58eaf2562 tempest-CreateVolumesFromSnapshotTest-828104883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:13 devstack sudo[90740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:53:13 devstack sudo[90740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:13 devstack sudo[90738]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:13 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5.info" returned: 0 in 0.513s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:13 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] Acquiring lock "cinder-quobyte-a3db62cd-7895-4d0b-9e77-858c9b187848" by "_copy_volume_from_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:53:13 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] Lock "cinder-quobyte-a3db62cd-7895-4d0b-9e77-858c9b187848" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:53:13 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] snapshot: 1c703f93-93d5-4527-b41c-3bc0afe70900, volume: a3db62cd-7895-4d0b-9e77-858c9b187848,  {{(pid=82760) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 09 12:53:13 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:53:13 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:53:13 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:53:13 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:53:13 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:53:13 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcfe991c-ef84-4610-a4d6-61457a11d831]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:53:13 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5.1c703f93-93d5-4527-b41c-3bc0afe70900 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:13 devstack sudo[90744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5.1c703f93-93d5-4527-b41c-3bc0afe70900
Apr 09 12:53:13 devstack sudo[90744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:13 devstack sudo[90740]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:13 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-b8a1573a-1210-448b-82cd-69f58eaf2562 tempest-CreateVolumesFromSnapshotTest-828104883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.623s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:13 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-b8a1573a-1210-448b-82cd-69f58eaf2562 tempest-CreateVolumesFromSnapshotTest-828104883 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:53:13 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-b8a1573a-1210-448b-82cd-69f58eaf2562 tempest-CreateVolumesFromSnapshotTest-828104883 None] Deleted volume successfully.
Apr 09 12:53:13 devstack cinder-volume[82760]: DEBUG dbcounter [-] [82760] Writing DB stats cinder:UPDATE=234,cinder:SELECT=155,cinder:INSERT=55,cinder:DELETE=21 {{(pid=82760) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 12:53:13 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-b8a1573a-1210-448b-82cd-69f58eaf2562 tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "cinder-4bd73a10-3482-474f-afdd-a557b84948ef-delete_volume" released by "delete_volume" :: held 1.943s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:53:13 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-83af23aa-28d2-4f5b-9de8-598f79331181 tempest-CreateVolumesFromSnapshotTest-828104883 None] Acquiring lock "cinder-07a05b49-8f10-4db3-8fa2-9393f6754174-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:53:13 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-83af23aa-28d2-4f5b-9de8-598f79331181 tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "cinder-07a05b49-8f10-4db3-8fa2-9393f6754174-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:53:14 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-83af23aa-28d2-4f5b-9de8-598f79331181 tempest-CreateVolumesFromSnapshotTest-828104883 None] Acquiring lock "cinder-quobyte-07a05b49-8f10-4db3-8fa2-9393f6754174" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:53:14 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-83af23aa-28d2-4f5b-9de8-598f79331181 tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "cinder-quobyte-07a05b49-8f10-4db3-8fa2-9393f6754174" acquired by "delete_volume" :: waited 0.011s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:53:14 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4447c5-1d97-4acc-b039-975b9db4005b]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:53:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-83af23aa-28d2-4f5b-9de8-598f79331181 tempest-CreateVolumesFromSnapshotTest-828104883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-07a05b49-8f10-4db3-8fa2-9393f6754174 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:14 devstack sudo[90747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-07a05b49-8f10-4db3-8fa2-9393f6754174
Apr 09 12:53:14 devstack sudo[90747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:14 devstack sudo[90744]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5.1c703f93-93d5-4527-b41c-3bc0afe70900" returned: 0 in 0.770s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:14 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:53:14 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5 {{(pid=82760) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 09 12:53:14 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] Creating direct copy from snapshot {{(pid=82760) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 09 12:53:14 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[689b705a-2a05-4666-8e04-a9a0334c808b]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:53:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:14 devstack sudo[90752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5
Apr 09 12:53:14 devstack sudo[90752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:14 devstack sudo[90747]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-83af23aa-28d2-4f5b-9de8-598f79331181 tempest-CreateVolumesFromSnapshotTest-828104883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-07a05b49-8f10-4db3-8fa2-9393f6754174" returned: 0 in 0.668s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-83af23aa-28d2-4f5b-9de8-598f79331181 tempest-CreateVolumesFromSnapshotTest-828104883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-07a05b49-8f10-4db3-8fa2-9393f6754174 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:14 devstack sudo[90757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-07a05b49-8f10-4db3-8fa2-9393f6754174
Apr 09 12:53:14 devstack sudo[90757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:14 devstack sudo[90752]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5" returned: 0 in 0.675s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:14 devstack cinder-volume[82760]: DEBUG cinder.utils [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] Path /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a3db62cd-7895-4d0b-9e77-858c9b187848 not found in is_blk_device check {{(pid=82760) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 09 12:53:14 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a3db62cd-7895-4d0b-9e77-858c9b187848 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:15 devstack sudo[90762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a3db62cd-7895-4d0b-9e77-858c9b187848
Apr 09 12:53:15 devstack sudo[90762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:15 devstack sudo[90757]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:15 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-83af23aa-28d2-4f5b-9de8-598f79331181 tempest-CreateVolumesFromSnapshotTest-828104883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-07a05b49-8f10-4db3-8fa2-9393f6754174" returned: 0 in 0.649s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:15 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-83af23aa-28d2-4f5b-9de8-598f79331181 tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "cinder-quobyte-07a05b49-8f10-4db3-8fa2-9393f6754174" released by "delete_volume" :: held 1.357s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:53:15 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-83af23aa-28d2-4f5b-9de8-598f79331181 tempest-CreateVolumesFromSnapshotTest-828104883 None] Created reservations ['d6365bde-eb18-4751-a8b8-ddaafbcb9afa', 'eccdf47b-476a-40f0-bb6b-1d0b81ce9906', '83951f77-d2cf-4cd9-bf47-b1c5ee4a7958', 'd900b858-7c36-4467-beae-519d6fcfea24'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:53:15 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-83af23aa-28d2-4f5b-9de8-598f79331181 tempest-CreateVolumesFromSnapshotTest-828104883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:53:15 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-83af23aa-28d2-4f5b-9de8-598f79331181 tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:53:15 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-83af23aa-28d2-4f5b-9de8-598f79331181 tempest-CreateVolumesFromSnapshotTest-828104883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:53:15 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-83af23aa-28d2-4f5b-9de8-598f79331181 tempest-CreateVolumesFromSnapshotTest-828104883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:53:15 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-83af23aa-28d2-4f5b-9de8-598f79331181 tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:53:15 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-83af23aa-28d2-4f5b-9de8-598f79331181 tempest-CreateVolumesFromSnapshotTest-828104883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:15 devstack sudo[90769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:53:15 devstack sudo[90769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:16 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-409fe45f-5636-4659-825c-2c86841b15da tempest-CreateVolumesFromSnapshotTest-828104883 None] Acquiring lock "cinder-023c12c4-c80f-4c23-9f62-9791d8838a50-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:53:16 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-409fe45f-5636-4659-825c-2c86841b15da tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "cinder-023c12c4-c80f-4c23-9f62-9791d8838a50-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:53:16 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-409fe45f-5636-4659-825c-2c86841b15da tempest-CreateVolumesFromSnapshotTest-828104883 None] Acquiring lock "cinder-quobyte-023c12c4-c80f-4c23-9f62-9791d8838a50" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:53:16 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-409fe45f-5636-4659-825c-2c86841b15da tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "cinder-quobyte-023c12c4-c80f-4c23-9f62-9791d8838a50" acquired by "delete_volume" :: waited 0.029s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:53:16 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b12a20-7023-4a5f-b14f-0d49cc28b908]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:53:16 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-409fe45f-5636-4659-825c-2c86841b15da tempest-CreateVolumesFromSnapshotTest-828104883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-023c12c4-c80f-4c23-9f62-9791d8838a50 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:16 devstack sudo[90769]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:16 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-83af23aa-28d2-4f5b-9de8-598f79331181 tempest-CreateVolumesFromSnapshotTest-828104883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 1.401s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:16 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-83af23aa-28d2-4f5b-9de8-598f79331181 tempest-CreateVolumesFromSnapshotTest-828104883 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:53:16 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-83af23aa-28d2-4f5b-9de8-598f79331181 tempest-CreateVolumesFromSnapshotTest-828104883 None] Deleted volume successfully.
Apr 09 12:53:16 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-83af23aa-28d2-4f5b-9de8-598f79331181 tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "cinder-07a05b49-8f10-4db3-8fa2-9393f6754174-delete_volume" released by "delete_volume" :: held 2.967s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:53:17 devstack sudo[90779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-023c12c4-c80f-4c23-9f62-9791d8838a50
Apr 09 12:53:17 devstack sudo[90779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:18 devstack sudo[90762]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a3db62cd-7895-4d0b-9e77-858c9b187848" returned: 0 in 3.045s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:18 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[2088abd7-3718-40ed-afab-c3d99f48b8b7]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:53:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:18 devstack sudo[90781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5
Apr 09 12:53:18 devstack sudo[90781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:18 devstack sudo[90779]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-409fe45f-5636-4659-825c-2c86841b15da tempest-CreateVolumesFromSnapshotTest-828104883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-023c12c4-c80f-4c23-9f62-9791d8838a50" returned: 0 in 1.480s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-409fe45f-5636-4659-825c-2c86841b15da tempest-CreateVolumesFromSnapshotTest-828104883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-023c12c4-c80f-4c23-9f62-9791d8838a50 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:18 devstack sudo[90786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-023c12c4-c80f-4c23-9f62-9791d8838a50
Apr 09 12:53:18 devstack sudo[90786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:18 devstack sudo[90781]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5" returned: 0 in 0.828s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:18 devstack cinder-volume[82760]: DEBUG cinder.image.image_utils [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] Image conversion details: src /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5, size 1024.00 MB, duration 3.05 sec, destination /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a3db62cd-7895-4d0b-9e77-858c9b187848 {{(pid=82760) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 09 12:53:18 devstack cinder-volume[82760]: INFO cinder.image.image_utils [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] Converted 1024.00 MB image at 336.18 MB/s
Apr 09 12:53:18 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a3db62cd-7895-4d0b-9e77-858c9b187848 is being set with open permissions: ugo+rw
Apr 09 12:53:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a3db62cd-7895-4d0b-9e77-858c9b187848 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:18 devstack sudo[90786]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:18 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-409fe45f-5636-4659-825c-2c86841b15da tempest-CreateVolumesFromSnapshotTest-828104883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-023c12c4-c80f-4c23-9f62-9791d8838a50" returned: 0 in 0.555s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:18 devstack sudo[90793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a3db62cd-7895-4d0b-9e77-858c9b187848
Apr 09 12:53:18 devstack sudo[90793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:18 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-409fe45f-5636-4659-825c-2c86841b15da tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "cinder-quobyte-023c12c4-c80f-4c23-9f62-9791d8838a50" released by "delete_volume" :: held 2.085s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:53:18 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-409fe45f-5636-4659-825c-2c86841b15da tempest-CreateVolumesFromSnapshotTest-828104883 None] Created reservations ['bf4903a1-127a-4a77-8911-72675e99964b', '6ec631b5-d931-4e37-98d1-75cf9c76e364', '39277404-2275-40e1-82bc-1c7b9538c1a1', 'd6538e7a-9601-4a44-8075-90d2487ba1b6'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:53:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-409fe45f-5636-4659-825c-2c86841b15da tempest-CreateVolumesFromSnapshotTest-828104883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:53:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-409fe45f-5636-4659-825c-2c86841b15da tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:53:19 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-409fe45f-5636-4659-825c-2c86841b15da tempest-CreateVolumesFromSnapshotTest-828104883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:53:19 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-409fe45f-5636-4659-825c-2c86841b15da tempest-CreateVolumesFromSnapshotTest-828104883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:53:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-409fe45f-5636-4659-825c-2c86841b15da tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:53:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-409fe45f-5636-4659-825c-2c86841b15da tempest-CreateVolumesFromSnapshotTest-828104883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:19 devstack sudo[90795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:53:19 devstack sudo[90795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:19 devstack sudo[90793]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a3db62cd-7895-4d0b-9e77-858c9b187848" returned: 0 in 0.618s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:19 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] Lock "cinder-quobyte-a3db62cd-7895-4d0b-9e77-858c9b187848" released by "_copy_volume_from_snapshot" :: held 6.014s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:53:19 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] Acquiring lock "cinder-quobyte-1c703f93-93d5-4527-b41c-3bc0afe70900" by "_delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:53:19 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] Lock "cinder-quobyte-1c703f93-93d5-4527-b41c-3bc0afe70900" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:53:19 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] Deleting offline snapshot 1c703f93-93d5-4527-b41c-3bc0afe70900 of volume 3729eba7-0002-43e3-9a8d-d8672d4a44c5 {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 12:53:19 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] snapshot_file for this snap is: volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5.1c703f93-93d5-4527-b41c-3bc0afe70900 {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 12:53:19 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[b429259c-b61c-4742-8f46-f819576b7677]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:53:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5.1c703f93-93d5-4527-b41c-3bc0afe70900 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:19 devstack sudo[90798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5.1c703f93-93d5-4527-b41c-3bc0afe70900
Apr 09 12:53:19 devstack sudo[90798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:19 devstack sudo[90795]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:19 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-409fe45f-5636-4659-825c-2c86841b15da tempest-CreateVolumesFromSnapshotTest-828104883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.641s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:19 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-409fe45f-5636-4659-825c-2c86841b15da tempest-CreateVolumesFromSnapshotTest-828104883 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:53:19 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-409fe45f-5636-4659-825c-2c86841b15da tempest-CreateVolumesFromSnapshotTest-828104883 None] Deleted volume successfully.
Apr 09 12:53:19 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-409fe45f-5636-4659-825c-2c86841b15da tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "cinder-023c12c4-c80f-4c23-9f62-9791d8838a50-delete_volume" released by "delete_volume" :: held 3.076s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:53:20 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-2e0cb5a5-010d-4d08-8670-2d30563ee3b3 tempest-CreateVolumesFromSnapshotTest-828104883 None] Acquiring lock "cinder-1e3ad4ec-f9db-475c-9d76-3d165da225df-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:53:20 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-2e0cb5a5-010d-4d08-8670-2d30563ee3b3 tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "cinder-1e3ad4ec-f9db-475c-9d76-3d165da225df-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:53:20 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-2e0cb5a5-010d-4d08-8670-2d30563ee3b3 tempest-CreateVolumesFromSnapshotTest-828104883 None] Acquiring lock "cinder-quobyte-1e3ad4ec-f9db-475c-9d76-3d165da225df" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:53:20 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-2e0cb5a5-010d-4d08-8670-2d30563ee3b3 tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "cinder-quobyte-1e3ad4ec-f9db-475c-9d76-3d165da225df" acquired by "delete_volume" :: waited 0.010s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:53:20 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[849e900f-2b3c-47fc-816a-88817db06b4d]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:53:20 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2e0cb5a5-010d-4d08-8670-2d30563ee3b3 tempest-CreateVolumesFromSnapshotTest-828104883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1e3ad4ec-f9db-475c-9d76-3d165da225df {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:20 devstack sudo[90798]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:20 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5.1c703f93-93d5-4527-b41c-3bc0afe70900" returned: 0 in 0.701s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:20 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:53:20 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[152cf368-cb06-4842-bb05-02e0a214ec07]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:53:20 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:20 devstack sudo[90804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1e3ad4ec-f9db-475c-9d76-3d165da225df
Apr 09 12:53:20 devstack sudo[90804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:20 devstack sudo[90805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5
Apr 09 12:53:20 devstack sudo[90805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:20 devstack sudo[90804]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:20 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2e0cb5a5-010d-4d08-8670-2d30563ee3b3 tempest-CreateVolumesFromSnapshotTest-828104883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1e3ad4ec-f9db-475c-9d76-3d165da225df" returned: 0 in 0.694s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:20 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2e0cb5a5-010d-4d08-8670-2d30563ee3b3 tempest-CreateVolumesFromSnapshotTest-828104883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1e3ad4ec-f9db-475c-9d76-3d165da225df {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:20 devstack sudo[90814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1e3ad4ec-f9db-475c-9d76-3d165da225df
Apr 09 12:53:20 devstack sudo[90814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:20 devstack sudo[90805]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:20 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5" returned: 0 in 0.696s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:20 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5.1c703f93-93d5-4527-b41c-3bc0afe70900 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:20 devstack sudo[90816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5.1c703f93-93d5-4527-b41c-3bc0afe70900
Apr 09 12:53:20 devstack sudo[90816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:21 devstack sudo[90814]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:21 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2e0cb5a5-010d-4d08-8670-2d30563ee3b3 tempest-CreateVolumesFromSnapshotTest-828104883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-1e3ad4ec-f9db-475c-9d76-3d165da225df" returned: 0 in 0.494s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:21 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-2e0cb5a5-010d-4d08-8670-2d30563ee3b3 tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "cinder-quobyte-1e3ad4ec-f9db-475c-9d76-3d165da225df" released by "delete_volume" :: held 1.216s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:53:21 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-2e0cb5a5-010d-4d08-8670-2d30563ee3b3 tempest-CreateVolumesFromSnapshotTest-828104883 None] Created reservations ['5b94a0ea-97bc-4304-b788-47020fcdd0d8', '53851a77-e331-47b8-acee-6c2dcf34feaf', '0dbfd641-2180-4769-9c38-de99eb38a26b', '1cad3e7f-f413-4580-bb8d-1ff4642633a1'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:53:21 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-2e0cb5a5-010d-4d08-8670-2d30563ee3b3 tempest-CreateVolumesFromSnapshotTest-828104883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:53:21 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-2e0cb5a5-010d-4d08-8670-2d30563ee3b3 tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:53:21 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-2e0cb5a5-010d-4d08-8670-2d30563ee3b3 tempest-CreateVolumesFromSnapshotTest-828104883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:53:21 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-2e0cb5a5-010d-4d08-8670-2d30563ee3b3 tempest-CreateVolumesFromSnapshotTest-828104883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:53:21 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-2e0cb5a5-010d-4d08-8670-2d30563ee3b3 tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:53:21 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2e0cb5a5-010d-4d08-8670-2d30563ee3b3 tempest-CreateVolumesFromSnapshotTest-828104883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:21 devstack sudo[90822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:53:21 devstack sudo[90822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:21 devstack sudo[90816]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:21 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5.1c703f93-93d5-4527-b41c-3bc0afe70900" returned: 0 in 0.648s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:21 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5.1c703f93-93d5-4527-b41c-3bc0afe70900 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:21 devstack sudo[90824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5.1c703f93-93d5-4527-b41c-3bc0afe70900
Apr 09 12:53:21 devstack sudo[90824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:22 devstack sudo[90822]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:22 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2e0cb5a5-010d-4d08-8670-2d30563ee3b3 tempest-CreateVolumesFromSnapshotTest-828104883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.628s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:22 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-2e0cb5a5-010d-4d08-8670-2d30563ee3b3 tempest-CreateVolumesFromSnapshotTest-828104883 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:53:22 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-2e0cb5a5-010d-4d08-8670-2d30563ee3b3 tempest-CreateVolumesFromSnapshotTest-828104883 None] Deleted volume successfully.
Apr 09 12:53:22 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-2e0cb5a5-010d-4d08-8670-2d30563ee3b3 tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "cinder-1e3ad4ec-f9db-475c-9d76-3d165da225df-delete_volume" released by "delete_volume" :: held 2.079s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:53:22 devstack sudo[90824]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:22 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5.1c703f93-93d5-4527-b41c-3bc0afe70900" returned: 0 in 0.615s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:22 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] Lock "cinder-quobyte-1c703f93-93d5-4527-b41c-3bc0afe70900" released by "_delete_snapshot" :: held 2.722s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:53:22 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.500s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:53:22 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ca87c037-3bef-4825-a00b-b5f014b2bfe7 tempest-CinderUnicodeTest-1468521471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.757s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:53:22 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e7b4910-e91f-4d36-90a2-5c3e7689c745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3db62cd-7895-4d0b-9e77-858c9b187848', 'volume_size': 1, 'source_volid': '3729eba7-0002-43e3-9a8d-d8672d4a44c5', 'source_volstatus': 'available'}' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:53:22 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a1cf253-2a52-43e2-ab5b-4d0d4782eb93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 09 12:53:22 devstack cinder-volume[82760]: INFO cinder.volume.flows.manager.create_volume [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] Volume volume-a3db62cd-7895-4d0b-9e77-858c9b187848 (a3db62cd-7895-4d0b-9e77-858c9b187848): created successfully
Apr 09 12:53:22 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a1cf253-2a52-43e2-ab5b-4d0d4782eb93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82760) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 09 12:53:22 devstack cinder-volume[82760]: DEBUG cinder.volume.manager [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] Flow 'volume_create_manager' (894299dc-fe20-4f5b-9d76-915d6c7c4a9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82760) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 09 12:53:22 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-ca87c037-3bef-4825-a00b-b5f014b2bfe7 tempest-CinderUnicodeTest-1468521471 None] Creating offline snapshot 837939b7-9cee-40e2-91a9-59337620f795 of volume 77cee92a-e8a4-4c97-98ac-ae40d42d131c {{(pid=82760) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 09 12:53:22 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-dbee3a9c-9a40-4568-8276-db5aac99d7fa tempest-CreateVolumesFromSnapshotTest-828104883 None] Acquiring lock "cinder-7ac3efa4-f2bb-4b8c-b60a-407d73534697-delete_snapshot" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:53:22 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad1313f-71f0-48f1-a372-73f083686a88]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:53:22 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ca87c037-3bef-4825-a00b-b5f014b2bfe7 tempest-CinderUnicodeTest-1468521471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-77cee92a-e8a4-4c97-98ac-ae40d42d131c {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:22 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-9d96b6f3-6064-4a34-815a-52ba2a3ea3a1 tempest-VolumeDependencyTests-1907829774 None] Created volume successfully.
Apr 09 12:53:22 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-dbee3a9c-9a40-4568-8276-db5aac99d7fa tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "cinder-7ac3efa4-f2bb-4b8c-b60a-407d73534697-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:53:22 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-dbee3a9c-9a40-4568-8276-db5aac99d7fa tempest-CreateVolumesFromSnapshotTest-828104883 None] Acquiring lock "cinder-quobyte-37d74158-2b90-4321-ab38-1d4a49da6fe7" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:53:22 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-dbee3a9c-9a40-4568-8276-db5aac99d7fa tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "cinder-quobyte-37d74158-2b90-4321-ab38-1d4a49da6fe7" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:53:22 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-dbee3a9c-9a40-4568-8276-db5aac99d7fa tempest-CreateVolumesFromSnapshotTest-828104883 None] Acquiring lock "cinder-quobyte-7ac3efa4-f2bb-4b8c-b60a-407d73534697" by "_delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:53:22 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-dbee3a9c-9a40-4568-8276-db5aac99d7fa tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "cinder-quobyte-7ac3efa4-f2bb-4b8c-b60a-407d73534697" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:53:22 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-dbee3a9c-9a40-4568-8276-db5aac99d7fa tempest-CreateVolumesFromSnapshotTest-828104883 None] Deleting offline snapshot 7ac3efa4-f2bb-4b8c-b60a-407d73534697 of volume 37d74158-2b90-4321-ab38-1d4a49da6fe7 {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 12:53:22 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-dbee3a9c-9a40-4568-8276-db5aac99d7fa tempest-CreateVolumesFromSnapshotTest-828104883 None] snapshot_file for this snap is: volume-37d74158-2b90-4321-ab38-1d4a49da6fe7.7ac3efa4-f2bb-4b8c-b60a-407d73534697 {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 12:53:22 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1a4967-7f09-4c2c-91ea-00b7baa61eed]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:53:22 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-dbee3a9c-9a40-4568-8276-db5aac99d7fa tempest-CreateVolumesFromSnapshotTest-828104883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-37d74158-2b90-4321-ab38-1d4a49da6fe7.7ac3efa4-f2bb-4b8c-b60a-407d73534697 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:22 devstack sudo[90830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-77cee92a-e8a4-4c97-98ac-ae40d42d131c
Apr 09 12:53:22 devstack sudo[90830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:22 devstack sudo[90831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-37d74158-2b90-4321-ab38-1d4a49da6fe7.7ac3efa4-f2bb-4b8c-b60a-407d73534697
Apr 09 12:53:22 devstack sudo[90831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:23 devstack sudo[90831]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-dbee3a9c-9a40-4568-8276-db5aac99d7fa tempest-CreateVolumesFromSnapshotTest-828104883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-37d74158-2b90-4321-ab38-1d4a49da6fe7.7ac3efa4-f2bb-4b8c-b60a-407d73534697" returned: 0 in 0.708s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:23 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-dbee3a9c-9a40-4568-8276-db5aac99d7fa tempest-CreateVolumesFromSnapshotTest-828104883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37d74158-2b90-4321-ab38-1d4a49da6fe7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:53:23 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae5173b-3653-46f4-929f-80483045465b]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:53:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-dbee3a9c-9a40-4568-8276-db5aac99d7fa tempest-CreateVolumesFromSnapshotTest-828104883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-37d74158-2b90-4321-ab38-1d4a49da6fe7 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:23 devstack sudo[90830]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ca87c037-3bef-4825-a00b-b5f014b2bfe7 tempest-CinderUnicodeTest-1468521471 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-77cee92a-e8a4-4c97-98ac-ae40d42d131c" returned: 0 in 0.832s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ca87c037-3bef-4825-a00b-b5f014b2bfe7 tempest-CinderUnicodeTest-1468521471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-77cee92a-e8a4-4c97-98ac-ae40d42d131c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-77cee92a-e8a4-4c97-98ac-ae40d42d131c.837939b7-9cee-40e2-91a9-59337620f795 1G {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:23 devstack sudo[90848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-77cee92a-e8a4-4c97-98ac-ae40d42d131c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-77cee92a-e8a4-4c97-98ac-ae40d42d131c.837939b7-9cee-40e2-91a9-59337620f795 1G
Apr 09 12:53:23 devstack sudo[90848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:23 devstack sudo[90847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-37d74158-2b90-4321-ab38-1d4a49da6fe7
Apr 09 12:53:23 devstack sudo[90847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:23 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-857213e3-17d7-4e69-bc25-b48dd414a607 tempest-VolumeDependencyTests-1907829774 None] Acquiring lock "cinder-3729eba7-0002-43e3-9a8d-d8672d4a44c5-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:53:23 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-857213e3-17d7-4e69-bc25-b48dd414a607 tempest-VolumeDependencyTests-1907829774 None] Lock "cinder-3729eba7-0002-43e3-9a8d-d8672d4a44c5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:53:23 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-857213e3-17d7-4e69-bc25-b48dd414a607 tempest-VolumeDependencyTests-1907829774 None] Acquiring lock "cinder-quobyte-3729eba7-0002-43e3-9a8d-d8672d4a44c5" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:53:23 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-857213e3-17d7-4e69-bc25-b48dd414a607 tempest-VolumeDependencyTests-1907829774 None] Lock "cinder-quobyte-3729eba7-0002-43e3-9a8d-d8672d4a44c5" acquired by "delete_volume" :: waited 0.013s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:53:23 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d531ec6-bc7d-4d2e-b771-66345264c25c]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:53:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-857213e3-17d7-4e69-bc25-b48dd414a607 tempest-VolumeDependencyTests-1907829774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:23 devstack sudo[90851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5
Apr 09 12:53:23 devstack sudo[90851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:23 devstack sudo[90847]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-dbee3a9c-9a40-4568-8276-db5aac99d7fa tempest-CreateVolumesFromSnapshotTest-828104883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-37d74158-2b90-4321-ab38-1d4a49da6fe7" returned: 0 in 0.713s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-dbee3a9c-9a40-4568-8276-db5aac99d7fa tempest-CreateVolumesFromSnapshotTest-828104883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-37d74158-2b90-4321-ab38-1d4a49da6fe7.7ac3efa4-f2bb-4b8c-b60a-407d73534697 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:23 devstack sudo[90859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-37d74158-2b90-4321-ab38-1d4a49da6fe7.7ac3efa4-f2bb-4b8c-b60a-407d73534697
Apr 09 12:53:23 devstack sudo[90859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:23 devstack sudo[90848]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ca87c037-3bef-4825-a00b-b5f014b2bfe7 tempest-CinderUnicodeTest-1468521471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-77cee92a-e8a4-4c97-98ac-ae40d42d131c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-77cee92a-e8a4-4c97-98ac-ae40d42d131c.837939b7-9cee-40e2-91a9-59337620f795 1G" returned: 0 in 0.792s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:23 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ca87c037-3bef-4825-a00b-b5f014b2bfe7 tempest-CinderUnicodeTest-1468521471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77cee92a-e8a4-4c97-98ac-ae40d42d131c -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-77cee92a-e8a4-4c97-98ac-ae40d42d131c.837939b7-9cee-40e2-91a9-59337620f795 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:24 devstack sudo[90861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77cee92a-e8a4-4c97-98ac-ae40d42d131c -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-77cee92a-e8a4-4c97-98ac-ae40d42d131c.837939b7-9cee-40e2-91a9-59337620f795
Apr 09 12:53:24 devstack sudo[90861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:24 devstack sudo[90851]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-857213e3-17d7-4e69-bc25-b48dd414a607 tempest-VolumeDependencyTests-1907829774 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5" returned: 0 in 0.746s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-857213e3-17d7-4e69-bc25-b48dd414a607 tempest-VolumeDependencyTests-1907829774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:24 devstack sudo[90866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5
Apr 09 12:53:24 devstack sudo[90866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:24 devstack sudo[90859]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-dbee3a9c-9a40-4568-8276-db5aac99d7fa tempest-CreateVolumesFromSnapshotTest-828104883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-37d74158-2b90-4321-ab38-1d4a49da6fe7.7ac3efa4-f2bb-4b8c-b60a-407d73534697" returned: 0 in 0.582s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-dbee3a9c-9a40-4568-8276-db5aac99d7fa tempest-CreateVolumesFromSnapshotTest-828104883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-37d74158-2b90-4321-ab38-1d4a49da6fe7.7ac3efa4-f2bb-4b8c-b60a-407d73534697 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:24 devstack sudo[90873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-37d74158-2b90-4321-ab38-1d4a49da6fe7.7ac3efa4-f2bb-4b8c-b60a-407d73534697
Apr 09 12:53:24 devstack sudo[90873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:24 devstack sudo[90861]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ca87c037-3bef-4825-a00b-b5f014b2bfe7 tempest-CinderUnicodeTest-1468521471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77cee92a-e8a4-4c97-98ac-ae40d42d131c -F qcow2 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-77cee92a-e8a4-4c97-98ac-ae40d42d131c.837939b7-9cee-40e2-91a9-59337620f795" returned: 0 in 0.649s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:24 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-ca87c037-3bef-4825-a00b-b5f014b2bfe7 tempest-CinderUnicodeTest-1468521471 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-77cee92a-e8a4-4c97-98ac-ae40d42d131c.837939b7-9cee-40e2-91a9-59337620f795 is being set with open permissions: ugo+rw
Apr 09 12:53:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ca87c037-3bef-4825-a00b-b5f014b2bfe7 tempest-CinderUnicodeTest-1468521471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-77cee92a-e8a4-4c97-98ac-ae40d42d131c.837939b7-9cee-40e2-91a9-59337620f795 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:24 devstack sudo[90876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-77cee92a-e8a4-4c97-98ac-ae40d42d131c.837939b7-9cee-40e2-91a9-59337620f795
Apr 09 12:53:24 devstack sudo[90876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:24 devstack sudo[90866]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-857213e3-17d7-4e69-bc25-b48dd414a607 tempest-VolumeDependencyTests-1907829774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-3729eba7-0002-43e3-9a8d-d8672d4a44c5" returned: 0 in 0.478s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:24 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-857213e3-17d7-4e69-bc25-b48dd414a607 tempest-VolumeDependencyTests-1907829774 None] Lock "cinder-quobyte-3729eba7-0002-43e3-9a8d-d8672d4a44c5" released by "delete_volume" :: held 1.263s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:53:24 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-857213e3-17d7-4e69-bc25-b48dd414a607 tempest-VolumeDependencyTests-1907829774 None] Created reservations ['c81d811e-2f0b-4e32-887c-c3eb775e565f', '9569387a-a1b0-4b46-bcfc-f379f27ef6b4', 'a938bcf2-68dd-4fbc-9481-effc7bc050d7', 'c36208ea-0e3c-4493-b954-80b1347b03f8'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:53:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-857213e3-17d7-4e69-bc25-b48dd414a607 tempest-VolumeDependencyTests-1907829774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:53:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-857213e3-17d7-4e69-bc25-b48dd414a607 tempest-VolumeDependencyTests-1907829774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:53:24 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-857213e3-17d7-4e69-bc25-b48dd414a607 tempest-VolumeDependencyTests-1907829774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:53:24 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-857213e3-17d7-4e69-bc25-b48dd414a607 tempest-VolumeDependencyTests-1907829774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:53:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-857213e3-17d7-4e69-bc25-b48dd414a607 tempest-VolumeDependencyTests-1907829774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:53:24 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-857213e3-17d7-4e69-bc25-b48dd414a607 tempest-VolumeDependencyTests-1907829774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:24 devstack sudo[90879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:53:24 devstack sudo[90879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:24 devstack sudo[90873]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-dbee3a9c-9a40-4568-8276-db5aac99d7fa tempest-CreateVolumesFromSnapshotTest-828104883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-37d74158-2b90-4321-ab38-1d4a49da6fe7.7ac3efa4-f2bb-4b8c-b60a-407d73534697" returned: 0 in 0.531s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:25 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-dbee3a9c-9a40-4568-8276-db5aac99d7fa tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "cinder-quobyte-7ac3efa4-f2bb-4b8c-b60a-407d73534697" released by "_delete_snapshot" :: held 2.611s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:53:25 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-dbee3a9c-9a40-4568-8276-db5aac99d7fa tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "cinder-quobyte-37d74158-2b90-4321-ab38-1d4a49da6fe7" released by "delete_snapshot" :: held 2.630s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:53:25 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-dbee3a9c-9a40-4568-8276-db5aac99d7fa tempest-CreateVolumesFromSnapshotTest-828104883 None] Created reservations ['94d8b93a-fdf1-4866-890a-220528b470c3', '8d251730-96e2-40cf-9b9b-6f7431cae566', 'a9b0f301-5de5-49ac-94ac-d5f1282b08b9', 'af328f49-f8db-4322-bef0-5d61ebbf4cf4'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:53:25 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-dbee3a9c-9a40-4568-8276-db5aac99d7fa tempest-CreateVolumesFromSnapshotTest-828104883 None] Delete snapshot completed successfully.
Apr 09 12:53:25 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-dbee3a9c-9a40-4568-8276-db5aac99d7fa tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "cinder-7ac3efa4-f2bb-4b8c-b60a-407d73534697-delete_snapshot" released by "delete_snapshot" :: held 2.755s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:53:25 devstack sudo[90876]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ca87c037-3bef-4825-a00b-b5f014b2bfe7 tempest-CinderUnicodeTest-1468521471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-77cee92a-e8a4-4c97-98ac-ae40d42d131c.837939b7-9cee-40e2-91a9-59337620f795" returned: 0 in 0.555s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ca87c037-3bef-4825-a00b-b5f014b2bfe7 tempest-CinderUnicodeTest-1468521471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-77cee92a-e8a4-4c97-98ac-ae40d42d131c.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:25 devstack sudo[90883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-77cee92a-e8a4-4c97-98ac-ae40d42d131c.info
Apr 09 12:53:25 devstack sudo[90883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:25 devstack sudo[90879]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-857213e3-17d7-4e69-bc25-b48dd414a607 tempest-VolumeDependencyTests-1907829774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.502s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:25 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-857213e3-17d7-4e69-bc25-b48dd414a607 tempest-VolumeDependencyTests-1907829774 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:53:25 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-857213e3-17d7-4e69-bc25-b48dd414a607 tempest-VolumeDependencyTests-1907829774 None] Deleted volume successfully.
Apr 09 12:53:25 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-857213e3-17d7-4e69-bc25-b48dd414a607 tempest-VolumeDependencyTests-1907829774 None] Lock "cinder-3729eba7-0002-43e3-9a8d-d8672d4a44c5-delete_volume" released by "delete_volume" :: held 1.957s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:53:25 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-6bea4bfd-1161-49f6-abfb-1560f7839113 tempest-CreateVolumesFromSnapshotTest-828104883 None] Acquiring lock "cinder-37d74158-2b90-4321-ab38-1d4a49da6fe7-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:53:25 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-6bea4bfd-1161-49f6-abfb-1560f7839113 tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "cinder-37d74158-2b90-4321-ab38-1d4a49da6fe7-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:53:25 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-6bea4bfd-1161-49f6-abfb-1560f7839113 tempest-CreateVolumesFromSnapshotTest-828104883 None] Acquiring lock "cinder-quobyte-37d74158-2b90-4321-ab38-1d4a49da6fe7" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:53:25 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-6bea4bfd-1161-49f6-abfb-1560f7839113 tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "cinder-quobyte-37d74158-2b90-4321-ab38-1d4a49da6fe7" acquired by "delete_volume" :: waited 0.015s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:53:25 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a18196-794b-40b1-905a-df16ec2358f2]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:53:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6bea4bfd-1161-49f6-abfb-1560f7839113 tempest-CreateVolumesFromSnapshotTest-828104883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-37d74158-2b90-4321-ab38-1d4a49da6fe7 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:25 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-e2fe0bd0-2a85-4cf1-bddb-bce6a6f75653 tempest-VolumeDependencyTests-1907829774 None] Acquiring lock "cinder-a3db62cd-7895-4d0b-9e77-858c9b187848-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:53:25 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-e2fe0bd0-2a85-4cf1-bddb-bce6a6f75653 tempest-VolumeDependencyTests-1907829774 None] Lock "cinder-a3db62cd-7895-4d0b-9e77-858c9b187848-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:53:25 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-e2fe0bd0-2a85-4cf1-bddb-bce6a6f75653 tempest-VolumeDependencyTests-1907829774 None] Acquiring lock "cinder-quobyte-a3db62cd-7895-4d0b-9e77-858c9b187848" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:53:25 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-e2fe0bd0-2a85-4cf1-bddb-bce6a6f75653 tempest-VolumeDependencyTests-1907829774 None] Lock "cinder-quobyte-a3db62cd-7895-4d0b-9e77-858c9b187848" acquired by "delete_volume" :: waited 0.012s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:53:25 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[79eec5df-018e-42bf-9923-b582aa7d88fe]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:53:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e2fe0bd0-2a85-4cf1-bddb-bce6a6f75653 tempest-VolumeDependencyTests-1907829774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a3db62cd-7895-4d0b-9e77-858c9b187848 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:25 devstack sudo[90886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-37d74158-2b90-4321-ab38-1d4a49da6fe7
Apr 09 12:53:25 devstack sudo[90886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:25 devstack sudo[90888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a3db62cd-7895-4d0b-9e77-858c9b187848
Apr 09 12:53:25 devstack sudo[90888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:25 devstack sudo[90883]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ca87c037-3bef-4825-a00b-b5f014b2bfe7 tempest-CinderUnicodeTest-1468521471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-77cee92a-e8a4-4c97-98ac-ae40d42d131c.info" returned: 0 in 0.632s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:25 devstack cinder-volume[82760]: WARNING cinder.volume.drivers.remotefs [None req-ca87c037-3bef-4825-a00b-b5f014b2bfe7 tempest-CinderUnicodeTest-1468521471 None] /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-77cee92a-e8a4-4c97-98ac-ae40d42d131c.info is being set with open permissions: ugo+rw
Apr 09 12:53:25 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ca87c037-3bef-4825-a00b-b5f014b2bfe7 tempest-CinderUnicodeTest-1468521471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-77cee92a-e8a4-4c97-98ac-ae40d42d131c.info {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:25 devstack sudo[90891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-77cee92a-e8a4-4c97-98ac-ae40d42d131c.info
Apr 09 12:53:25 devstack sudo[90891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:26 devstack sudo[90886]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6bea4bfd-1161-49f6-abfb-1560f7839113 tempest-CreateVolumesFromSnapshotTest-828104883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-37d74158-2b90-4321-ab38-1d4a49da6fe7" returned: 0 in 0.722s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6bea4bfd-1161-49f6-abfb-1560f7839113 tempest-CreateVolumesFromSnapshotTest-828104883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-37d74158-2b90-4321-ab38-1d4a49da6fe7 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:26 devstack sudo[90888]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e2fe0bd0-2a85-4cf1-bddb-bce6a6f75653 tempest-VolumeDependencyTests-1907829774 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a3db62cd-7895-4d0b-9e77-858c9b187848" returned: 0 in 0.640s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e2fe0bd0-2a85-4cf1-bddb-bce6a6f75653 tempest-VolumeDependencyTests-1907829774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a3db62cd-7895-4d0b-9e77-858c9b187848 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:26 devstack sudo[90900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-37d74158-2b90-4321-ab38-1d4a49da6fe7
Apr 09 12:53:26 devstack sudo[90900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:26 devstack sudo[90901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a3db62cd-7895-4d0b-9e77-858c9b187848
Apr 09 12:53:26 devstack sudo[90901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:26 devstack sudo[90891]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ca87c037-3bef-4825-a00b-b5f014b2bfe7 tempest-CinderUnicodeTest-1468521471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-77cee92a-e8a4-4c97-98ac-ae40d42d131c.info" returned: 0 in 0.581s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ca87c037-3bef-4825-a00b-b5f014b2bfe7 tempest-CinderUnicodeTest-1468521471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.166s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:53:26 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-ca87c037-3bef-4825-a00b-b5f014b2bfe7 tempest-CinderUnicodeTest-1468521471 None] Create snapshot completed successfully
Apr 09 12:53:26 devstack sudo[90900]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6bea4bfd-1161-49f6-abfb-1560f7839113 tempest-CreateVolumesFromSnapshotTest-828104883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-37d74158-2b90-4321-ab38-1d4a49da6fe7" returned: 0 in 0.565s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:26 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-6bea4bfd-1161-49f6-abfb-1560f7839113 tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "cinder-quobyte-37d74158-2b90-4321-ab38-1d4a49da6fe7" released by "delete_volume" :: held 1.330s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:53:26 devstack sudo[90901]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:26 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e2fe0bd0-2a85-4cf1-bddb-bce6a6f75653 tempest-VolumeDependencyTests-1907829774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-a3db62cd-7895-4d0b-9e77-858c9b187848" returned: 0 in 0.567s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:26 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-e2fe0bd0-2a85-4cf1-bddb-bce6a6f75653 tempest-VolumeDependencyTests-1907829774 None] Lock "cinder-quobyte-a3db62cd-7895-4d0b-9e77-858c9b187848" released by "delete_volume" :: held 1.241s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:53:27 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-6bea4bfd-1161-49f6-abfb-1560f7839113 tempest-CreateVolumesFromSnapshotTest-828104883 None] Created reservations ['5dbaa489-4b49-4950-afa4-0055a35bfaca', '674dde7c-c816-4f6c-8425-929cc28429af', 'e182b5f7-cfd4-48a7-9750-2d1c477730a7', '201f1a65-4629-42f3-9bba-56c4e278451b'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:53:27 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-e2fe0bd0-2a85-4cf1-bddb-bce6a6f75653 tempest-VolumeDependencyTests-1907829774 None] Created reservations ['b70a8651-89eb-408e-9969-fd3799970dd3', 'eefed3ab-c266-4e43-86c0-74b16da33de2', '5bda07d4-2ccc-4774-9e64-3e03d9122528', 'aa18f217-f5d0-4d61-82c0-0b2137ad8638'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:53:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-6bea4bfd-1161-49f6-abfb-1560f7839113 tempest-CreateVolumesFromSnapshotTest-828104883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:53:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-6bea4bfd-1161-49f6-abfb-1560f7839113 tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:53:27 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-6bea4bfd-1161-49f6-abfb-1560f7839113 tempest-CreateVolumesFromSnapshotTest-828104883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:53:27 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-6bea4bfd-1161-49f6-abfb-1560f7839113 tempest-CreateVolumesFromSnapshotTest-828104883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:53:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-6bea4bfd-1161-49f6-abfb-1560f7839113 tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:53:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6bea4bfd-1161-49f6-abfb-1560f7839113 tempest-CreateVolumesFromSnapshotTest-828104883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:27 devstack sudo[90906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:53:27 devstack sudo[90906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-e2fe0bd0-2a85-4cf1-bddb-bce6a6f75653 tempest-VolumeDependencyTests-1907829774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:53:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-e2fe0bd0-2a85-4cf1-bddb-bce6a6f75653 tempest-VolumeDependencyTests-1907829774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:53:27 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-e2fe0bd0-2a85-4cf1-bddb-bce6a6f75653 tempest-VolumeDependencyTests-1907829774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:53:27 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-e2fe0bd0-2a85-4cf1-bddb-bce6a6f75653 tempest-VolumeDependencyTests-1907829774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:53:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-e2fe0bd0-2a85-4cf1-bddb-bce6a6f75653 tempest-VolumeDependencyTests-1907829774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:53:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e2fe0bd0-2a85-4cf1-bddb-bce6a6f75653 tempest-VolumeDependencyTests-1907829774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:27 devstack sudo[90908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:53:27 devstack sudo[90908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:27 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-e44678a0-9d10-4bc7-bc62-5bc24ab3f687 tempest-CinderUnicodeTest-1468521471 None] Acquiring lock "cinder-837939b7-9cee-40e2-91a9-59337620f795-delete_snapshot" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:53:27 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-e44678a0-9d10-4bc7-bc62-5bc24ab3f687 tempest-CinderUnicodeTest-1468521471 None] Lock "cinder-837939b7-9cee-40e2-91a9-59337620f795-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:53:27 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-e44678a0-9d10-4bc7-bc62-5bc24ab3f687 tempest-CinderUnicodeTest-1468521471 None] Acquiring lock "cinder-quobyte-77cee92a-e8a4-4c97-98ac-ae40d42d131c" by "delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:53:27 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-e44678a0-9d10-4bc7-bc62-5bc24ab3f687 tempest-CinderUnicodeTest-1468521471 None] Lock "cinder-quobyte-77cee92a-e8a4-4c97-98ac-ae40d42d131c" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:53:27 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-e44678a0-9d10-4bc7-bc62-5bc24ab3f687 tempest-CinderUnicodeTest-1468521471 None] Acquiring lock "cinder-quobyte-837939b7-9cee-40e2-91a9-59337620f795" by "_delete_snapshot" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:53:27 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-e44678a0-9d10-4bc7-bc62-5bc24ab3f687 tempest-CinderUnicodeTest-1468521471 None] Lock "cinder-quobyte-837939b7-9cee-40e2-91a9-59337620f795" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:53:27 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-e44678a0-9d10-4bc7-bc62-5bc24ab3f687 tempest-CinderUnicodeTest-1468521471 None] Deleting offline snapshot 837939b7-9cee-40e2-91a9-59337620f795 of volume 77cee92a-e8a4-4c97-98ac-ae40d42d131c {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 09 12:53:27 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-e44678a0-9d10-4bc7-bc62-5bc24ab3f687 tempest-CinderUnicodeTest-1468521471 None] snapshot_file for this snap is: volume-77cee92a-e8a4-4c97-98ac-ae40d42d131c.837939b7-9cee-40e2-91a9-59337620f795 {{(pid=82760) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 09 12:53:27 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[0493deec-f783-4922-9269-39682d39dfbe]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:53:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e44678a0-9d10-4bc7-bc62-5bc24ab3f687 tempest-CinderUnicodeTest-1468521471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-77cee92a-e8a4-4c97-98ac-ae40d42d131c.837939b7-9cee-40e2-91a9-59337620f795 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:27 devstack sudo[90910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-77cee92a-e8a4-4c97-98ac-ae40d42d131c.837939b7-9cee-40e2-91a9-59337620f795
Apr 09 12:53:27 devstack sudo[90910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:27 devstack sudo[90908]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e2fe0bd0-2a85-4cf1-bddb-bce6a6f75653 tempest-VolumeDependencyTests-1907829774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.507s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:27 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-e2fe0bd0-2a85-4cf1-bddb-bce6a6f75653 tempest-VolumeDependencyTests-1907829774 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:53:27 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-e2fe0bd0-2a85-4cf1-bddb-bce6a6f75653 tempest-VolumeDependencyTests-1907829774 None] Deleted volume successfully.
Apr 09 12:53:27 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-e2fe0bd0-2a85-4cf1-bddb-bce6a6f75653 tempest-VolumeDependencyTests-1907829774 None] Lock "cinder-a3db62cd-7895-4d0b-9e77-858c9b187848-delete_volume" released by "delete_volume" :: held 2.016s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:53:27 devstack sudo[90906]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:27 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-6bea4bfd-1161-49f6-abfb-1560f7839113 tempest-CreateVolumesFromSnapshotTest-828104883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.586s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:27 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-6bea4bfd-1161-49f6-abfb-1560f7839113 tempest-CreateVolumesFromSnapshotTest-828104883 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:53:27 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-6bea4bfd-1161-49f6-abfb-1560f7839113 tempest-CreateVolumesFromSnapshotTest-828104883 None] Deleted volume successfully.
Apr 09 12:53:27 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-6bea4bfd-1161-49f6-abfb-1560f7839113 tempest-CreateVolumesFromSnapshotTest-828104883 None] Lock "cinder-37d74158-2b90-4321-ab38-1d4a49da6fe7-delete_volume" released by "delete_volume" :: held 2.164s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:53:27 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ae03802e-6099-4446-b6cc-5d6419036037 tempest-VolumeDependencyTests-1907829774 None] Acquiring lock "cinder-b58cbf29-bc38-4424-ac76-cd8d16ae26a4-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:53:27 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ae03802e-6099-4446-b6cc-5d6419036037 tempest-VolumeDependencyTests-1907829774 None] Lock "cinder-b58cbf29-bc38-4424-ac76-cd8d16ae26a4-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:53:27 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ae03802e-6099-4446-b6cc-5d6419036037 tempest-VolumeDependencyTests-1907829774 None] Acquiring lock "cinder-quobyte-b58cbf29-bc38-4424-ac76-cd8d16ae26a4" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:53:28 devstack sudo[90910]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:28 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ae03802e-6099-4446-b6cc-5d6419036037 tempest-VolumeDependencyTests-1907829774 None] Lock "cinder-quobyte-b58cbf29-bc38-4424-ac76-cd8d16ae26a4" acquired by "delete_volume" :: waited 0.019s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:53:28 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e44678a0-9d10-4bc7-bc62-5bc24ab3f687 tempest-CinderUnicodeTest-1468521471 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-77cee92a-e8a4-4c97-98ac-ae40d42d131c.837939b7-9cee-40e2-91a9-59337620f795" returned: 0 in 0.621s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:28 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.remotefs [None req-e44678a0-9d10-4bc7-bc62-5bc24ab3f687 tempest-CinderUnicodeTest-1468521471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77cee92a-e8a4-4c97-98ac-ae40d42d131c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82760) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 09 12:53:28 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a01a70f-c43f-4d83-890b-df78d502a003]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:53:28 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ae03802e-6099-4446-b6cc-5d6419036037 tempest-VolumeDependencyTests-1907829774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-b58cbf29-bc38-4424-ac76-cd8d16ae26a4 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:28 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[17243679-f410-448f-8f3c-d8ad03a70504]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:53:28 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e44678a0-9d10-4bc7-bc62-5bc24ab3f687 tempest-CinderUnicodeTest-1468521471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-77cee92a-e8a4-4c97-98ac-ae40d42d131c {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:28 devstack sudo[90917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-b58cbf29-bc38-4424-ac76-cd8d16ae26a4
Apr 09 12:53:28 devstack sudo[90917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:28 devstack sudo[90918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-77cee92a-e8a4-4c97-98ac-ae40d42d131c
Apr 09 12:53:28 devstack sudo[90918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:28 devstack sudo[90917]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:28 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ae03802e-6099-4446-b6cc-5d6419036037 tempest-VolumeDependencyTests-1907829774 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-b58cbf29-bc38-4424-ac76-cd8d16ae26a4" returned: 0 in 0.771s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:28 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ae03802e-6099-4446-b6cc-5d6419036037 tempest-VolumeDependencyTests-1907829774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-b58cbf29-bc38-4424-ac76-cd8d16ae26a4 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:28 devstack sudo[90927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-b58cbf29-bc38-4424-ac76-cd8d16ae26a4
Apr 09 12:53:28 devstack sudo[90927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:28 devstack sudo[90918]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:28 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e44678a0-9d10-4bc7-bc62-5bc24ab3f687 tempest-CinderUnicodeTest-1468521471 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-77cee92a-e8a4-4c97-98ac-ae40d42d131c" returned: 0 in 0.880s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:28 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e44678a0-9d10-4bc7-bc62-5bc24ab3f687 tempest-CinderUnicodeTest-1468521471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-77cee92a-e8a4-4c97-98ac-ae40d42d131c.837939b7-9cee-40e2-91a9-59337620f795 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:28 devstack sudo[90929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-77cee92a-e8a4-4c97-98ac-ae40d42d131c.837939b7-9cee-40e2-91a9-59337620f795
Apr 09 12:53:28 devstack sudo[90929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:29 devstack sudo[90929]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:29 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e44678a0-9d10-4bc7-bc62-5bc24ab3f687 tempest-CinderUnicodeTest-1468521471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-77cee92a-e8a4-4c97-98ac-ae40d42d131c.837939b7-9cee-40e2-91a9-59337620f795" returned: 0 in 0.691s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:29 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e44678a0-9d10-4bc7-bc62-5bc24ab3f687 tempest-CinderUnicodeTest-1468521471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-77cee92a-e8a4-4c97-98ac-ae40d42d131c.837939b7-9cee-40e2-91a9-59337620f795 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:29 devstack sudo[90927]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:29 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ae03802e-6099-4446-b6cc-5d6419036037 tempest-VolumeDependencyTests-1907829774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-b58cbf29-bc38-4424-ac76-cd8d16ae26a4" returned: 0 in 0.836s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:29 devstack sudo[90935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-77cee92a-e8a4-4c97-98ac-ae40d42d131c.837939b7-9cee-40e2-91a9-59337620f795
Apr 09 12:53:29 devstack sudo[90935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:29 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ae03802e-6099-4446-b6cc-5d6419036037 tempest-VolumeDependencyTests-1907829774 None] Lock "cinder-quobyte-b58cbf29-bc38-4424-ac76-cd8d16ae26a4" released by "delete_volume" :: held 1.649s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:53:29 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-ae03802e-6099-4446-b6cc-5d6419036037 tempest-VolumeDependencyTests-1907829774 None] Created reservations ['4b2bad7e-ec12-410f-8626-7eb30c8d0117', '689d810a-c8b5-4851-ba60-2a59a144c8a6', 'abc22c96-82ed-4b36-92f2-404b25b5cf20', '5e0ea99e-e368-4f47-82c5-f21cb393ed77'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:53:29 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ae03802e-6099-4446-b6cc-5d6419036037 tempest-VolumeDependencyTests-1907829774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:53:29 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ae03802e-6099-4446-b6cc-5d6419036037 tempest-VolumeDependencyTests-1907829774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:53:29 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-ae03802e-6099-4446-b6cc-5d6419036037 tempest-VolumeDependencyTests-1907829774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:53:29 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-ae03802e-6099-4446-b6cc-5d6419036037 tempest-VolumeDependencyTests-1907829774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:53:29 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-ae03802e-6099-4446-b6cc-5d6419036037 tempest-VolumeDependencyTests-1907829774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:53:29 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ae03802e-6099-4446-b6cc-5d6419036037 tempest-VolumeDependencyTests-1907829774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:29 devstack sudo[90937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:53:29 devstack sudo[90937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:30 devstack sudo[90935]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:30 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-e44678a0-9d10-4bc7-bc62-5bc24ab3f687 tempest-CinderUnicodeTest-1468521471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-77cee92a-e8a4-4c97-98ac-ae40d42d131c.837939b7-9cee-40e2-91a9-59337620f795" returned: 0 in 0.490s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:30 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-e44678a0-9d10-4bc7-bc62-5bc24ab3f687 tempest-CinderUnicodeTest-1468521471 None] Lock "cinder-quobyte-837939b7-9cee-40e2-91a9-59337620f795" released by "_delete_snapshot" :: held 2.775s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:53:30 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-e44678a0-9d10-4bc7-bc62-5bc24ab3f687 tempest-CinderUnicodeTest-1468521471 None] Lock "cinder-quobyte-77cee92a-e8a4-4c97-98ac-ae40d42d131c" released by "delete_snapshot" :: held 2.790s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:53:30 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-e44678a0-9d10-4bc7-bc62-5bc24ab3f687 tempest-CinderUnicodeTest-1468521471 None] Created reservations ['aaaf8f78-b610-407a-9ce6-b3095511ce7f', '4581eed7-0a62-432c-9458-037b2a642a4b', 'a63bc553-23f7-47b9-b81b-93b064c45f38', '9b6dbecd-3b88-4f95-9eb3-4f9b62f91cd3'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:53:30 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-e44678a0-9d10-4bc7-bc62-5bc24ab3f687 tempest-CinderUnicodeTest-1468521471 None] Delete snapshot completed successfully.
Apr 09 12:53:30 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-e44678a0-9d10-4bc7-bc62-5bc24ab3f687 tempest-CinderUnicodeTest-1468521471 None] Lock "cinder-837939b7-9cee-40e2-91a9-59337620f795-delete_snapshot" released by "delete_snapshot" :: held 2.928s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:53:30 devstack sudo[90937]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:30 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-ae03802e-6099-4446-b6cc-5d6419036037 tempest-VolumeDependencyTests-1907829774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.564s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:30 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-ae03802e-6099-4446-b6cc-5d6419036037 tempest-VolumeDependencyTests-1907829774 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:53:30 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-ae03802e-6099-4446-b6cc-5d6419036037 tempest-VolumeDependencyTests-1907829774 None] Deleted volume successfully.
Apr 09 12:53:30 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-ae03802e-6099-4446-b6cc-5d6419036037 tempest-VolumeDependencyTests-1907829774 None] Lock "cinder-b58cbf29-bc38-4424-ac76-cd8d16ae26a4-delete_volume" released by "delete_volume" :: held 2.449s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:53:30 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-39cc12a8-9274-4668-89b1-bd9fb1c1e13e tempest-CinderUnicodeTest-1468521471 None] Acquiring lock "cinder-77cee92a-e8a4-4c97-98ac-ae40d42d131c-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:53:30 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-39cc12a8-9274-4668-89b1-bd9fb1c1e13e tempest-CinderUnicodeTest-1468521471 None] Lock "cinder-77cee92a-e8a4-4c97-98ac-ae40d42d131c-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:53:30 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-39cc12a8-9274-4668-89b1-bd9fb1c1e13e tempest-CinderUnicodeTest-1468521471 None] Acquiring lock "cinder-quobyte-77cee92a-e8a4-4c97-98ac-ae40d42d131c" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:53:30 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-39cc12a8-9274-4668-89b1-bd9fb1c1e13e tempest-CinderUnicodeTest-1468521471 None] Lock "cinder-quobyte-77cee92a-e8a4-4c97-98ac-ae40d42d131c" acquired by "delete_volume" :: waited 0.016s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:53:30 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2d40bc-adf7-43ee-9d5c-32453192ec62]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:53:30 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-39cc12a8-9274-4668-89b1-bd9fb1c1e13e tempest-CinderUnicodeTest-1468521471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-77cee92a-e8a4-4c97-98ac-ae40d42d131c {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:30 devstack sudo[90941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-77cee92a-e8a4-4c97-98ac-ae40d42d131c
Apr 09 12:53:30 devstack sudo[90941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:31 devstack sudo[90941]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:31 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-39cc12a8-9274-4668-89b1-bd9fb1c1e13e tempest-CinderUnicodeTest-1468521471 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-77cee92a-e8a4-4c97-98ac-ae40d42d131c" returned: 0 in 0.643s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:31 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-39cc12a8-9274-4668-89b1-bd9fb1c1e13e tempest-CinderUnicodeTest-1468521471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-77cee92a-e8a4-4c97-98ac-ae40d42d131c {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:31 devstack sudo[90946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-77cee92a-e8a4-4c97-98ac-ae40d42d131c
Apr 09 12:53:31 devstack sudo[90946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:31 devstack sudo[90946]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:31 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-39cc12a8-9274-4668-89b1-bd9fb1c1e13e tempest-CinderUnicodeTest-1468521471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-77cee92a-e8a4-4c97-98ac-ae40d42d131c" returned: 0 in 0.623s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:31 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-39cc12a8-9274-4668-89b1-bd9fb1c1e13e tempest-CinderUnicodeTest-1468521471 None] Lock "cinder-quobyte-77cee92a-e8a4-4c97-98ac-ae40d42d131c" released by "delete_volume" :: held 1.308s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:53:31 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-39cc12a8-9274-4668-89b1-bd9fb1c1e13e tempest-CinderUnicodeTest-1468521471 None] Created reservations ['55b1f8c8-1483-4ef6-842b-f976fb97bc79', '38370397-fb0d-4908-b8a1-de36f95152ff', '9bfdb763-3794-4802-9c25-62650f8e466d', '1291028d-9042-4163-917d-8ba093c27620'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:53:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-39cc12a8-9274-4668-89b1-bd9fb1c1e13e tempest-CinderUnicodeTest-1468521471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:53:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-39cc12a8-9274-4668-89b1-bd9fb1c1e13e tempest-CinderUnicodeTest-1468521471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:53:32 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-39cc12a8-9274-4668-89b1-bd9fb1c1e13e tempest-CinderUnicodeTest-1468521471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:53:32 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-39cc12a8-9274-4668-89b1-bd9fb1c1e13e tempest-CinderUnicodeTest-1468521471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:53:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-39cc12a8-9274-4668-89b1-bd9fb1c1e13e tempest-CinderUnicodeTest-1468521471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:53:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-39cc12a8-9274-4668-89b1-bd9fb1c1e13e tempest-CinderUnicodeTest-1468521471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:32 devstack sudo[90949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:53:32 devstack sudo[90949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:32 devstack sudo[90949]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-39cc12a8-9274-4668-89b1-bd9fb1c1e13e tempest-CinderUnicodeTest-1468521471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.546s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:32 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-39cc12a8-9274-4668-89b1-bd9fb1c1e13e tempest-CinderUnicodeTest-1468521471 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:53:32 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-39cc12a8-9274-4668-89b1-bd9fb1c1e13e tempest-CinderUnicodeTest-1468521471 None] Deleted volume successfully.
Apr 09 12:53:32 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-39cc12a8-9274-4668-89b1-bd9fb1c1e13e tempest-CinderUnicodeTest-1468521471 None] Lock "cinder-77cee92a-e8a4-4c97-98ac-ae40d42d131c-delete_volume" released by "delete_volume" :: held 2.048s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:53:32 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-2396d95b-a028-4a13-8f5f-8ddaaa7935e0 tempest-CinderUnicodeTest-1468521471 None] Acquiring lock "cinder-31f49052-5c01-4185-830f-627589cab426-delete_volume" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:53:32 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-2396d95b-a028-4a13-8f5f-8ddaaa7935e0 tempest-CinderUnicodeTest-1468521471 None] Lock "cinder-31f49052-5c01-4185-830f-627589cab426-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:53:32 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-2396d95b-a028-4a13-8f5f-8ddaaa7935e0 tempest-CinderUnicodeTest-1468521471 None] Acquiring lock "cinder-quobyte-31f49052-5c01-4185-830f-627589cab426" by "delete_volume" {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 09 12:53:32 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-2396d95b-a028-4a13-8f5f-8ddaaa7935e0 tempest-CinderUnicodeTest-1468521471 None] Lock "cinder-quobyte-31f49052-5c01-4185-830f-627589cab426" acquired by "delete_volume" :: waited 0.014s {{(pid=82760) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 09 12:53:32 devstack cinder-volume[82760]: DEBUG oslo.privsep.daemon [-] privsep: reply[1745cdcd-4e25-49c2-9d14-0e2b2ca8fbf5]: (4, 'qcow2') {{(pid=83649) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 09 12:53:32 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2396d95b-a028-4a13-8f5f-8ddaaa7935e0 tempest-CinderUnicodeTest-1468521471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-31f49052-5c01-4185-830f-627589cab426 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:32 devstack sudo[90953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-31f49052-5c01-4185-830f-627589cab426
Apr 09 12:53:32 devstack sudo[90953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:33 devstack sudo[90953]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:33 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2396d95b-a028-4a13-8f5f-8ddaaa7935e0 tempest-CinderUnicodeTest-1468521471 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-31f49052-5c01-4185-830f-627589cab426" returned: 0 in 0.674s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:33 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2396d95b-a028-4a13-8f5f-8ddaaa7935e0 tempest-CinderUnicodeTest-1468521471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-31f49052-5c01-4185-830f-627589cab426 {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:33 devstack sudo[90958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-31f49052-5c01-4185-830f-627589cab426
Apr 09 12:53:33 devstack sudo[90958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:34 devstack sudo[90958]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:34 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2396d95b-a028-4a13-8f5f-8ddaaa7935e0 tempest-CinderUnicodeTest-1468521471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b/volume-31f49052-5c01-4185-830f-627589cab426" returned: 0 in 0.607s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:34 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-2396d95b-a028-4a13-8f5f-8ddaaa7935e0 tempest-CinderUnicodeTest-1468521471 None] Lock "cinder-quobyte-31f49052-5c01-4185-830f-627589cab426" released by "delete_volume" :: held 1.313s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:53:34 devstack cinder-volume[82760]: DEBUG cinder.quota [None req-2396d95b-a028-4a13-8f5f-8ddaaa7935e0 tempest-CinderUnicodeTest-1468521471 None] Created reservations ['ed9699c2-ef4f-40a5-b8e9-13c34dbbf80d', '71aac66d-ff2d-4e22-a501-8b0413f0167e', '12e3d2de-27b0-479a-b843-58df776c58f8', 'a5f79c20-14b4-41db-87d5-74c787d22773'] {{(pid=82760) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 09 12:53:34 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-2396d95b-a028-4a13-8f5f-8ddaaa7935e0 tempest-CinderUnicodeTest-1468521471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 09 12:53:34 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-2396d95b-a028-4a13-8f5f-8ddaaa7935e0 tempest-CinderUnicodeTest-1468521471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 09 12:53:34 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-2396d95b-a028-4a13-8f5f-8ddaaa7935e0 tempest-CinderUnicodeTest-1468521471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5': None} {{(pid=82760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 09 12:53:34 devstack cinder-volume[82760]: DEBUG cinder.volume.drivers.quobyte [None req-2396d95b-a028-4a13-8f5f-8ddaaa7935e0 tempest-CinderUnicodeTest-1468521471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a9b1b89c-8adf-467e-9756-08d2ce30d8a5'] {{(pid=82760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 09 12:53:34 devstack cinder-volume[82760]: DEBUG oslo_concurrency.lockutils [None req-2396d95b-a028-4a13-8f5f-8ddaaa7935e0 tempest-CinderUnicodeTest-1468521471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82760) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 09 12:53:34 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2396d95b-a028-4a13-8f5f-8ddaaa7935e0 tempest-CinderUnicodeTest-1468521471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 09 12:53:34 devstack sudo[90961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b
Apr 09 12:53:34 devstack sudo[90961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 09 12:53:34 devstack sudo[90961]: pam_unix(sudo:session): session closed for user root
Apr 09 12:53:34 devstack cinder-volume[82760]: DEBUG oslo_concurrency.processutils [None req-2396d95b-a028-4a13-8f5f-8ddaaa7935e0 tempest-CinderUnicodeTest-1468521471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bc571cece86c568ff420ba799d49834b" returned: 0 in 0.685s {{(pid=82760) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 09 12:53:34 devstack cinder-volume[82760]: DEBUG cinder.manager [None req-2396d95b-a028-4a13-8f5f-8ddaaa7935e0 tempest-CinderUnicodeTest-1468521471 None] Notifying Schedulers of capabilities ... {{(pid=82760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 09 12:53:34 devstack cinder-volume[82760]: INFO cinder.volume.manager [None req-2396d95b-a028-4a13-8f5f-8ddaaa7935e0 tempest-CinderUnicodeTest-1468521471 None] Deleted volume successfully.
Apr 09 12:53:34 devstack cinder-volume[82760]: DEBUG cinder.coordination [None req-2396d95b-a028-4a13-8f5f-8ddaaa7935e0 tempest-CinderUnicodeTest-1468521471 None] Lock "cinder-31f49052-5c01-4185-830f-627589cab426-delete_volume" released by "delete_volume" :: held 2.236s {{(pid=82760) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 09 12:53:44 devstack cinder-volume[82760]: DEBUG dbcounter [-] [82760] Writing DB stats cinder:UPDATE=90,cinder:SELECT=56,cinder:INSERT=23,cinder:DELETE=2 {{(pid=82760) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 09 12:53:44 devstack cinder-volume[82760]: DEBUG dbcounter [-] [82760] Writing DB stats cinder:INSERT=24,cinder:UPDATE=92,cinder:SELECT=65,cinder:DELETE=9 {{(pid=82760) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}